-- Logs begin at Mon 2022-05-16 14:15:25 UTC, end at Mon 2022-05-16 15:40:39 UTC. -- May 16 14:59:54.643460 dv-cinder-790535-39-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 16 14:59:54.651758 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 16 14:59:54.653813 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 14:59:54 2022] *** May 16 14:59:54.653813 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 14:59:54.653813 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 14:59:54.653813 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: nodename: dv-cinder-790535-39-iscsi May 16 14:59:54.653813 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: machine: x86_64 May 16 14:59:54.653813 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: clock source: unix May 16 14:59:54.653813 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: pcre jit disabled May 16 14:59:54.654297 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: detected number of CPU cores: 4 May 16 14:59:54.654297 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: current working directory: / May 16 14:59:54.654297 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: detected binary path: /usr/bin/uwsgi-core May 16 14:59:54.654297 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: your processes number limit is 47680 May 16 14:59:54.654297 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: your memory page size is 4096 bytes May 16 14:59:54.654297 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: detected max file descriptor number: 2048 May 16 14:59:54.654297 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: lock engine: pthread robust mutexes May 16 14:59:54.654297 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: thunder lock: enabled May 16 14:59:54.654664 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 16 14:59:54.654664 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 14:59:54.702320 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: Python main interpreter initialized at 0x557b82f669c0 May 16 14:59:54.702320 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: python threads support enabled May 16 14:59:54.702320 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: your server socket listen backlog is limited to 100 connections May 16 14:59:54.702320 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: your mercy for graceful operations on workers is 90 seconds May 16 14:59:54.702705 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: mapped 403077 bytes (393 KB) for 2 cores May 16 14:59:54.702826 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: *** Operational MODE: preforking *** May 16 14:59:54.703107 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: *** uWSGI is running in multiple interpreter mode *** May 16 14:59:54.703107 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: spawned uWSGI master process (pid: 80307) May 16 14:59:54.703323 dv-cinder-790535-39-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 16 14:59:54.704339 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: spawned uWSGI worker 1 (pid: 80319, cores: 1) May 16 14:59:54.707208 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: spawned uWSGI worker 2 (pid: 80320, cores: 1) May 16 14:59:54.707208 dv-cinder-790535-39-iscsi devstack@keystone.service[80307]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 15:00:00.462795 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:00:00.462795 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: from cryptography.utils import int_from_bytes May 16 15:00:00.463597 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:00:00.463597 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: from cryptography.utils import int_from_bytes May 16 15:00:00.464094 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:00:00.464094 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: from cryptography.utils import int_from_bytes May 16 15:00:00.464292 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:00:00.464292 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: from cryptography.utils import int_from_bytes May 16 15:00:00.514091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 15:00:00.514302 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 15:00:00.514498 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] command line args: [] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 15:00:00.514809 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 15:00:00.514992 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ================================================================================ {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 15:00:00.515248 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] admin_token = **** {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.515494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] config_dir = [] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.515782 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.515977 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] config_source = [] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.516161 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] debug = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.516361 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.517530 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.517530 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.517530 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.517530 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.517789 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] list_limit = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.517789 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] log_config_append = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.517940 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.518175 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] log_dir = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.518350 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] log_file = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.518590 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.518842 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.519098 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.519349 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.519454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 15:00:00.519532 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.519628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 15:00:00.519741 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.519825 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] command line args: [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 15:00:00.519934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.520080 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 15:00:00.520180 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.520259 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ================================================================================ {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 15:00:00.520392 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.520492 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] admin_token = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.520628 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.520722 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] config_dir = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.520860 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.520959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.521070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] config_source = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.521171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.521245 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] debug = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.521324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.521444 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.521553 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.521682 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.521828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.521955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.522100 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.522353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.76/identity {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.522439 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.522527 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] publish_errors = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.522606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.522769 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] log_config_append = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.522851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.523019 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.523115 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.523214 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.523276 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] log_dir = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.523365 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] log_file = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.523471 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.523606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.523693 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.523855 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.523949 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] standard_threads = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.524093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.524169 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.524340 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.524416 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.524518 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.524594 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.524694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] use_journal = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.524773 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.524874 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] use_json = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.524960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.525036 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] use_stderr = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.525168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.525250 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] use_syslog = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.525405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.525480 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.525640 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.525807 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.525886 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.525957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.526192 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.526284 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.526407 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.526484 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.526655 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.526737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.526922 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.527005 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.527174 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.527409 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.76/identity {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.527491 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.527576 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] publish_errors = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.527652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.527813 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.527895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.528044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.528131 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.528224 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.528351 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.528470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.528600 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.528707 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.528840 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.528945 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] standard_threads = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.529096 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.529171 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.529343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.529421 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.529573 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.529648 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.529749 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] use_journal = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.529832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.529925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] use_json = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.530067 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.530239 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] use_stderr = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.530315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] use_syslog = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.530383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.530513 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:00:00.530596 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.530773 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.530861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.531013 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.531090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.531273 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.531350 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.531513 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.531600 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.531762 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.531845 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.532001 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.532077 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.532232 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.532316 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.532472 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.532554 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.532721 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.532804 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.532966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.533051 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.533196 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.533271 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.533429 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.533505 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.534223 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.534321 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.534464 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.534545 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.534705 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.534786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.534950 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.535035 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.535313 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.535436 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.535539 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.535641 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.535736 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.535841 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.535937 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.536040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.536140 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.536261 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.536334 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.536503 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.536589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.536658 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.536789 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.536867 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.537044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.537123 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.537279 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.537388 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.537516 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.537591 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.537745 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.537822 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.537979 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.538055 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.538238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.538317 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.542319 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.542440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.542533 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.542612 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.542612 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.542744 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.542744 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.542876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.542954 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.543026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.543026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.543149 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.543149 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.543318 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.543398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.543468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.543468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.543592 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.543667 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.543745 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.543816 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.543891 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.543961 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.544030 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.544110 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.544186 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.544264 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.544336 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.544410 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.544480 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.544549 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.544623 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.544701 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.544772 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.544841 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.544910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.544984 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.545053 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.545201 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.545314 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.545427 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.545503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.545578 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.545657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.545728 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.545728 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.545860 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.545975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.546049 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.546148 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.546232 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.546303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.546373 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.546449 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.546521 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.546600 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.546671 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.546741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.546809 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.546878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.546946 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.547027 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.547105 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.547184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.547255 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.547331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.547403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.547477 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.547548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.547624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.547695 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.547764 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.547838 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.547909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.547978 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.548057 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.548128 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.548250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.548326 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.548326 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.548451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.548528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.548599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.548675 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.548746 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.548821 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.548896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.548973 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.549044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.549112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.549181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.549255 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.549359 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.549975 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.550054 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.550146 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.550230 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.550303 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.550415 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.550528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.550658 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.550789 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.550944 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.551057 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.551177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.551295 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.551380 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.551533 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] auth.external = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.551611 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.551768 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.551846 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.552058 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.552135 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.552289 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.552366 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.552523 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] auth.password = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.552600 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.552758 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] auth.token = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.552900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.552997 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.553073 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.553231 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.553315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.553463 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.553538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.553697 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.553773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.553930 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.554015 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.554192 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.554275 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.554426 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.554537 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.554667 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] credential.caching = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.554747 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.554903 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.554979 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.555156 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.555234 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.555394 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.555470 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.555631 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.555715 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.555878 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.555957 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.556127 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.556212 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.556411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.556561 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.external = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.556637 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.556713 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.556893 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.556971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.557149 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.557239 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.557378 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.password = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.557455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.557613 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.token = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.557692 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.557854 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.557940 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.558093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.558193 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.558367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.558444 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.558601 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.558694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] federation.caching = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.558850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.558935 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.559101 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.559181 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.559334 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.559420 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.559573 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.559651 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.559821 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.559898 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.560060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.560147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.560306 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.560382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.560544 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.560660 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.560877 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.560981 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.561057 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.561127 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.561302 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.561383 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.561540 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.caching = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.561627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.561791 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.561871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.562040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.562119 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.562699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.562810 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.562916 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.563014 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.563111 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.563207 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.563303 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.563407 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.563511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.563609 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.563713 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.563816 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.563913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.564017 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.564121 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.564219 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.564407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.564509 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.564606 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.564712 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.564820 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.564960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.565083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.565181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.565285 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.565390 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.565489 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.565586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.565687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.565799 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.565904 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.566028 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.566165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.566276 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.566373 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.566470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.566578 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.566683 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.566779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.566899 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.567004 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.567138 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.567269 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.567378 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.567458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.567627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.567705 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.567862 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.567947 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.568134 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.568220 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.568369 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.568458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.568607 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.568696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.568841 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.568920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.569073 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.569157 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.569305 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.569391 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.569552 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.569632 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.569799 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.569876 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.570044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.570192 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.570312 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.576668 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.576786 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.576865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.576939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.577024 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.577098 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.577168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.577238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.577308 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.577378 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.577456 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.577529 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.577600 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.577669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.577739 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.577809 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.577889 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.577961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.578031 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.578102 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.578206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.578279 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.578361 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.578435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.578506 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.578576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.578647 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.578717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.578799 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.578872 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.578943 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.579013 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.579084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.579084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.579215 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.579277 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.579346 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.579416 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.579492 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.579564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.579648 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.579722 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.579792 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.579863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.579932 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.580002 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.580081 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.580155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.580225 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.580295 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.580365 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.580435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.580513 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.580586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.580586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.580712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.580787 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.580865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.580938 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.581008 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.581079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.581149 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.581219 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.581296 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.581374 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.581446 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.581515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.581585 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.581655 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.581735 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.581852 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.581950 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.582045 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.582160 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.582264 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.582443 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.582545 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.582642 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.582738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.582834 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.582929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.583033 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.583131 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.583228 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.583324 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.583419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.583515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.583617 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.583715 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.583810 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.583906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.584002 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.584097 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.584201 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.584299 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.584395 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.584491 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.584586 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.584681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.584785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.584883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.584979 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.585075 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.585170 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] resource.caching = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.585265 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.585369 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.585466 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.585561 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.585656 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.585752 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.585854 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.585959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.586058 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.586671 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.586749 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.586822 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.586907 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.586982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.587054 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.587124 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.587194 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.587265 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.587343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.587422 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] role.caching = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.587494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.587564 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] role.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.587634 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.587703 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.587781 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.587853 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.587923 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.587993 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.588064 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.588123 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.588200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.588272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.588344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.588344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.588471 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.588541 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.588619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.588692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.588761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.588831 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.588901 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.588971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.589048 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.589120 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.589190 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.589260 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.589329 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.589399 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.589476 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.589549 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.589618 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.589688 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.589758 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.589837 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.589909 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.589987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.590059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.590177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] role.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.590253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.590337 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] role.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.590416 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.590488 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.590558 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.590629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.590702 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.590781 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.590855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.590925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.590994 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.591065 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.591134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.591212 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.591285 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.591355 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.591456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.591538 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.591690 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.591779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.591946 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.592027 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.592191 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.592269 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.592439 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.592524 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.592679 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.592758 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.592918 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.592996 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.593152 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.593333 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.593413 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] token.caching = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.593572 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.593650 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.593823 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.593902 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.594074 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.594171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.594351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.594430 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.594630 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.594739 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.594873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.595073 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.595155 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.595226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.595347 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.595428 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.595592 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.595671 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.595826 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.595905 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.596058 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.596630 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.596812 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.596890 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.597064 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.597141 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.597313 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.597402 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.597548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.597627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.597785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.597863 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.598023 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.598109 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.598281 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.598361 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] database.connection = **** {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.598519 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] token.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.598608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.598758 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.598837 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.599008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.599095 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.599247 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.599325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.599504 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.599581 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.599745 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.599833 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.599978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.600055 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.600215 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.600341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.600456 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.600608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.600684 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.600755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.600923 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.601003 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.601158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.601244 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.601395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.601474 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.601642 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.601724 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.601892 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.601979 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.602140 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.602223 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.602391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.602469 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.602639 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.605270 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.605400 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 15:00:00.605478 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.connection = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.605478 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.605478 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.605478 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.605478 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.605478 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.605478 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.605478 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.605478 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.606037 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.606037 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.606037 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.606037 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.606037 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.606426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.606426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.606662 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.606905 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.607141 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:00:00.607313 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 15:00:00.634966 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.635200 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.635430 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.638044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.638307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.638535 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.644990 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.647334 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.680391 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.680512 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.680624 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.680760 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.746074 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.746252 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.800984 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.801214 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.804326 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.804573 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.875468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.875693 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.875785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.875920 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.876006 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.876144 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.876230 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.876364 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.876446 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.876583 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.876665 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.876827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.905023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.905135 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.905255 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.905371 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.905470 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.905604 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.905686 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.905829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.905913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.906047 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.906172 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.906314 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.906396 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.906542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.918426 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.918521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.932991 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.933223 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.933448 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.933530 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.938702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.938787 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.938873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.938949 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.939022 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.939102 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.939177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.939249 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.939249 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.939249 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80320) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 15:00:00.955084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.955298 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 15:00:00.956179 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.956269 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.956381 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 15:00:00.956463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 15:00:00.956651 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.956735 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.956904 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 15:00:00.956985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.957157 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.957246 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.957410 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.957492 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.957663 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.957918 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.968471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.968746 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.969016 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.969176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.969299 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.969456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.969726 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.970005 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.978016 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:00.978801 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:00.981343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:00.981624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.982015 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.982163 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:00.982326 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.982454 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.989025 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.989165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.989287 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.989287 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.989414 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.989486 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.989566 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.989640 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.989705 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.989776 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.989847 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.989918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.989998 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.989998 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.989998 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:00.989998 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.010750 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.012428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.012586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.012866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.014155 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.014509 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.019176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.019176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.019561 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.020511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.020901 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.021187 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.028859 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.029148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.029230 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.029511 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.034005 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.034255 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.034341 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.034544 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.034626 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.034827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.034920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.035109 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.035191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.035378 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.035476 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.035648 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.035740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.035914 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.035994 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.036216 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.055748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.055893 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.056025 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.056172 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.060608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.060765 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.064255 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.064473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.064556 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.064770 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.069568 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.069845 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.073165 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.073467 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.076919 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.077216 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.077301 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.077501 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.077584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.077786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.077877 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.078063 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.078167 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.078367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.078450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.078644 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.097917 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.098314 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.098398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.098589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.098776 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.098870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.099045 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.099309 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.106810 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.107263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.108538 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.108817 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.108992 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.109268 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.112480 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.112759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.112882 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.113040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.113161 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.113335 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.113438 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.113612 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.113714 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.114001 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.127115 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.127447 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.127705 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.127788 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.127981 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.128063 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.128265 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.128353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.128547 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.128629 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.128820 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.128903 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.129098 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.129371 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.147870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.148467 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.151189 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.151791 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.154562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.155149 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.156150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.156770 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.157799 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.158080 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.158400 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.158481 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.159230 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.159520 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.166461 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.167060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.168082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.168684 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.171352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.171647 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.171930 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.172011 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.172208 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.172289 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.172505 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.173001 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.181644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.181938 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.182253 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.182698 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.183188 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.183503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.192168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.192451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.192734 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.193023 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.193299 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.193593 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.193869 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.194184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.194458 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.194611 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80320) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 15:00:01.194725 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.194893 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.194995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.195175 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.195279 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.195450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.195531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.195721 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.195810 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.196004 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.196276 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.196557 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.196827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.197094 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.197364 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.197657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.197905 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.198197 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80320) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 15:00:01.237661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x557b82f669c0 pid: 80319 (default app) May 16 15:00:01.238923 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x557b82f669c0 pid: 80320 (default app) May 16 15:00:01.241136 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a2377-552a-42cd-9b52-95212d255bbd None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:01.241449 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a2377-552a-42cd-9b52-95212d255bbd None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:01.241736 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a2377-552a-42cd-9b52-95212d255bbd None None] PATH_INFO: `/v3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:01.245966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1/1] 10.222.0.76 () {50 vars in 791 bytes} [Mon May 16 15:00:01 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:10.388730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f85c51-5828-440e-a566-59c7040e29c6 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:10.389240 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f85c51-5828-440e-a566-59c7040e29c6 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:10.389319 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f85c51-5828-440e-a566-59c7040e29c6 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:10.393602 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1/2] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:00:10.399526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be80c15-0a36-4d6f-b10b-f5c41300ad7d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:10.399893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be80c15-0a36-4d6f-b10b-f5c41300ad7d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:10.400083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be80c15-0a36-4d6f-b10b-f5c41300ad7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:10.430732 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG oslo_db.sqlalchemy.engines [None req-0be80c15-0a36-4d6f-b10b-f5c41300ad7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:00:10.617871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG passlib.handlers.bcrypt [None req-0be80c15-0a36-4d6f-b10b-f5c41300ad7d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80319) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 16 15:00:10.618318 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG passlib.handlers.bcrypt [None req-0be80c15-0a36-4d6f-b10b-f5c41300ad7d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80319) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 16 15:00:10.674361 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-0be80c15-0a36-4d6f-b10b-f5c41300ad7d None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:10.676450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0be80c15-0a36-4d6f-b10b-f5c41300ad7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:10.799441 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 2/3] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 16 15:00:10.969862 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f85c51-5828-440e-a566-59c7040e29c6 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:11.004181 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG oslo_db.sqlalchemy.engines [None req-d1f85c51-5828-440e-a566-59c7040e29c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80320) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:00:11.132068 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f85c51-5828-440e-a566-59c7040e29c6 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:11.137812 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8777b34-c29a-4c20-872d-f8fae36712fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:11.138508 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8777b34-c29a-4c20-872d-f8fae36712fe admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:11.138794 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8777b34-c29a-4c20-872d-f8fae36712fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:11.139068 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8777b34-c29a-4c20-872d-f8fae36712fe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:11.147386 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8777b34-c29a-4c20-872d-f8fae36712fe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:11.199423 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d8777b34-c29a-4c20-872d-f8fae36712fe admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 16 15:00:11.199767 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8777b34-c29a-4c20-872d-f8fae36712fe admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:11.209165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 2/4] 10.222.0.76 () {58 vars in 1324 bytes} [Mon May 16 15:00:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 15:00:11.215131 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be80c15-0a36-4d6f-b10b-f5c41300ad7d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:11.229608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be80c15-0a36-4d6f-b10b-f5c41300ad7d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:11.233849 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ca00e-e13f-4f5a-8822-970f17808238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:11.234988 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ca00e-e13f-4f5a-8822-970f17808238 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:11.235269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ca00e-e13f-4f5a-8822-970f17808238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:11.235546 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ca00e-e13f-4f5a-8822-970f17808238 admin admin] PATH_INFO: `/v3/projects/1c01b64ed2e84249921cacc6ee5ef7ac` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:11.237059 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ca00e-e13f-4f5a-8822-970f17808238 admin admin] RBAC: Authorizing `identity:get_project(project_id=1c01b64ed2e84249921cacc6ee5ef7ac)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:11.288525 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a52ca00e-e13f-4f5a-8822-970f17808238 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 16 15:00:11.288865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ca00e-e13f-4f5a-8822-970f17808238 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:11.293345 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 3/5] 10.222.0.76 () {56 vars in 1207 bytes} [Mon May 16 15:00:11 2022] GET /identity/v3/projects/1c01b64ed2e84249921cacc6ee5ef7ac => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:13.479860 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78dc0d3-b1b5-43fb-b851-e3fa4ee08ef1 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:13.480373 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78dc0d3-b1b5-43fb-b851-e3fa4ee08ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:13.480456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78dc0d3-b1b5-43fb-b851-e3fa4ee08ef1 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:13.484533 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 3/6] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:00:13.490053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d3143-5880-4eac-9b58-5dfbd4584907 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:13.490502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d3143-5880-4eac-9b58-5dfbd4584907 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:13.490653 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d3143-5880-4eac-9b58-5dfbd4584907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:13.511494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-0f4d3143-5880-4eac-9b58-5dfbd4584907 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:13.513042 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0f4d3143-5880-4eac-9b58-5dfbd4584907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:13.521850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 4/7] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 16 15:00:13.544322 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78dc0d3-b1b5-43fb-b851-e3fa4ee08ef1 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:13.556714 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78dc0d3-b1b5-43fb-b851-e3fa4ee08ef1 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:13.560895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320549a-03e9-477e-aa34-dd02cd70985e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:13.561526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320549a-03e9-477e-aa34-dd02cd70985e admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:13.561807 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320549a-03e9-477e-aa34-dd02cd70985e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:13.562082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320549a-03e9-477e-aa34-dd02cd70985e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:13.570344 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320549a-03e9-477e-aa34-dd02cd70985e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:13.572139 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320549a-03e9-477e-aa34-dd02cd70985e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:13.580648 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 4/8] 10.222.0.76 () {58 vars in 1324 bytes} [Mon May 16 15:00:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:00:13.586155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d3143-5880-4eac-9b58-5dfbd4584907 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:13.595188 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d3143-5880-4eac-9b58-5dfbd4584907 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:13.599872 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680c881-4aac-4b77-8a6a-39c64489260c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:13.600729 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680c881-4aac-4b77-8a6a-39c64489260c admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:13.601016 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680c881-4aac-4b77-8a6a-39c64489260c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:13.601295 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680c881-4aac-4b77-8a6a-39c64489260c admin admin] PATH_INFO: `/v3/users/cfa3cc953e414bc0b20f729623352259` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:13.602724 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680c881-4aac-4b77-8a6a-39c64489260c admin admin] RBAC: Authorizing `identity:get_user(user_id=cfa3cc953e414bc0b20f729623352259)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:13.604607 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680c881-4aac-4b77-8a6a-39c64489260c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:13.606205 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 5/9] 10.222.0.76 () {56 vars in 1198 bytes} [Mon May 16 15:00:13 2022] GET /identity/v3/users/cfa3cc953e414bc0b20f729623352259 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:15.886043 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcdbc8-0358-451d-a551-bd2aee6fd814 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:15.886583 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcdbc8-0358-451d-a551-bd2aee6fd814 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:15.886664 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcdbc8-0358-451d-a551-bd2aee6fd814 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:15.887979 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 5/10] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:15.893105 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029b27c-d47e-4d49-ba78-332269330555 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:15.893481 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029b27c-d47e-4d49-ba78-332269330555 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:15.894318 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029b27c-d47e-4d49-ba78-332269330555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:15.895937 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b5257-3629-4c14-a9a2-4f3597320a3b None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:15.896222 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b5257-3629-4c14-a9a2-4f3597320a3b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:15.896499 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b5257-3629-4c14-a9a2-4f3597320a3b None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:15.897724 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 6/11] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:00:15.902697 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd2425-966e-4f84-8f17-5f6fadde6cb1 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:15.902987 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd2425-966e-4f84-8f17-5f6fadde6cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:15.903265 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd2425-966e-4f84-8f17-5f6fadde6cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:15.944984 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG passlib.handlers.bcrypt [None req-29cd2425-966e-4f84-8f17-5f6fadde6cb1 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80320) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 16 15:00:15.945413 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG passlib.handlers.bcrypt [None req-29cd2425-966e-4f84-8f17-5f6fadde6cb1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80320) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 16 15:00:15.993790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-29cd2425-966e-4f84-8f17-5f6fadde6cb1 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:15.995461 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-29cd2425-966e-4f84-8f17-5f6fadde6cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:16.022809 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-5029b27c-d47e-4d49-ba78-332269330555 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:16.024008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5029b27c-d47e-4d49-ba78-332269330555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:16.100022 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 6/12] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:16.105532 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 7/13] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:00:16.123060 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029b27c-d47e-4d49-ba78-332269330555 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:16.127214 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd2425-966e-4f84-8f17-5f6fadde6cb1 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:16.218259 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029b27c-d47e-4d49-ba78-332269330555 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:16.223088 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd2425-966e-4f84-8f17-5f6fadde6cb1 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:16.250925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652a2e9-1d43-4ce0-8af3-d826d435c410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:16.251714 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652a2e9-1d43-4ce0-8af3-d826d435c410 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:16.251999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652a2e9-1d43-4ce0-8af3-d826d435c410 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:16.252301 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652a2e9-1d43-4ce0-8af3-d826d435c410 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:16.255378 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb62f30-cd93-46fe-aa72-56e2d5dc5621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:16.256269 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb62f30-cd93-46fe-aa72-56e2d5dc5621 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:16.256556 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb62f30-cd93-46fe-aa72-56e2d5dc5621 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:16.256834 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb62f30-cd93-46fe-aa72-56e2d5dc5621 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:16.263420 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652a2e9-1d43-4ce0-8af3-d826d435c410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:16.274498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-0652a2e9-1d43-4ce0-8af3-d826d435c410 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:00:16.274498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:16.274498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:16.274498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:16.274498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:16.274498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:16.274498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:16.274498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:16.274498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:16.274498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:16.274498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:16.274498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:16.274498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:16.274498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:16.274498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:16.274498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:16.275370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:16.275370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:16.275370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:16.275370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:16.275370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:16.275370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:16.275370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:16.275370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:16.275370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:16.275370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:16.275370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:16.275370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:00:16.275370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:16.275370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:16.275370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:16.275370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:16.276133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:16.276133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:16.276133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:16.276133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:16.276133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:16.276133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:16.276133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:16.276133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:16.276133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:16.276133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:16.276133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:00:16.276133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:00:16.276133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 7/14] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:00:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:00:16.281420 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652a2e9-1d43-4ce0-8af3-d826d435c410 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:16.322573 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb62f30-cd93-46fe-aa72-56e2d5dc5621 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:16.324116 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb62f30-cd93-46fe-aa72-56e2d5dc5621 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:16.376595 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652a2e9-1d43-4ce0-8af3-d826d435c410 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:16.409791 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ef501-5ba5-4d10-9a25-259c0427a237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:16.410481 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ef501-5ba5-4d10-9a25-259c0427a237 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:16.410769 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ef501-5ba5-4d10-9a25-259c0427a237 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:16.411047 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ef501-5ba5-4d10-9a25-259c0427a237 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:16.411794 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ef501-5ba5-4d10-9a25-259c0427a237 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:16.412102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ef501-5ba5-4d10-9a25-259c0427a237 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:16.413498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ef501-5ba5-4d10-9a25-259c0427a237 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:16.418388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 8/15] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:00:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 15:00:16.423653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb62f30-cd93-46fe-aa72-56e2d5dc5621 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:16.425750 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 8/16] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:00:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:00:16.431191 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ef501-5ba5-4d10-9a25-259c0427a237 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:16.534865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ef501-5ba5-4d10-9a25-259c0427a237 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:16.571283 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaa485-011a-45fb-b479-885b883d294f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:16.572182 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaa485-011a-45fb-b479-885b883d294f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:16.572466 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaa485-011a-45fb-b479-885b883d294f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:16.572743 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaa485-011a-45fb-b479-885b883d294f None admin] PATH_INFO: `/v3/users/cfa3cc953e414bc0b20f729623352259` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:16.573946 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcaa485-011a-45fb-b479-885b883d294f None admin] RBAC: Authorizing `identity:get_user(user_id=cfa3cc953e414bc0b20f729623352259)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:16.575436 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcaa485-011a-45fb-b479-885b883d294f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:16.577259 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 9/17] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:16 2022] GET /identity/v3/users/cfa3cc953e414bc0b20f729623352259 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:00:16.582429 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaa485-011a-45fb-b479-885b883d294f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:16.631493 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb62f30-cd93-46fe-aa72-56e2d5dc5621 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:16.664744 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a4447-4b08-4378-aa78-853fc2dda05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:16.665536 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a4447-4b08-4378-aa78-853fc2dda05a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:16.665819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a4447-4b08-4378-aa78-853fc2dda05a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:16.666104 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a4447-4b08-4378-aa78-853fc2dda05a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:16.676151 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaa485-011a-45fb-b479-885b883d294f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:16.684372 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a4447-4b08-4378-aa78-853fc2dda05a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:16.685858 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a4447-4b08-4378-aa78-853fc2dda05a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:16.705528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-f24a4447-4b08-4378-aa78-853fc2dda05a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:00:16.705528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:16.705528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:16.705528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:16.705528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:16.705528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:16.705528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:16.705528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:16.705528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:16.705528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:16.705528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:16.705528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:16.705528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:00:16.705528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:00:16.705528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:00:16.707072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:00:16.707072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:16.707072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:16.707072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:16.707072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:16.707072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:16.707072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:16.707072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:16.707072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:00:16.707072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:16.707072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:16.707072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:16.707072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:16.707072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:16.707072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:16.707072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:16.707072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:16.708046 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:00:16.708046 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:00:16.708046 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:00:16.708046 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:00:16.708046 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 9/18] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:00:16.711053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f900b0-b572-48bf-b0b9-262d31f304d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:16.711940 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f900b0-b572-48bf-b0b9-262d31f304d5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:16.712237 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f900b0-b572-48bf-b0b9-262d31f304d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:16.712514 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f900b0-b572-48bf-b0b9-262d31f304d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:16.712950 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a4447-4b08-4378-aa78-853fc2dda05a None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:16.713985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f900b0-b572-48bf-b0b9-262d31f304d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:16.715467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f900b0-b572-48bf-b0b9-262d31f304d5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:16.717083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 10/19] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:00:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:00:16.723120 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f900b0-b572-48bf-b0b9-262d31f304d5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:16.806905 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a4447-4b08-4378-aa78-853fc2dda05a None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:16.816097 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f900b0-b572-48bf-b0b9-262d31f304d5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:16.838438 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039df53-e570-485e-ac65-d834cf1ab493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:16.839084 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039df53-e570-485e-ac65-d834cf1ab493 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:16.839366 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039df53-e570-485e-ac65-d834cf1ab493 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:16.839635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039df53-e570-485e-ac65-d834cf1ab493 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:16.840347 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039df53-e570-485e-ac65-d834cf1ab493 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:16.840647 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039df53-e570-485e-ac65-d834cf1ab493 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:16.842021 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039df53-e570-485e-ac65-d834cf1ab493 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:16.848879 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155bac6e-9bea-4455-bd04-50240be3d64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:16.849528 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bac6e-9bea-4455-bd04-50240be3d64a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:16.849813 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bac6e-9bea-4455-bd04-50240be3d64a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:16.850093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bac6e-9bea-4455-bd04-50240be3d64a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:16.850963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155bac6e-9bea-4455-bd04-50240be3d64a None admin] RBAC: Adding query filter params (role.id=f6c8fc0dc0f24de3907b0960a1201901, scope.domain.id=default, user.id=cfa3cc953e414bc0b20f729623352259) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:16.851276 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155bac6e-9bea-4455-bd04-50240be3d64a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:16.852709 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155bac6e-9bea-4455-bd04-50240be3d64a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:16.858914 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 10/20] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:00:16.859266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 11/21] 10.222.0.76 () {56 vars in 1322 bytes} [Mon May 16 15:00:16 2022] GET /identity/v3/role_assignments?user.id=cfa3cc953e414bc0b20f729623352259&scope.domain.id=default&role.id=f6c8fc0dc0f24de3907b0960a1201901 => generated 233 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:00:19.551067 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac206b7-cadd-4f89-8461-e70cbd2a3495 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:19.551617 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac206b7-cadd-4f89-8461-e70cbd2a3495 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:19.551617 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac206b7-cadd-4f89-8461-e70cbd2a3495 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:19.553243 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 11/22] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:19.571954 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601387ff-752a-41d8-bf7d-136fef7900d8 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:19.572877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601387ff-752a-41d8-bf7d-136fef7900d8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:19.573370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601387ff-752a-41d8-bf7d-136fef7900d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:19.591772 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-601387ff-752a-41d8-bf7d-136fef7900d8 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:19.593177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-601387ff-752a-41d8-bf7d-136fef7900d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:19.598160 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd1e05-871e-47b2-8ea5-4c3b52ed0963 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:19.598160 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd1e05-871e-47b2-8ea5-4c3b52ed0963 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:19.598160 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd1e05-871e-47b2-8ea5-4c3b52ed0963 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:19.599351 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 12/23] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:19.604872 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84b694-0b60-496c-b15d-c0ae165172de None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:19.605397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84b694-0b60-496c-b15d-c0ae165172de None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:19.605893 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84b694-0b60-496c-b15d-c0ae165172de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:19.623972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-dd84b694-0b60-496c-b15d-c0ae165172de None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:19.625468 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-dd84b694-0b60-496c-b15d-c0ae165172de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:19.685178 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 12/24] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:00:19.686559 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6d3a2-e516-4ee9-9d81-0c4e4a0acc2a None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:19.686872 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6d3a2-e516-4ee9-9d81-0c4e4a0acc2a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:19.687123 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6d3a2-e516-4ee9-9d81-0c4e4a0acc2a None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:19.688687 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 13/25] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:19.706748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa920a-5390-40ea-be68-ffea19e8d10a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:19.707035 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa920a-5390-40ea-be68-ffea19e8d10a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:19.707319 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa920a-5390-40ea-be68-ffea19e8d10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:19.730993 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6caa920a-5390-40ea-be68-ffea19e8d10a None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:19.732186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6caa920a-5390-40ea-be68-ffea19e8d10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:19.735660 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 13/26] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:00:19.736431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84b694-0b60-496c-b15d-c0ae165172de None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:19.810930 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 14/27] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:19.811738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa920a-5390-40ea-be68-ffea19e8d10a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:19.923757 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84b694-0b60-496c-b15d-c0ae165172de None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:19.961441 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa920a-5390-40ea-be68-ffea19e8d10a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:19.965850 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571fb6c-694e-4e3e-837e-93fe728ab945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:19.966930 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571fb6c-694e-4e3e-837e-93fe728ab945 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:19.967434 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571fb6c-694e-4e3e-837e-93fe728ab945 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:19.967903 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571fb6c-694e-4e3e-837e-93fe728ab945 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:19.987363 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571fb6c-694e-4e3e-837e-93fe728ab945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:19.990656 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571fb6c-694e-4e3e-837e-93fe728ab945 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:20.021289 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-d571fb6c-694e-4e3e-837e-93fe728ab945 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:00:20.021289 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:20.021289 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:20.021289 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:20.021289 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:20.021289 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:20.021289 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:20.021289 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:20.021289 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:20.021289 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:20.021289 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:20.021289 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:20.021289 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:00:20.021289 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:00:20.021289 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:00:20.022192 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:00:20.022192 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:20.022192 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:20.022192 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:20.022192 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:20.022192 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:20.022192 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:20.022192 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:20.022192 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:00:20.022192 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:20.022192 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:20.022192 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:20.022192 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:20.022192 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:20.022192 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:20.022192 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:20.022192 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:20.023023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:00:20.023023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:00:20.023023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:00:20.023023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:00:20.023023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 14/28] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:00:20.023639 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571fb6c-694e-4e3e-837e-93fe728ab945 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:20.039561 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc02202-6c2d-4914-8f7a-7fa833dbab3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:20.040829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc02202-6c2d-4914-8f7a-7fa833dbab3e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:20.041241 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc02202-6c2d-4914-8f7a-7fa833dbab3e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:20.041650 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc02202-6c2d-4914-8f7a-7fa833dbab3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:20.055760 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc02202-6c2d-4914-8f7a-7fa833dbab3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:20.071643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-2bc02202-6c2d-4914-8f7a-7fa833dbab3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:00:20.071643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:20.071643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:20.071643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:20.071643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:20.071643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:20.071643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:20.071643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:20.071643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:20.071643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:20.071643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:20.071643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:20.071643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:20.071643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:20.071643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:20.071643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:20.072517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:20.072517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:20.072517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:20.072517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:20.072517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:20.072517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:20.072517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:20.072517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:20.072517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:20.072517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:20.072517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:20.072517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:00:20.072517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:20.072517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:20.072517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:20.072517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:20.073268 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:20.073268 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:20.073268 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:20.073268 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:20.073268 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:20.073268 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:20.073268 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:20.073268 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:20.073268 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:20.073268 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:20.073268 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:00:20.073268 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:00:20.076166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 15/29] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:00:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:00:20.077600 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c9f44-d571-45ce-84a9-9a7a16c57614 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:20.078025 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c9f44-d571-45ce-84a9-9a7a16c57614 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:20.078674 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c9f44-d571-45ce-84a9-9a7a16c57614 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:20.081417 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 16/30] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:20.082773 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c9f44-d571-45ce-84a9-9a7a16c57614 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:20.146157 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571fb6c-694e-4e3e-837e-93fe728ab945 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:20.180607 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fe836-3cc1-42bd-bb61-e31326f49bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:20.181674 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fe836-3cc1-42bd-bb61-e31326f49bc5 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:20.182256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fe836-3cc1-42bd-bb61-e31326f49bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:20.182732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fe836-3cc1-42bd-bb61-e31326f49bc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:20.183675 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3fe836-3cc1-42bd-bb61-e31326f49bc5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:20.185263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3fe836-3cc1-42bd-bb61-e31326f49bc5 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:20.204473 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c9f44-d571-45ce-84a9-9a7a16c57614 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:20.239261 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e806c10-e89c-4d8a-b3e7-129b48e38420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:20.239924 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e806c10-e89c-4d8a-b3e7-129b48e38420 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:20.240210 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e806c10-e89c-4d8a-b3e7-129b48e38420 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:20.240496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e806c10-e89c-4d8a-b3e7-129b48e38420 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:20.241222 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e806c10-e89c-4d8a-b3e7-129b48e38420 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:20.241528 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e806c10-e89c-4d8a-b3e7-129b48e38420 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:20.243014 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e806c10-e89c-4d8a-b3e7-129b48e38420 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:20.265462 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 17/31] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:20.265462 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e806c10-e89c-4d8a-b3e7-129b48e38420 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:20.373912 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e806c10-e89c-4d8a-b3e7-129b48e38420 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:20.400617 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 15/32] 10.222.0.76 () {60 vars in 1131 bytes} [Mon May 16 15:00:20 2022] POST /identity/v3/roles => generated 219 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:00:20.402181 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858027e-fce2-472f-9356-ca28fd5389e9 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:20.402507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858027e-fce2-472f-9356-ca28fd5389e9 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:20.402767 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858027e-fce2-472f-9356-ca28fd5389e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:20.415786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2c5ac-52a0-4221-a7f2-2e0070436940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:20.417107 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2c5ac-52a0-4221-a7f2-2e0070436940 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:20.417583 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2c5ac-52a0-4221-a7f2-2e0070436940 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:20.418045 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2c5ac-52a0-4221-a7f2-2e0070436940 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:20.419054 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2c5ac-52a0-4221-a7f2-2e0070436940 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:20.419554 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2c5ac-52a0-4221-a7f2-2e0070436940 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:20.421064 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-7858027e-fce2-472f-9356-ca28fd5389e9 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:20.421621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2c5ac-52a0-4221-a7f2-2e0070436940 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:20.422632 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7858027e-fce2-472f-9356-ca28fd5389e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:20.435900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 18/33] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:00:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:20.437265 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2c5ac-52a0-4221-a7f2-2e0070436940 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:20.501588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 16/34] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:20.506672 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858027e-fce2-472f-9356-ca28fd5389e9 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:20.567484 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2c5ac-52a0-4221-a7f2-2e0070436940 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:20.609340 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b7b65-5445-41d2-9831-52fc94aacb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:20.610076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b7b65-5445-41d2-9831-52fc94aacb8e None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:20.610324 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b7b65-5445-41d2-9831-52fc94aacb8e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:20.610602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b7b65-5445-41d2-9831-52fc94aacb8e None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:20.611325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b7b65-5445-41d2-9831-52fc94aacb8e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:20.613068 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b7b65-5445-41d2-9831-52fc94aacb8e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:20.665448 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858027e-fce2-472f-9356-ca28fd5389e9 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:20.702732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c1ede-e469-402a-b702-3880263f5a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:20.703617 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c1ede-e469-402a-b702-3880263f5a46 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:20.703898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c1ede-e469-402a-b702-3880263f5a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:20.704205 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c1ede-e469-402a-b702-3880263f5a46 None admin] PATH_INFO: `/v3/users/cfa3cc953e414bc0b20f729623352259` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:20.706483 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c1ede-e469-402a-b702-3880263f5a46 None admin] RBAC: Authorizing `identity:get_user(user_id=cfa3cc953e414bc0b20f729623352259)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:20.708446 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c1ede-e469-402a-b702-3880263f5a46 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:20.710114 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 17/35] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:20 2022] GET /identity/v3/users/cfa3cc953e414bc0b20f729623352259 => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:20.710887 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c1ede-e469-402a-b702-3880263f5a46 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:20.823670 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c1ede-e469-402a-b702-3880263f5a46 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:20.858222 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e99fe-dfe1-4708-83bf-1e4daac767bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:20.859244 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e99fe-dfe1-4708-83bf-1e4daac767bc None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:20.859785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e99fe-dfe1-4708-83bf-1e4daac767bc None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:20.860301 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e99fe-dfe1-4708-83bf-1e4daac767bc None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:20.861304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e99fe-dfe1-4708-83bf-1e4daac767bc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:20.862998 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e99fe-dfe1-4708-83bf-1e4daac767bc None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:20.881945 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 19/36] 10.222.0.76 () {60 vars in 1141 bytes} [Mon May 16 15:00:20 2022] POST /identity/v3/projects => generated 301 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:00:20.886180 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b7b65-5445-41d2-9831-52fc94aacb8e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:20.955602 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 18/37] 10.222.0.76 () {60 vars in 1131 bytes} [Mon May 16 15:00:20 2022] POST /identity/v3/roles => generated 225 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:00:21.030548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b7b65-5445-41d2-9831-52fc94aacb8e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:21.075648 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0529f-f401-4b1e-90cb-7f53d4a28d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:21.076831 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0529f-f401-4b1e-90cb-7f53d4a28d68 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:21.077336 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0529f-f401-4b1e-90cb-7f53d4a28d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:21.077834 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0529f-f401-4b1e-90cb-7f53d4a28d68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:21.079396 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0529f-f401-4b1e-90cb-7f53d4a28d68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:21.081266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0529f-f401-4b1e-90cb-7f53d4a28d68 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:21.083380 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 20/38] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:00:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:21.091069 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e99fe-dfe1-4708-83bf-1e4daac767bc None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:21.164864 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d31c7b-0811-41cf-a729-fa5c33f5d66e None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:21.165182 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d31c7b-0811-41cf-a729-fa5c33f5d66e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:21.165429 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d31c7b-0811-41cf-a729-fa5c33f5d66e None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:21.166870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 21/39] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:21.172496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2368b-27d2-4621-b242-b471ca471074 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:21.172791 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2368b-27d2-4621-b242-b471ca471074 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:21.173069 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2368b-27d2-4621-b242-b471ca471074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:21.195948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-3ce2368b-27d2-4621-b242-b471ca471074 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:21.197697 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3ce2368b-27d2-4621-b242-b471ca471074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:21.248249 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e99fe-dfe1-4708-83bf-1e4daac767bc None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:21.283483 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 22/40] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:00:21.284510 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e926a-0459-4f04-abf4-b9ea81c14a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:21.285214 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f74745-37c0-492a-81a2-e0c748b3ec99 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:21.285472 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e926a-0459-4f04-abf4-b9ea81c14a51 None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:21.285605 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f74745-37c0-492a-81a2-e0c748b3ec99 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:21.285758 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e926a-0459-4f04-abf4-b9ea81c14a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:21.286047 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f74745-37c0-492a-81a2-e0c748b3ec99 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:21.286152 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e926a-0459-4f04-abf4-b9ea81c14a51 None admin] PATH_INFO: `/v3/domains/default/users/cfa3cc953e414bc0b20f729623352259/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:21.287489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 23/41] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:21.288335 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e926a-0459-4f04-abf4-b9ea81c14a51 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=cfa3cc953e414bc0b20f729623352259, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:21.289913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e926a-0459-4f04-abf4-b9ea81c14a51 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:21.295464 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0d841-2b01-406a-ab2f-43c54967d86d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:21.296002 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0d841-2b01-406a-ab2f-43c54967d86d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:21.296344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0d841-2b01-406a-ab2f-43c54967d86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:21.315763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-38b0d841-2b01-406a-ab2f-43c54967d86d None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:21.317073 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-38b0d841-2b01-406a-ab2f-43c54967d86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:21.382149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 24/42] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:21.382832 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0d841-2b01-406a-ab2f-43c54967d86d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:21.394405 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 19/43] 10.222.0.76 () {58 vars in 1361 bytes} [Mon May 16 15:00:21 2022] PUT /identity/v3/domains/default/users/cfa3cc953e414bc0b20f729623352259/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:00:21.405033 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e926a-0459-4f04-abf4-b9ea81c14a51 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:21.501751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0d841-2b01-406a-ab2f-43c54967d86d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:21.513099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e926a-0459-4f04-abf4-b9ea81c14a51 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:21.538504 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fb1d2-bb40-4152-82d2-88b1c814ea79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:21.539605 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fb1d2-bb40-4152-82d2-88b1c814ea79 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:21.539887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fb1d2-bb40-4152-82d2-88b1c814ea79 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:21.540159 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fb1d2-bb40-4152-82d2-88b1c814ea79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:21.541422 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fb1d2-bb40-4152-82d2-88b1c814ea79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:21.542997 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fb1d2-bb40-4152-82d2-88b1c814ea79 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:21.544688 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 25/44] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:00:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:21.551026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fb1d2-bb40-4152-82d2-88b1c814ea79 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:21.552616 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a6a74-30c3-430e-810f-4b80f17c2373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:21.553433 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a6a74-30c3-430e-810f-4b80f17c2373 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:21.553795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a6a74-30c3-430e-810f-4b80f17c2373 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:21.554260 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a6a74-30c3-430e-810f-4b80f17c2373 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:21.555826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a6a74-30c3-430e-810f-4b80f17c2373 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:21.556443 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a6a74-30c3-430e-810f-4b80f17c2373 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:21.638095 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 20/45] 10.222.0.76 () {60 vars in 1131 bytes} [Mon May 16 15:00:21 2022] POST /identity/v3/roles => generated 223 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:00:21.653594 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fb1d2-bb40-4152-82d2-88b1c814ea79 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:21.692013 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f5896-785f-441d-a97d-5aa657d590cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:21.692699 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f5896-785f-441d-a97d-5aa657d590cf None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:21.692984 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f5896-785f-441d-a97d-5aa657d590cf None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:21.693264 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f5896-785f-441d-a97d-5aa657d590cf None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:21.693996 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f5896-785f-441d-a97d-5aa657d590cf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:21.695576 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f5896-785f-441d-a97d-5aa657d590cf None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:21.786821 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 26/46] 10.222.0.76 () {60 vars in 1141 bytes} [Mon May 16 15:00:21 2022] POST /identity/v3/projects => generated 312 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:00:23.649194 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86254027-7a26-4f5c-8cb5-6e125468937c None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:23.649692 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86254027-7a26-4f5c-8cb5-6e125468937c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:23.649772 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86254027-7a26-4f5c-8cb5-6e125468937c None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:23.651177 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 21/47] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:23.656486 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e24fb-4602-4129-a0d1-c52bd4698204 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:23.656890 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e24fb-4602-4129-a0d1-c52bd4698204 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:23.657123 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e24fb-4602-4129-a0d1-c52bd4698204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:23.675291 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e08e24fb-4602-4129-a0d1-c52bd4698204 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:23.676459 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e08e24fb-4602-4129-a0d1-c52bd4698204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:23.759459 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 27/48] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:23.782456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86254027-7a26-4f5c-8cb5-6e125468937c None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:23.884464 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86254027-7a26-4f5c-8cb5-6e125468937c None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:23.916549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe94be1-f5f3-458a-b888-3953659f2613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:23.917347 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe94be1-f5f3-458a-b888-3953659f2613 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:23.917633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe94be1-f5f3-458a-b888-3953659f2613 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:23.917909 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe94be1-f5f3-458a-b888-3953659f2613 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:23.929871 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe94be1-f5f3-458a-b888-3953659f2613 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:23.938635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-efe94be1-f5f3-458a-b888-3953659f2613 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:00:23.938635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:23.938635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:23.938635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:23.938635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:23.938635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:23.938635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:23.938635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:23.938635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:23.938635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:23.938635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:23.938635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:23.938635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:23.938635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:23.938635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:23.938635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:23.939572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:23.939572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:23.939572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:23.939572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:23.939572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:23.939572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:23.939572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:23.939572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:23.939572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:23.939572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:23.939572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:23.939572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:00:23.939572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:23.939572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:23.939572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:23.939572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:23.940324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:23.940324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:23.940324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:23.940324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:23.940324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:23.940324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:23.940324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:23.940324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:23.940324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:23.940324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:23.940324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:00:23.940324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:00:23.940324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 22/49] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:00:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:00:23.945585 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e24fb-4602-4129-a0d1-c52bd4698204 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:24.006595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72251616-81fb-44a1-90fb-fa99a758cf01 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:24.006886 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72251616-81fb-44a1-90fb-fa99a758cf01 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:24.007171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72251616-81fb-44a1-90fb-fa99a758cf01 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:24.008621 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 23/50] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:00:24.013769 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9915c3-677f-4a81-9a84-32fbb14cf415 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:24.014066 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9915c3-677f-4a81-9a84-32fbb14cf415 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:24.014383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9915c3-677f-4a81-9a84-32fbb14cf415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:24.030940 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-fd9915c3-677f-4a81-9a84-32fbb14cf415 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:24.032139 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-fd9915c3-677f-4a81-9a84-32fbb14cf415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:24.040726 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e24fb-4602-4129-a0d1-c52bd4698204 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:24.072835 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085ed2a-55bb-47af-85fd-08f7edef18b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:24.073502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085ed2a-55bb-47af-85fd-08f7edef18b5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:24.073790 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085ed2a-55bb-47af-85fd-08f7edef18b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:24.074067 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085ed2a-55bb-47af-85fd-08f7edef18b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:24.074859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085ed2a-55bb-47af-85fd-08f7edef18b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:24.075167 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085ed2a-55bb-47af-85fd-08f7edef18b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:24.076571 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085ed2a-55bb-47af-85fd-08f7edef18b5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:24.085149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 28/51] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:00:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:24.090782 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085ed2a-55bb-47af-85fd-08f7edef18b5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:24.101903 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 24/52] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:00:24.128207 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9915c3-677f-4a81-9a84-32fbb14cf415 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:24.185724 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085ed2a-55bb-47af-85fd-08f7edef18b5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:24.217544 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8db5c2-180c-4176-9b15-ae494411324d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:24.218464 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8db5c2-180c-4176-9b15-ae494411324d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:24.218751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8db5c2-180c-4176-9b15-ae494411324d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:24.219028 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8db5c2-180c-4176-9b15-ae494411324d None admin] PATH_INFO: `/v3/users/cfa3cc953e414bc0b20f729623352259` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:24.220229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8db5c2-180c-4176-9b15-ae494411324d None admin] RBAC: Authorizing `identity:get_user(user_id=cfa3cc953e414bc0b20f729623352259)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:24.222045 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9915c3-677f-4a81-9a84-32fbb14cf415 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:24.222269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8db5c2-180c-4176-9b15-ae494411324d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:24.224052 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 29/53] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:24 2022] GET /identity/v3/users/cfa3cc953e414bc0b20f729623352259 => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:00:24.229449 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8db5c2-180c-4176-9b15-ae494411324d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:24.255593 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b6a49-27ea-456a-a112-3346bcfa1692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:24.256373 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b6a49-27ea-456a-a112-3346bcfa1692 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:24.256661 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b6a49-27ea-456a-a112-3346bcfa1692 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:24.256948 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b6a49-27ea-456a-a112-3346bcfa1692 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:24.258150 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b6a49-27ea-456a-a112-3346bcfa1692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:24.259877 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b6a49-27ea-456a-a112-3346bcfa1692 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:24.261647 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 25/54] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:00:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:00:24.266879 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b6a49-27ea-456a-a112-3346bcfa1692 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:24.324561 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8db5c2-180c-4176-9b15-ae494411324d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:24.356757 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b4d49-d1bf-4e8b-a087-a1de232b2439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:24.357550 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b4d49-d1bf-4e8b-a087-a1de232b2439 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:24.357838 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b4d49-d1bf-4e8b-a087-a1de232b2439 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:24.358140 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b4d49-d1bf-4e8b-a087-a1de232b2439 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:24.359318 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b4d49-d1bf-4e8b-a087-a1de232b2439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:24.360240 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b6a49-27ea-456a-a112-3346bcfa1692 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:24.360770 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b4d49-d1bf-4e8b-a087-a1de232b2439 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:24.362475 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 30/55] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:00:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:00:24.368107 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b4d49-d1bf-4e8b-a087-a1de232b2439 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:24.395897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b165c1-e778-499e-9726-e9a81474a01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:24.396561 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b165c1-e778-499e-9726-e9a81474a01e None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:24.399346 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b165c1-e778-499e-9726-e9a81474a01e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:24.399346 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b165c1-e778-499e-9726-e9a81474a01e None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:24.399346 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b165c1-e778-499e-9726-e9a81474a01e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:24.399346 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b165c1-e778-499e-9726-e9a81474a01e None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:24.466671 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b4d49-d1bf-4e8b-a087-a1de232b2439 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:24.498891 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd03e6-154a-4a3c-8ab7-41776b23d18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:24.499539 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd03e6-154a-4a3c-8ab7-41776b23d18d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:24.499827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd03e6-154a-4a3c-8ab7-41776b23d18d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:24.500106 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd03e6-154a-4a3c-8ab7-41776b23d18d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:24.501012 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd03e6-154a-4a3c-8ab7-41776b23d18d None admin] RBAC: Adding query filter params (role.id=f6c8fc0dc0f24de3907b0960a1201901, scope.domain.id=default, user.id=cfa3cc953e414bc0b20f729623352259) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:24.501321 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd03e6-154a-4a3c-8ab7-41776b23d18d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:24.502828 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd03e6-154a-4a3c-8ab7-41776b23d18d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:24.508619 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 31/56] 10.222.0.76 () {56 vars in 1322 bytes} [Mon May 16 15:00:24 2022] GET /identity/v3/role_assignments?user.id=cfa3cc953e414bc0b20f729623352259&scope.domain.id=default&role.id=f6c8fc0dc0f24de3907b0960a1201901 => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:00:24.560570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 26/57] 10.222.0.76 () {60 vars in 1140 bytes} [Mon May 16 15:00:24 2022] POST /identity/v3/projects => generated 298 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:00:26.793361 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afba314-6b75-4a9e-a91f-00641dc507f0 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:26.793920 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afba314-6b75-4a9e-a91f-00641dc507f0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:26.793920 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afba314-6b75-4a9e-a91f-00641dc507f0 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:26.795312 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 32/58] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:26.800699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d2811-b051-411b-8fe0-8f2da1b5c579 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:26.801156 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d2811-b051-411b-8fe0-8f2da1b5c579 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:26.801250 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d2811-b051-411b-8fe0-8f2da1b5c579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:26.818005 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-231d2811-b051-411b-8fe0-8f2da1b5c579 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:26.819221 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-231d2811-b051-411b-8fe0-8f2da1b5c579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:26.880942 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 27/59] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:26.905557 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afba314-6b75-4a9e-a91f-00641dc507f0 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:27.002261 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afba314-6b75-4a9e-a91f-00641dc507f0 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:27.034562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115fdb6-12d1-4a55-9d3e-d1de0bc82016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:27.035338 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115fdb6-12d1-4a55-9d3e-d1de0bc82016 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:27.035624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115fdb6-12d1-4a55-9d3e-d1de0bc82016 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:27.035904 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115fdb6-12d1-4a55-9d3e-d1de0bc82016 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:27.037070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115fdb6-12d1-4a55-9d3e-d1de0bc82016 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:27.038599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115fdb6-12d1-4a55-9d3e-d1de0bc82016 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:27.040195 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 33/60] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:00:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:27.045510 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d2811-b051-411b-8fe0-8f2da1b5c579 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:27.136971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d2811-b051-411b-8fe0-8f2da1b5c579 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:27.167523 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6cefe3-928f-458f-b0a3-caebe18e9ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:27.168176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cefe3-928f-458f-b0a3-caebe18e9ea7 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:27.168457 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cefe3-928f-458f-b0a3-caebe18e9ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:27.168734 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cefe3-928f-458f-b0a3-caebe18e9ea7 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:27.169432 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6cefe3-928f-458f-b0a3-caebe18e9ea7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:27.170899 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6cefe3-928f-458f-b0a3-caebe18e9ea7 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:27.295800 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 28/61] 10.222.0.76 () {60 vars in 1132 bytes} [Mon May 16 15:00:27 2022] POST /identity/v3/users => generated 275 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:00:30.766238 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b59bc4-7cff-486b-97ca-636e76af4186 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:30.767883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b59bc4-7cff-486b-97ca-636e76af4186 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:30.768386 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b59bc4-7cff-486b-97ca-636e76af4186 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:30.770455 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 34/62] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:30.776489 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ef193-8f46-42d0-9232-7f573bed627a None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:30.777456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ef193-8f46-42d0-9232-7f573bed627a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:30.777951 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ef193-8f46-42d0-9232-7f573bed627a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:30.790505 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf741827-7312-40bd-a5d8-4e6b0ed1d42d None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:30.791163 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf741827-7312-40bd-a5d8-4e6b0ed1d42d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:30.791663 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf741827-7312-40bd-a5d8-4e6b0ed1d42d None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:30.793637 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 35/63] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:30.800530 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca9648-b93b-4617-bd84-f5545cd3264b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:30.801168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca9648-b93b-4617-bd84-f5545cd3264b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:30.801659 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca9648-b93b-4617-bd84-f5545cd3264b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:30.803160 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-ca6ef193-8f46-42d0-9232-7f573bed627a None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:30.804404 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ca6ef193-8f46-42d0-9232-7f573bed627a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:30.830713 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a3ca9648-b93b-4617-bd84-f5545cd3264b None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:30.831936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a3ca9648-b93b-4617-bd84-f5545cd3264b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:30.883407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 29/64] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:00:30.937787 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ef193-8f46-42d0-9232-7f573bed627a None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:30.971194 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 36/65] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:00:30.981055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5765dba-3126-4a9c-a2a8-cf99e3faa1ba None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:30.981534 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5765dba-3126-4a9c-a2a8-cf99e3faa1ba None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:30.981959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5765dba-3126-4a9c-a2a8-cf99e3faa1ba None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:30.983749 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 37/66] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:00:30.988891 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a39fd-3369-4933-970c-fff4fd0a2cca None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:30.989370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a39fd-3369-4933-970c-fff4fd0a2cca None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:30.989802 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a39fd-3369-4933-970c-fff4fd0a2cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:31.014792 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7c3a39fd-3369-4933-970c-fff4fd0a2cca None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:31.016235 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7c3a39fd-3369-4933-970c-fff4fd0a2cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:31.051679 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ef193-8f46-42d0-9232-7f573bed627a None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:31.086258 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 38/67] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:00:31.088332 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e4571-3b0f-4f82-8ad7-2d8fc775f3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:31.089140 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e4571-3b0f-4f82-8ad7-2d8fc775f3ce None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:31.089431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e4571-3b0f-4f82-8ad7-2d8fc775f3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:31.089713 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e4571-3b0f-4f82-8ad7-2d8fc775f3ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:31.091198 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a39fd-3369-4933-970c-fff4fd0a2cca None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:31.101153 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e4571-3b0f-4f82-8ad7-2d8fc775f3ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:31.109242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-901e4571-3b0f-4f82-8ad7-2d8fc775f3ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 15:00:31.109242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:31.109242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:31.109242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:31.109242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:31.109242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:31.109242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:31.109242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:31.109242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:31.109242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:31.109242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:31.109242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:31.109242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:31.109242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:31.109242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:31.109242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:31.110298 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:31.110298 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:31.110298 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:31.110298 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:31.110298 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:31.110298 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:31.110298 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:31.110298 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:31.110298 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:31.110298 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:31.110298 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:31.110298 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:00:31.110298 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:31.110298 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:31.110298 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:31.110298 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:31.111275 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:31.111275 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:31.111275 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:31.111275 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:31.111275 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:31.111275 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:31.111275 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:31.111275 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:31.111275 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:31.111275 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:31.111275 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 15:00:31.111275 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:00:31.113278 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 30/68] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:00:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:00:31.114705 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cb24b-d9d3-44d8-a04e-20d2b784ce1a None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:31.114996 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cb24b-d9d3-44d8-a04e-20d2b784ce1a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:31.115280 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cb24b-d9d3-44d8-a04e-20d2b784ce1a None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:31.120828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 31/69] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:31.121620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cb24b-d9d3-44d8-a04e-20d2b784ce1a None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:31.193392 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a39fd-3369-4933-970c-fff4fd0a2cca None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:31.224444 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cb24b-d9d3-44d8-a04e-20d2b784ce1a None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:31.237300 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f160858-47bb-4d2e-9747-273dbd60461a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:31.238498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f160858-47bb-4d2e-9747-273dbd60461a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:31.238922 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f160858-47bb-4d2e-9747-273dbd60461a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:31.239347 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f160858-47bb-4d2e-9747-273dbd60461a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:31.252735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f160858-47bb-4d2e-9747-273dbd60461a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:31.257508 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787123f-b63e-4ab0-b230-508518880cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:31.258348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787123f-b63e-4ab0-b230-508518880cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:31.258639 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787123f-b63e-4ab0-b230-508518880cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:31.258913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787123f-b63e-4ab0-b230-508518880cc7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:31.261403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-7f160858-47bb-4d2e-9747-273dbd60461a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:00:31.261403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:31.261403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:31.261403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:31.261403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:31.261403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:31.261403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:31.261403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:31.261403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:31.261403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:31.261403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:31.261403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:31.261403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:31.261403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:31.261403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:31.261403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:31.262297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:31.262297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:31.262297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:31.262297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:31.262297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:31.262297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:31.262297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:31.262297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:31.262297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:31.262297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:31.262297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:31.262297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:00:31.262297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:31.262297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:31.262297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:31.262297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:31.263055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:31.263055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:31.263055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:31.263055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:31.263055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:31.263055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:31.263055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:31.263055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:31.263055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:31.263055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:31.263055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:00:31.263055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:00:31.263624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 39/70] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:00:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:00:31.264153 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f160858-47bb-4d2e-9747-273dbd60461a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:31.274823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787123f-b63e-4ab0-b230-508518880cc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:31.283563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-d787123f-b63e-4ab0-b230-508518880cc7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 15:00:31.283563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:31.283563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:31.283563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:31.283563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:31.283563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:31.283563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:31.283563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:31.283563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:31.283563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:31.283563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:31.283563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:31.283563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:31.283563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:31.283563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:31.283563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:31.284428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:31.284428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:31.284428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:31.284428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:31.284428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:31.284428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:31.284428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:31.284428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:31.284428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:31.284428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:31.284428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:31.284428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:00:31.284428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:31.284428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:31.284428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:31.284428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:31.285191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:31.285191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:31.285191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:31.285191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:31.285191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:31.285191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:31.285191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:31.285191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:31.285191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:31.285191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:31.285191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 15:00:31.285191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:00:31.285191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 32/71] 10.222.0.76 () {56 vars in 1114 bytes} [Mon May 16 15:00:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:00:31.286326 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64201415-72e7-4af4-89be-b6944cd59587 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:31.286326 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64201415-72e7-4af4-89be-b6944cd59587 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:31.286574 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64201415-72e7-4af4-89be-b6944cd59587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:31.303595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-64201415-72e7-4af4-89be-b6944cd59587 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:31.304882 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-64201415-72e7-4af4-89be-b6944cd59587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:31.375045 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 33/72] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:31.375918 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64201415-72e7-4af4-89be-b6944cd59587 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:31.385307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f160858-47bb-4d2e-9747-273dbd60461a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:31.421502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13263a1-60a0-4d4f-aacb-a3a44684939b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:31.422318 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13263a1-60a0-4d4f-aacb-a3a44684939b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:31.422607 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13263a1-60a0-4d4f-aacb-a3a44684939b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:31.422888 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13263a1-60a0-4d4f-aacb-a3a44684939b None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:31.424363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13263a1-60a0-4d4f-aacb-a3a44684939b None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:31.424674 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13263a1-60a0-4d4f-aacb-a3a44684939b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:31.426060 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13263a1-60a0-4d4f-aacb-a3a44684939b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:31.433895 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 40/73] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:00:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:31.434711 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13263a1-60a0-4d4f-aacb-a3a44684939b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:31.469558 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64201415-72e7-4af4-89be-b6944cd59587 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:31.503054 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bf6ca-34d5-4a99-a94d-344e8fdd5987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:31.504193 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bf6ca-34d5-4a99-a94d-344e8fdd5987 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:31.504644 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bf6ca-34d5-4a99-a94d-344e8fdd5987 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:31.505102 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bf6ca-34d5-4a99-a94d-344e8fdd5987 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:31.506081 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bf6ca-34d5-4a99-a94d-344e8fdd5987 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:31.506490 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bf6ca-34d5-4a99-a94d-344e8fdd5987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:31.508051 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bf6ca-34d5-4a99-a94d-344e8fdd5987 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:31.520340 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 34/74] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:00:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:31.521531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e60cc6-f6a4-4c21-8d06-5f0e4a9276f6 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:31.521821 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e60cc6-f6a4-4c21-8d06-5f0e4a9276f6 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:31.522098 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e60cc6-f6a4-4c21-8d06-5f0e4a9276f6 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:31.523463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 35/75] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:31.524082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e60cc6-f6a4-4c21-8d06-5f0e4a9276f6 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:31.533675 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13263a1-60a0-4d4f-aacb-a3a44684939b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:31.567119 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb23597-2f16-49ab-89f3-cb5c1226ca38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:31.567801 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb23597-2f16-49ab-89f3-cb5c1226ca38 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:31.568092 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb23597-2f16-49ab-89f3-cb5c1226ca38 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:31.568373 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb23597-2f16-49ab-89f3-cb5c1226ca38 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:31.569132 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb23597-2f16-49ab-89f3-cb5c1226ca38 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:31.569440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb23597-2f16-49ab-89f3-cb5c1226ca38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:31.570869 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb23597-2f16-49ab-89f3-cb5c1226ca38 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:31.578795 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 41/76] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:00:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:31.580132 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb23597-2f16-49ab-89f3-cb5c1226ca38 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:31.623527 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e60cc6-f6a4-4c21-8d06-5f0e4a9276f6 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:31.655505 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb593f-5562-46ef-8f3c-aa20193f5d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:31.656304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb593f-5562-46ef-8f3c-aa20193f5d8d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:31.656592 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb593f-5562-46ef-8f3c-aa20193f5d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:31.656875 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb593f-5562-46ef-8f3c-aa20193f5d8d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:31.667422 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb593f-5562-46ef-8f3c-aa20193f5d8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:31.673964 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb23597-2f16-49ab-89f3-cb5c1226ca38 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:31.675083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-14bb593f-5562-46ef-8f3c-aa20193f5d8d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 15:00:31.675083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:31.675083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:31.675083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:31.675083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:31.675083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:31.675083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:31.675083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:31.675083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:31.675083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:31.675083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:31.675083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:31.675083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:31.675083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:31.675083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:31.675083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:31.676079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:31.676079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:31.676079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:31.676079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:31.676079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:31.676079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:31.676079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:31.676079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:31.676079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:31.676079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:31.676079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:31.676079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:00:31.676079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:31.676079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:31.676079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:31.676079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:31.677014 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:31.677014 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:31.677014 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:31.677014 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:31.677014 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:31.677014 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:31.677014 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:31.677014 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:31.677014 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:31.677014 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:31.677014 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 15:00:31.677014 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:00:31.677014 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 36/77] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:00:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:00:31.677766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb593f-5562-46ef-8f3c-aa20193f5d8d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:31.709408 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ed495-1b26-4aa8-bc9e-1d8d37b57e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:31.710315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ed495-1b26-4aa8-bc9e-1d8d37b57e3d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:31.710599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ed495-1b26-4aa8-bc9e-1d8d37b57e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:31.710874 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ed495-1b26-4aa8-bc9e-1d8d37b57e3d None admin] PATH_INFO: `/v3/users/f5d2bf1ef38b459e901ca8c53d1dc02e` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:31.724819 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ed495-1b26-4aa8-bc9e-1d8d37b57e3d None admin] RBAC: Authorizing `identity:get_user(user_id=f5d2bf1ef38b459e901ca8c53d1dc02e)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:31.726264 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ed495-1b26-4aa8-bc9e-1d8d37b57e3d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:31.727953 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 42/78] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:31 2022] GET /identity/v3/users/f5d2bf1ef38b459e901ca8c53d1dc02e => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:31.729128 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0eeb58-4084-491c-adc7-8c17cf7de6c2 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:31.729490 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0eeb58-4084-491c-adc7-8c17cf7de6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:31.729714 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0eeb58-4084-491c-adc7-8c17cf7de6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:31.745707 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-3f0eeb58-4084-491c-adc7-8c17cf7de6c2 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:31.746937 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3f0eeb58-4084-491c-adc7-8c17cf7de6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:31.771786 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb593f-5562-46ef-8f3c-aa20193f5d8d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:31.803385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ede53e-3bae-442c-aa40-c295e7d65f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:31.804252 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ede53e-3bae-442c-aa40-c295e7d65f66 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:31.804538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ede53e-3bae-442c-aa40-c295e7d65f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:31.804818 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ede53e-3bae-442c-aa40-c295e7d65f66 None admin] PATH_INFO: `/v3/users/cfa3cc953e414bc0b20f729623352259` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:31.806049 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ede53e-3bae-442c-aa40-c295e7d65f66 None admin] RBAC: Authorizing `identity:get_user(user_id=cfa3cc953e414bc0b20f729623352259)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:31.807554 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ede53e-3bae-442c-aa40-c295e7d65f66 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:31.809195 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 37/79] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:31 2022] GET /identity/v3/users/cfa3cc953e414bc0b20f729623352259 => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:31.809960 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ede53e-3bae-442c-aa40-c295e7d65f66 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:31.818186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 43/80] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:31.818186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0eeb58-4084-491c-adc7-8c17cf7de6c2 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:31.904898 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0eeb58-4084-491c-adc7-8c17cf7de6c2 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:31.911487 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ede53e-3bae-442c-aa40-c295e7d65f66 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:31.937289 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcace7a-65fb-4693-8bea-fa59e4c3c31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:31.937955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcace7a-65fb-4693-8bea-fa59e4c3c31f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:31.938272 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcace7a-65fb-4693-8bea-fa59e4c3c31f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:31.938575 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcace7a-65fb-4693-8bea-fa59e4c3c31f None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:31.939340 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcace7a-65fb-4693-8bea-fa59e4c3c31f None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:31.939653 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcace7a-65fb-4693-8bea-fa59e4c3c31f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:31.941066 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcace7a-65fb-4693-8bea-fa59e4c3c31f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:31.942924 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f490f-b04d-449e-8a1a-66dca08a8946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:31.943781 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f490f-b04d-449e-8a1a-66dca08a8946 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:31.944061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f490f-b04d-449e-8a1a-66dca08a8946 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:31.944337 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f490f-b04d-449e-8a1a-66dca08a8946 None admin] PATH_INFO: `/v3/users/f5d2bf1ef38b459e901ca8c53d1dc02e` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:31.945518 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f490f-b04d-449e-8a1a-66dca08a8946 None admin] RBAC: Authorizing `identity:get_user(user_id=f5d2bf1ef38b459e901ca8c53d1dc02e)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:31.946967 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f490f-b04d-449e-8a1a-66dca08a8946 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:31.948584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 38/81] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:31 2022] GET /identity/v3/users/f5d2bf1ef38b459e901ca8c53d1dc02e => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:31.949079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 44/82] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:00:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:31.949423 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f490f-b04d-449e-8a1a-66dca08a8946 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:31.949723 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcace7a-65fb-4693-8bea-fa59e4c3c31f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:32.042908 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f490f-b04d-449e-8a1a-66dca08a8946 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:32.050172 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcace7a-65fb-4693-8bea-fa59e4c3c31f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:32.074751 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b4766-0bae-4ca0-ba27-5ec42a2408db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:32.075389 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b4766-0bae-4ca0-ba27-5ec42a2408db None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:32.075674 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b4766-0bae-4ca0-ba27-5ec42a2408db None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:32.075950 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b4766-0bae-4ca0-ba27-5ec42a2408db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:32.082410 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140de212-ef97-44e1-b88c-624474705301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:32.083162 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140de212-ef97-44e1-b88c-624474705301 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:32.083511 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140de212-ef97-44e1-b88c-624474705301 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:32.083886 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140de212-ef97-44e1-b88c-624474705301 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:32.139101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b4766-0bae-4ca0-ba27-5ec42a2408db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:32.140573 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b4766-0bae-4ca0-ba27-5ec42a2408db None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:32.150579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140de212-ef97-44e1-b88c-624474705301 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:32.152039 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140de212-ef97-44e1-b88c-624474705301 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:32.232649 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 39/83] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:00:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:00:32.233478 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b4766-0bae-4ca0-ba27-5ec42a2408db None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:32.242656 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 45/84] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:00:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:00:32.243482 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140de212-ef97-44e1-b88c-624474705301 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:32.325770 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b4766-0bae-4ca0-ba27-5ec42a2408db None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:32.335681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140de212-ef97-44e1-b88c-624474705301 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:32.357178 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0dfa9-6dee-42a3-84c7-a19be16fa2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:32.357959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0dfa9-6dee-42a3-84c7-a19be16fa2ae None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:32.358273 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0dfa9-6dee-42a3-84c7-a19be16fa2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:32.358554 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0dfa9-6dee-42a3-84c7-a19be16fa2ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:32.359722 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0dfa9-6dee-42a3-84c7-a19be16fa2ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:32.361708 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0dfa9-6dee-42a3-84c7-a19be16fa2ae None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:32.363356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 40/85] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:00:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:32.364110 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0dfa9-6dee-42a3-84c7-a19be16fa2ae None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:32.367608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8ee11-057b-4015-9932-fdac55ac03e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:32.368259 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8ee11-057b-4015-9932-fdac55ac03e1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:32.368541 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8ee11-057b-4015-9932-fdac55ac03e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:32.368815 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8ee11-057b-4015-9932-fdac55ac03e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:32.433875 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8ee11-057b-4015-9932-fdac55ac03e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:32.435410 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8ee11-057b-4015-9932-fdac55ac03e1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:32.458033 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0dfa9-6dee-42a3-84c7-a19be16fa2ae None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:32.490020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7cb66-dfc5-4ba0-9b9a-4d9f7de68d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:32.490921 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7cb66-dfc5-4ba0-9b9a-4d9f7de68d6d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:32.491207 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7cb66-dfc5-4ba0-9b9a-4d9f7de68d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:32.491489 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7cb66-dfc5-4ba0-9b9a-4d9f7de68d6d None admin] PATH_INFO: `/v3/users/f5d2bf1ef38b459e901ca8c53d1dc02e` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:32.492694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7cb66-dfc5-4ba0-9b9a-4d9f7de68d6d None admin] RBAC: Authorizing `identity:get_user(user_id=f5d2bf1ef38b459e901ca8c53d1dc02e)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:32.494170 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7cb66-dfc5-4ba0-9b9a-4d9f7de68d6d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:32.495814 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 41/86] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:32 2022] GET /identity/v3/users/f5d2bf1ef38b459e901ca8c53d1dc02e => generated 275 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:32.496571 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7cb66-dfc5-4ba0-9b9a-4d9f7de68d6d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:32.528435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 46/87] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:00:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:00:32.529279 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8ee11-057b-4015-9932-fdac55ac03e1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:32.603455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7cb66-dfc5-4ba0-9b9a-4d9f7de68d6d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:32.631190 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8ee11-057b-4015-9932-fdac55ac03e1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:32.650775 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c33fd-b62a-4f7c-af79-81c2bb23b605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:32.651647 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c33fd-b62a-4f7c-af79-81c2bb23b605 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:32.652086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c33fd-b62a-4f7c-af79-81c2bb23b605 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:32.652504 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c33fd-b62a-4f7c-af79-81c2bb23b605 None admin] PATH_INFO: `/v3/projects/21716abeaba940d1bdae0c660acc6bc5` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:32.654901 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c33fd-b62a-4f7c-af79-81c2bb23b605 None admin] RBAC: Authorizing `identity:get_project(project_id=21716abeaba940d1bdae0c660acc6bc5)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:32.656599 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c33fd-b62a-4f7c-af79-81c2bb23b605 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:32.659447 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 42/88] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:00:32 2022] GET /identity/v3/projects/21716abeaba940d1bdae0c660acc6bc5 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:32.660229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c33fd-b62a-4f7c-af79-81c2bb23b605 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:32.666988 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccdba5-6308-4170-b92c-4276f08e4c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:32.668131 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccdba5-6308-4170-b92c-4276f08e4c51 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:32.668641 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccdba5-6308-4170-b92c-4276f08e4c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:32.669102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccdba5-6308-4170-b92c-4276f08e4c51 None admin] PATH_INFO: `/v3/projects/21716abeaba940d1bdae0c660acc6bc5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:32.670587 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daccdba5-6308-4170-b92c-4276f08e4c51 None admin] RBAC: Authorizing `identity:get_project(project_id=21716abeaba940d1bdae0c660acc6bc5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:32.672314 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daccdba5-6308-4170-b92c-4276f08e4c51 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:32.674382 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 47/89] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:00:32 2022] GET /identity/v3/projects/21716abeaba940d1bdae0c660acc6bc5 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:32.675739 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccdba5-6308-4170-b92c-4276f08e4c51 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:32.764786 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c33fd-b62a-4f7c-af79-81c2bb23b605 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:32.778318 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccdba5-6308-4170-b92c-4276f08e4c51 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:32.797976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a42aa-3070-4e6a-ada1-c075ca2a2437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:32.799341 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a42aa-3070-4e6a-ada1-c075ca2a2437 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:32.799630 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a42aa-3070-4e6a-ada1-c075ca2a2437 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:32.799901 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a42aa-3070-4e6a-ada1-c075ca2a2437 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:32.800607 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a42aa-3070-4e6a-ada1-c075ca2a2437 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:32.802083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a42aa-3070-4e6a-ada1-c075ca2a2437 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:32.815719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c3033-fef4-4543-b970-151d978a8101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:32.816378 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c3033-fef4-4543-b970-151d978a8101 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:32.816663 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c3033-fef4-4543-b970-151d978a8101 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:32.816942 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c3033-fef4-4543-b970-151d978a8101 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:32.882361 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c3033-fef4-4543-b970-151d978a8101 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:32.883847 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c3033-fef4-4543-b970-151d978a8101 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:32.893074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 43/90] 10.222.0.76 () {60 vars in 1132 bytes} [Mon May 16 15:00:32 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:00:32.893912 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a42aa-3070-4e6a-ada1-c075ca2a2437 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:33.005792 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 48/91] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:00:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:00:33.005792 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c3033-fef4-4543-b970-151d978a8101 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:33.024170 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a42aa-3070-4e6a-ada1-c075ca2a2437 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:33.059847 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778f9eb-d9cd-407e-bd18-279e755d71cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:33.060734 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778f9eb-d9cd-407e-bd18-279e755d71cb None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:33.061023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778f9eb-d9cd-407e-bd18-279e755d71cb None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:33.061306 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778f9eb-d9cd-407e-bd18-279e755d71cb None admin] PATH_INFO: `/v3/projects/21716abeaba940d1bdae0c660acc6bc5` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:33.062608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778f9eb-d9cd-407e-bd18-279e755d71cb None admin] RBAC: Authorizing `identity:get_project(project_id=21716abeaba940d1bdae0c660acc6bc5)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:33.064692 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778f9eb-d9cd-407e-bd18-279e755d71cb None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:33.071879 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 44/92] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:00:32 2022] GET /identity/v3/projects/21716abeaba940d1bdae0c660acc6bc5 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:33.071879 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778f9eb-d9cd-407e-bd18-279e755d71cb None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:33.115140 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c3033-fef4-4543-b970-151d978a8101 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:33.149928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0d61c-82ac-4ae6-bb59-6cebd6a103a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:33.150250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0d61c-82ac-4ae6-bb59-6cebd6a103a2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:33.150473 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0d61c-82ac-4ae6-bb59-6cebd6a103a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:33.150748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0d61c-82ac-4ae6-bb59-6cebd6a103a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:33.151587 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0d61c-82ac-4ae6-bb59-6cebd6a103a2 None admin] RBAC: Adding query filter params (role.id=0e00f6ebfc2843a0992b3d01f50e262d, scope.project.id=21716abeaba940d1bdae0c660acc6bc5, user.id=f5d2bf1ef38b459e901ca8c53d1dc02e) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:33.151902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0d61c-82ac-4ae6-bb59-6cebd6a103a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:33.153355 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0d61c-82ac-4ae6-bb59-6cebd6a103a2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:33.159377 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 49/93] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:00:33 2022] GET /identity/v3/role_assignments?user.id=f5d2bf1ef38b459e901ca8c53d1dc02e&scope.project.id=21716abeaba940d1bdae0c660acc6bc5&role.id=0e00f6ebfc2843a0992b3d01f50e262d => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:33.161191 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0d61c-82ac-4ae6-bb59-6cebd6a103a2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:33.173697 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778f9eb-d9cd-407e-bd18-279e755d71cb None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:33.211073 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb9fce-4440-4a43-9db0-353888dc03e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:33.212089 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb9fce-4440-4a43-9db0-353888dc03e3 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:33.212574 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb9fce-4440-4a43-9db0-353888dc03e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:33.213051 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb9fce-4440-4a43-9db0-353888dc03e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:33.214097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb9fce-4440-4a43-9db0-353888dc03e3 None admin] RBAC: Adding query filter params (role.id=f6c8fc0dc0f24de3907b0960a1201901, scope.project.id=21716abeaba940d1bdae0c660acc6bc5, user.id=cfa3cc953e414bc0b20f729623352259) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:33.214655 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb9fce-4440-4a43-9db0-353888dc03e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:33.216387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb9fce-4440-4a43-9db0-353888dc03e3 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:33.225998 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 45/94] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:00:33 2022] GET /identity/v3/role_assignments?user.id=cfa3cc953e414bc0b20f729623352259&scope.project.id=21716abeaba940d1bdae0c660acc6bc5&role.id=f6c8fc0dc0f24de3907b0960a1201901 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:33.231158 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb9fce-4440-4a43-9db0-353888dc03e3 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:33.278518 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0d61c-82ac-4ae6-bb59-6cebd6a103a2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:33.317894 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af827bce-bfb8-43dc-8f24-5313bc87c5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:33.318830 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af827bce-bfb8-43dc-8f24-5313bc87c5bb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:33.319115 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af827bce-bfb8-43dc-8f24-5313bc87c5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:33.319393 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af827bce-bfb8-43dc-8f24-5313bc87c5bb None admin] PATH_INFO: `/v3/projects/8830a506e3894ac980ab89554499a44a` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:33.320687 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af827bce-bfb8-43dc-8f24-5313bc87c5bb None admin] RBAC: Authorizing `identity:get_project(project_id=8830a506e3894ac980ab89554499a44a)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:33.322359 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af827bce-bfb8-43dc-8f24-5313bc87c5bb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:33.324557 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 50/95] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:00:33 2022] GET /identity/v3/projects/8830a506e3894ac980ab89554499a44a => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:33.332773 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af827bce-bfb8-43dc-8f24-5313bc87c5bb None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:33.368288 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb9fce-4440-4a43-9db0-353888dc03e3 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:33.407731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8eae2-3739-4d15-9bf1-b856c0972245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:33.408328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8eae2-3739-4d15-9bf1-b856c0972245 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:33.408770 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8eae2-3739-4d15-9bf1-b856c0972245 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:33.408957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8eae2-3739-4d15-9bf1-b856c0972245 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:33.409822 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8eae2-3739-4d15-9bf1-b856c0972245 None admin] RBAC: Adding query filter params (role.id=00ecc8471dbb4296b40c8b8c0b29aedd, scope.project.id=21716abeaba940d1bdae0c660acc6bc5, user.id=f5d2bf1ef38b459e901ca8c53d1dc02e) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:33.410168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8eae2-3739-4d15-9bf1-b856c0972245 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:33.411683 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8eae2-3739-4d15-9bf1-b856c0972245 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:33.418414 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 46/96] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:00:33 2022] GET /identity/v3/role_assignments?user.id=f5d2bf1ef38b459e901ca8c53d1dc02e&scope.project.id=21716abeaba940d1bdae0c660acc6bc5&role.id=00ecc8471dbb4296b40c8b8c0b29aedd => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:33.467065 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af827bce-bfb8-43dc-8f24-5313bc87c5bb None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:33.541472 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1379644-595a-4a68-b3b9-cc34957c756b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:33.542496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1379644-595a-4a68-b3b9-cc34957c756b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:33.542951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1379644-595a-4a68-b3b9-cc34957c756b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:33.543397 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1379644-595a-4a68-b3b9-cc34957c756b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:33.544419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1379644-595a-4a68-b3b9-cc34957c756b None admin] RBAC: Adding query filter params (role.id=0e00f6ebfc2843a0992b3d01f50e262d, scope.project.id=8830a506e3894ac980ab89554499a44a, user.id=f5d2bf1ef38b459e901ca8c53d1dc02e) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:33.544906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1379644-595a-4a68-b3b9-cc34957c756b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:33.546632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1379644-595a-4a68-b3b9-cc34957c756b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:33.555455 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 51/97] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:00:33 2022] GET /identity/v3/role_assignments?user.id=f5d2bf1ef38b459e901ca8c53d1dc02e&scope.project.id=8830a506e3894ac980ab89554499a44a&role.id=0e00f6ebfc2843a0992b3d01f50e262d => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:36.063847 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57aa83-1ad6-43d7-9684-6289d370b9e5 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:36.064853 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57aa83-1ad6-43d7-9684-6289d370b9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:36.065345 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57aa83-1ad6-43d7-9684-6289d370b9e5 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:36.066966 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 47/98] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:36.072443 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c8d35-624f-4d07-9744-4ba831117fa4 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:36.073295 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c8d35-624f-4d07-9744-4ba831117fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:36.073778 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c8d35-624f-4d07-9744-4ba831117fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:36.100488 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f04c8d35-624f-4d07-9744-4ba831117fa4 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:36.102036 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f04c8d35-624f-4d07-9744-4ba831117fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:36.204500 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 52/99] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:36.213538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a61c8-196a-4c6a-ba29-2182d4d73f40 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:36.214105 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a61c8-196a-4c6a-ba29-2182d4d73f40 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:36.214613 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a61c8-196a-4c6a-ba29-2182d4d73f40 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:36.216180 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 48/100] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:36.221792 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9001e51-737c-4dfa-afd2-0cba553a5843 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:36.222357 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9001e51-737c-4dfa-afd2-0cba553a5843 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:36.222859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9001e51-737c-4dfa-afd2-0cba553a5843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:36.239526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f623b-79e4-4cd5-91ee-fff9aecd2416 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:36.240122 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f623b-79e4-4cd5-91ee-fff9aecd2416 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:36.240618 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f623b-79e4-4cd5-91ee-fff9aecd2416 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:36.242307 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 49/101] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:00:36.243261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f623b-79e4-4cd5-91ee-fff9aecd2416 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:36.246865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c9001e51-737c-4dfa-afd2-0cba553a5843 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:36.248369 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c9001e51-737c-4dfa-afd2-0cba553a5843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:36.317056 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 53/102] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:36.323038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ef5b4-f5b1-4451-9181-fd5eac07fc5b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:36.323558 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ef5b4-f5b1-4451-9181-fd5eac07fc5b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:36.324037 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ef5b4-f5b1-4451-9181-fd5eac07fc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:36.355186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e01ef5b4-f5b1-4451-9181-fd5eac07fc5b None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:36.356795 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e01ef5b4-f5b1-4451-9181-fd5eac07fc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:36.428026 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f623b-79e4-4cd5-91ee-fff9aecd2416 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:36.435502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 54/103] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:36.437003 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ef5b4-f5b1-4451-9181-fd5eac07fc5b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:36.472569 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10c151-dcbd-402e-a483-8aa6884a8ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:36.473803 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10c151-dcbd-402e-a483-8aa6884a8ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:36.474346 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10c151-dcbd-402e-a483-8aa6884a8ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:36.475002 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10c151-dcbd-402e-a483-8aa6884a8ee5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:36.527709 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10c151-dcbd-402e-a483-8aa6884a8ee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:36.537009 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-0c10c151-dcbd-402e-a483-8aa6884a8ee5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 15:00:36.537009 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:36.537009 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:36.537009 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:36.537009 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:36.537009 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:36.537009 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:36.537009 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:36.537009 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:36.537009 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:36.537009 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:36.537009 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:36.537009 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:36.537009 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:36.537009 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:36.537009 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:36.537926 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:36.537926 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:36.537926 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:36.537926 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:36.537926 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:36.537926 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:36.537926 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:36.537926 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:36.537926 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:36.537926 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:36.537926 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:36.537926 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:00:36.537926 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:36.537926 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:36.537926 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:36.537926 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:36.538719 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:36.538719 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:36.538719 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:36.538719 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:36.538719 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:36.538719 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:36.538719 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:36.538719 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:36.538719 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:36.538719 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:36.538719 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 15:00:36.538719 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:00:36.551254 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 50/104] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:00:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:00:36.553081 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10c151-dcbd-402e-a483-8aa6884a8ee5 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:36.666273 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ef5b4-f5b1-4451-9181-fd5eac07fc5b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:36.701975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b957d-f6f1-43ac-b68b-2432a75ed570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:36.703049 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b957d-f6f1-43ac-b68b-2432a75ed570 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:36.703649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b957d-f6f1-43ac-b68b-2432a75ed570 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:36.703941 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b957d-f6f1-43ac-b68b-2432a75ed570 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:36.717195 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b957d-f6f1-43ac-b68b-2432a75ed570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:36.719794 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10c151-dcbd-402e-a483-8aa6884a8ee5 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:36.726779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-bc0b957d-f6f1-43ac-b68b-2432a75ed570 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:00:36.726779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:36.726779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:36.726779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:36.726779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:36.726779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:36.726779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:36.726779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:36.726779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:36.726779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:36.726779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:36.726779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:36.726779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:36.726779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:36.726779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:36.726779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:36.727740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:36.727740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:36.727740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:36.727740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:36.727740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:36.727740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:36.727740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:36.727740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:36.727740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:36.727740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:36.727740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:36.727740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:00:36.727740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:36.727740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:36.727740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:36.727740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:36.728494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:36.728494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:36.728494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:36.728494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:36.728494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:36.728494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:36.728494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:36.728494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:36.728494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:36.728494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:36.728494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:00:36.728494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:00:36.728494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 55/105] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:00:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:00:36.729411 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b957d-f6f1-43ac-b68b-2432a75ed570 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:36.764867 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33835bbc-a4d2-4d3a-9daa-8f7a4c963209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:36.767209 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33835bbc-a4d2-4d3a-9daa-8f7a4c963209 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:36.767943 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33835bbc-a4d2-4d3a-9daa-8f7a4c963209 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:36.768389 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33835bbc-a4d2-4d3a-9daa-8f7a4c963209 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:36.781491 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33835bbc-a4d2-4d3a-9daa-8f7a4c963209 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:36.792896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-33835bbc-a4d2-4d3a-9daa-8f7a4c963209 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 15:00:36.792896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:36.792896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:36.792896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:36.792896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:36.792896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:36.792896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:36.792896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:36.792896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:36.792896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:36.792896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:36.792896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:36.792896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:36.792896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:36.792896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:36.792896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:36.793773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:36.793773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:36.793773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:36.793773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:36.793773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:36.793773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:36.793773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:36.793773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:36.793773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:36.793773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:36.793773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:36.793773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:00:36.793773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:36.793773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:36.793773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:36.793773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:36.794576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:36.794576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:36.794576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:36.794576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:36.794576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:36.794576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:36.794576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:36.794576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:36.794576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:36.794576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:36.794576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 15:00:36.794576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:00:36.797291 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 51/106] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:00:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:00:36.803625 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cbc17-f7d7-49c8-b34b-d9f9aa284d2a None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:36.803917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cbc17-f7d7-49c8-b34b-d9f9aa284d2a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:36.804197 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cbc17-f7d7-49c8-b34b-d9f9aa284d2a None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:36.805635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 52/107] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:36.806230 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1cbc17-f7d7-49c8-b34b-d9f9aa284d2a None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:36.852212 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b957d-f6f1-43ac-b68b-2432a75ed570 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:36.887613 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ff367-27be-4f39-8852-c6b3c635b93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:36.888745 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ff367-27be-4f39-8852-c6b3c635b93b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:36.889316 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ff367-27be-4f39-8852-c6b3c635b93b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:36.889800 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ff367-27be-4f39-8852-c6b3c635b93b None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:36.890854 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ff367-27be-4f39-8852-c6b3c635b93b None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:36.891982 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ff367-27be-4f39-8852-c6b3c635b93b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:36.893671 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ff367-27be-4f39-8852-c6b3c635b93b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:36.903883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 56/108] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:00:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:36.905127 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ff367-27be-4f39-8852-c6b3c635b93b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:36.929065 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1cbc17-f7d7-49c8-b34b-d9f9aa284d2a None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:36.965556 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f497c-6db0-4948-9417-25023e3d105b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:36.966272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f497c-6db0-4948-9417-25023e3d105b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:36.966560 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f497c-6db0-4948-9417-25023e3d105b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:36.966839 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f497c-6db0-4948-9417-25023e3d105b None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:36.967596 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f497c-6db0-4948-9417-25023e3d105b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:36.967954 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f497c-6db0-4948-9417-25023e3d105b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:36.969356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f497c-6db0-4948-9417-25023e3d105b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:36.978754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 53/109] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:00:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:36.980146 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a777a2-33c6-426d-a1ed-f84c4f16db33 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:36.980341 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a777a2-33c6-426d-a1ed-f84c4f16db33 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:36.980616 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a777a2-33c6-426d-a1ed-f84c4f16db33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:36.997441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-38a777a2-33c6-426d-a1ed-f84c4f16db33 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:36.998678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-38a777a2-33c6-426d-a1ed-f84c4f16db33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:37.028055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ff367-27be-4f39-8852-c6b3c635b93b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:37.066269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35449b-4ab3-4d2d-b07c-d82839fa3168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:37.066477 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 54/110] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:37.067217 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a777a2-33c6-426d-a1ed-f84c4f16db33 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:37.068001 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35449b-4ab3-4d2d-b07c-d82839fa3168 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:37.068485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35449b-4ab3-4d2d-b07c-d82839fa3168 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:37.068957 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35449b-4ab3-4d2d-b07c-d82839fa3168 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:37.069926 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35449b-4ab3-4d2d-b07c-d82839fa3168 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:37.070453 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35449b-4ab3-4d2d-b07c-d82839fa3168 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:37.072065 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35449b-4ab3-4d2d-b07c-d82839fa3168 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:37.081614 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 57/111] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:00:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:37.087792 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35449b-4ab3-4d2d-b07c-d82839fa3168 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:37.177002 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a777a2-33c6-426d-a1ed-f84c4f16db33 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:37.185430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35449b-4ab3-4d2d-b07c-d82839fa3168 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:37.209695 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eabf24-4d34-4d74-af51-cf8cadd1e80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:37.210590 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eabf24-4d34-4d74-af51-cf8cadd1e80f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:37.210874 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eabf24-4d34-4d74-af51-cf8cadd1e80f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:37.211151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eabf24-4d34-4d74-af51-cf8cadd1e80f None admin] PATH_INFO: `/v3/users/f5d2bf1ef38b459e901ca8c53d1dc02e` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:37.212336 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eabf24-4d34-4d74-af51-cf8cadd1e80f None admin] RBAC: Authorizing `identity:get_user(user_id=f5d2bf1ef38b459e901ca8c53d1dc02e)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:37.213793 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eabf24-4d34-4d74-af51-cf8cadd1e80f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:37.215463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 55/112] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:37 2022] GET /identity/v3/users/f5d2bf1ef38b459e901ca8c53d1dc02e => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:37.216750 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66400431-6fb1-4c89-b437-46360e0d6a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:37.217624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66400431-6fb1-4c89-b437-46360e0d6a9d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:37.217911 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66400431-6fb1-4c89-b437-46360e0d6a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:37.219168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66400431-6fb1-4c89-b437-46360e0d6a9d None admin] PATH_INFO: `/v3/users/cfa3cc953e414bc0b20f729623352259` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:37.219783 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eabf24-4d34-4d74-af51-cf8cadd1e80f None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:37.220035 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66400431-6fb1-4c89-b437-46360e0d6a9d None admin] RBAC: Authorizing `identity:get_user(user_id=cfa3cc953e414bc0b20f729623352259)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:37.221447 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66400431-6fb1-4c89-b437-46360e0d6a9d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:37.223125 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 58/113] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:37 2022] GET /identity/v3/users/cfa3cc953e414bc0b20f729623352259 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:37.224303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8432a5-a611-4131-96c2-48f555d0359a None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:37.224593 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8432a5-a611-4131-96c2-48f555d0359a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:37.224873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8432a5-a611-4131-96c2-48f555d0359a None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:37.230348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 59/114] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:37.230348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8432a5-a611-4131-96c2-48f555d0359a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:37.314067 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eabf24-4d34-4d74-af51-cf8cadd1e80f None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:37.322841 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8432a5-a611-4131-96c2-48f555d0359a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:37.346425 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6f39e-a0e7-43c3-94ba-628e80a0a4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:37.347292 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6f39e-a0e7-43c3-94ba-628e80a0a4cd None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:37.347571 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6f39e-a0e7-43c3-94ba-628e80a0a4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:37.347942 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6f39e-a0e7-43c3-94ba-628e80a0a4cd None admin] PATH_INFO: `/v3/users/07b3d14137ce4f2abf1ed2ff6d0ba6f5` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:37.356234 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282bb19-496a-46c3-8f9b-9b400964c350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:37.357011 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282bb19-496a-46c3-8f9b-9b400964c350 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:37.357319 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282bb19-496a-46c3-8f9b-9b400964c350 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:37.357611 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282bb19-496a-46c3-8f9b-9b400964c350 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:37.358757 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282bb19-496a-46c3-8f9b-9b400964c350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:37.360249 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282bb19-496a-46c3-8f9b-9b400964c350 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:37.361851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 60/115] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:00:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:37.362969 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6f39e-a0e7-43c3-94ba-628e80a0a4cd None admin] RBAC: Authorizing `identity:get_user(user_id=07b3d14137ce4f2abf1ed2ff6d0ba6f5)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:37.363076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c946ea8-42a9-4113-b2ad-46b905cbc260 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:37.367896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c946ea8-42a9-4113-b2ad-46b905cbc260 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:37.367896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c946ea8-42a9-4113-b2ad-46b905cbc260 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:37.368045 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6f39e-a0e7-43c3-94ba-628e80a0a4cd None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:37.368112 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 61/116] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:37.369373 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c946ea8-42a9-4113-b2ad-46b905cbc260 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:37.370372 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 56/117] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:37 2022] GET /identity/v3/users/07b3d14137ce4f2abf1ed2ff6d0ba6f5 => generated 289 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:37.371397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6f39e-a0e7-43c3-94ba-628e80a0a4cd None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:37.469149 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6f39e-a0e7-43c3-94ba-628e80a0a4cd None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:37.470000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c946ea8-42a9-4113-b2ad-46b905cbc260 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:37.501450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573f1ad-05e3-437d-95a9-e4960a7116ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:37.501641 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d15b2-5926-47b4-bf31-5bf76fc6b70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:37.502344 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573f1ad-05e3-437d-95a9-e4960a7116ab None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:37.502451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d15b2-5926-47b4-bf31-5bf76fc6b70f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:37.502635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573f1ad-05e3-437d-95a9-e4960a7116ab None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:37.502735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d15b2-5926-47b4-bf31-5bf76fc6b70f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:37.502915 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573f1ad-05e3-437d-95a9-e4960a7116ab None admin] PATH_INFO: `/v3/projects/21716abeaba940d1bdae0c660acc6bc5` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:37.502999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d15b2-5926-47b4-bf31-5bf76fc6b70f None admin] PATH_INFO: `/v3/projects/21716abeaba940d1bdae0c660acc6bc5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:37.504084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d15b2-5926-47b4-bf31-5bf76fc6b70f None admin] RBAC: Authorizing `identity:get_project(project_id=21716abeaba940d1bdae0c660acc6bc5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:37.504177 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573f1ad-05e3-437d-95a9-e4960a7116ab None admin] RBAC: Authorizing `identity:get_project(project_id=21716abeaba940d1bdae0c660acc6bc5)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:37.505525 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d15b2-5926-47b4-bf31-5bf76fc6b70f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:37.505623 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573f1ad-05e3-437d-95a9-e4960a7116ab None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:37.507400 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 62/119] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:00:37 2022] GET /identity/v3/projects/21716abeaba940d1bdae0c660acc6bc5 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:37.507499 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 57/119] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:00:37 2022] GET /identity/v3/projects/21716abeaba940d1bdae0c660acc6bc5 => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:37.508396 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d35265-2631-4775-b7c0-dd3924ad0d31 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:37.508940 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d35265-2631-4775-b7c0-dd3924ad0d31 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:37.509223 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d35265-2631-4775-b7c0-dd3924ad0d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:37.515021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d15b2-5926-47b4-bf31-5bf76fc6b70f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:37.527061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-c6d35265-2631-4775-b7c0-dd3924ad0d31 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:37.528266 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c6d35265-2631-4775-b7c0-dd3924ad0d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:37.592408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 58/120] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:37.594882 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775657cb-cb16-4e6a-9026-c0b21f4a6b42 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:37.595250 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775657cb-cb16-4e6a-9026-c0b21f4a6b42 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:37.595541 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775657cb-cb16-4e6a-9026-c0b21f4a6b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:37.611498 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-775657cb-cb16-4e6a-9026-c0b21f4a6b42 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:37.612618 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d15b2-5926-47b4-bf31-5bf76fc6b70f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:37.612734 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-775657cb-cb16-4e6a-9026-c0b21f4a6b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:37.646445 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebc0df-91c9-4d58-861e-7d95a49e2d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:37.647106 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebc0df-91c9-4d58-861e-7d95a49e2d58 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:37.647397 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebc0df-91c9-4d58-861e-7d95a49e2d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:37.647675 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebc0df-91c9-4d58-861e-7d95a49e2d58 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:37.648384 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebc0df-91c9-4d58-861e-7d95a49e2d58 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:37.649841 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebc0df-91c9-4d58-861e-7d95a49e2d58 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:37.675953 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 59/121] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:37.676792 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775657cb-cb16-4e6a-9026-c0b21f4a6b42 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:37.751054 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 63/122] 10.222.0.76 () {60 vars in 1141 bytes} [Mon May 16 15:00:37 2022] POST /identity/v3/projects => generated 302 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:00:37.751913 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebc0df-91c9-4d58-861e-7d95a49e2d58 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:37.782987 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775657cb-cb16-4e6a-9026-c0b21f4a6b42 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:37.822187 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59503189-c7e4-4d66-83c6-4c61c3b34668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:37.823143 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59503189-c7e4-4d66-83c6-4c61c3b34668 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:37.823569 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59503189-c7e4-4d66-83c6-4c61c3b34668 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:37.823991 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59503189-c7e4-4d66-83c6-4c61c3b34668 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:37.859322 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebc0df-91c9-4d58-861e-7d95a49e2d58 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:37.894852 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b886b-d668-48ed-875e-6157b4b8d36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:37.895870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b886b-d668-48ed-875e-6157b4b8d36b None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:37.896219 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b886b-d668-48ed-875e-6157b4b8d36b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:37.896559 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b886b-d668-48ed-875e-6157b4b8d36b None admin] PATH_INFO: `/v3/projects/21716abeaba940d1bdae0c660acc6bc5/users/cfa3cc953e414bc0b20f729623352259/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:37.896648 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59503189-c7e4-4d66-83c6-4c61c3b34668 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:37.898185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59503189-c7e4-4d66-83c6-4c61c3b34668 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:37.898798 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b886b-d668-48ed-875e-6157b4b8d36b None admin] RBAC: Authorizing `identity:create_grant(project_id=21716abeaba940d1bdae0c660acc6bc5, user_id=cfa3cc953e414bc0b20f729623352259, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:37.900367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b886b-d668-48ed-875e-6157b4b8d36b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:37.996953 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 60/123] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:00:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:00:37.998001 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59503189-c7e4-4d66-83c6-4c61c3b34668 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:38.009388 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 64/124] 10.222.0.76 () {58 vars in 1439 bytes} [Mon May 16 15:00:37 2022] PUT /identity/v3/projects/21716abeaba940d1bdae0c660acc6bc5/users/cfa3cc953e414bc0b20f729623352259/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:00:38.010242 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b886b-d668-48ed-875e-6157b4b8d36b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:38.116473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59503189-c7e4-4d66-83c6-4c61c3b34668 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:38.125465 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b886b-d668-48ed-875e-6157b4b8d36b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:38.154200 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f6910-7060-4d7d-bfde-38401421d825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:38.155485 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f6910-7060-4d7d-bfde-38401421d825 None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:38.155990 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f6910-7060-4d7d-bfde-38401421d825 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:38.156464 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f6910-7060-4d7d-bfde-38401421d825 None admin] PATH_INFO: `/v3/projects/21716abeaba940d1bdae0c660acc6bc5/users/f5d2bf1ef38b459e901ca8c53d1dc02e/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:38.159342 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f6910-7060-4d7d-bfde-38401421d825 None admin] RBAC: Authorizing `identity:create_grant(project_id=21716abeaba940d1bdae0c660acc6bc5, user_id=f5d2bf1ef38b459e901ca8c53d1dc02e, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:38.161190 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f6910-7060-4d7d-bfde-38401421d825 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:38.163318 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acb037-3be1-4b35-a303-65a28bd31526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:38.164150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acb037-3be1-4b35-a303-65a28bd31526 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:38.164544 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acb037-3be1-4b35-a303-65a28bd31526 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:38.164729 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acb037-3be1-4b35-a303-65a28bd31526 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:38.181804 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acb037-3be1-4b35-a303-65a28bd31526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:38.190781 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-c7acb037-3be1-4b35-a303-65a28bd31526 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 15:00:38.190781 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:38.190781 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:38.190781 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:38.190781 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:38.190781 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:38.190781 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:38.190781 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:38.190781 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:38.190781 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:38.190781 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:38.190781 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:38.190781 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:38.190781 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:38.190781 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:38.190781 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:38.191702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:38.191702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:38.191702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:38.191702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:38.191702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:38.191702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:38.191702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:38.191702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:38.191702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:38.191702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:38.191702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:38.191702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:00:38.191702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:38.191702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:38.191702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:38.191702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:38.192471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:38.192471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:38.192471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:38.192471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:38.192471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:38.192471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:38.192471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:38.192471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:38.192471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:38.192471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:38.192471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 15:00:38.192471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:00:38.193559 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 65/125] 10.222.0.76 () {56 vars in 1114 bytes} [Mon May 16 15:00:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:00:38.195819 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acb037-3be1-4b35-a303-65a28bd31526 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:38.273395 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 61/126] 10.222.0.76 () {58 vars in 1439 bytes} [Mon May 16 15:00:37 2022] PUT /identity/v3/projects/21716abeaba940d1bdae0c660acc6bc5/users/f5d2bf1ef38b459e901ca8c53d1dc02e/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:00:38.274014 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f6910-7060-4d7d-bfde-38401421d825 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:38.305887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acb037-3be1-4b35-a303-65a28bd31526 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:38.342321 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34294d-c427-4283-a03e-6ee000fe13ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:38.343370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34294d-c427-4283-a03e-6ee000fe13ee None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:38.343794 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34294d-c427-4283-a03e-6ee000fe13ee None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:38.344268 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34294d-c427-4283-a03e-6ee000fe13ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:38.355831 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34294d-c427-4283-a03e-6ee000fe13ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:38.364240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-cd34294d-c427-4283-a03e-6ee000fe13ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 15:00:38.364240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:38.364240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:38.364240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:38.364240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:38.364240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:38.364240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:38.364240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:38.364240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:38.364240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:38.364240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:38.364240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:38.364240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:38.364240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:38.364240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:38.364240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:38.365264 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:38.365264 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:38.365264 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:38.365264 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:38.365264 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:38.365264 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:38.365264 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:38.365264 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:38.365264 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:38.365264 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:38.365264 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:38.365264 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:00:38.365264 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:38.365264 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:38.365264 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:38.365264 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:38.366176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:38.366176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:38.366176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:38.366176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:38.366176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:38.366176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:38.366176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:38.366176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:38.366176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:38.366176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:38.366176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 15:00:38.366176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:00:38.368114 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 66/127] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:00:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:00:38.369098 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34294d-c427-4283-a03e-6ee000fe13ee None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:38.383116 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f6910-7060-4d7d-bfde-38401421d825 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:38.420126 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff3cdd-0731-4bff-bf41-e095ecce57d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:38.421012 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff3cdd-0731-4bff-bf41-e095ecce57d9 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:38.421296 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff3cdd-0731-4bff-bf41-e095ecce57d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:38.421574 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff3cdd-0731-4bff-bf41-e095ecce57d9 None admin] PATH_INFO: `/v3/projects/21716abeaba940d1bdae0c660acc6bc5` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:38.423469 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff3cdd-0731-4bff-bf41-e095ecce57d9 None admin] RBAC: Authorizing `identity:get_project(project_id=21716abeaba940d1bdae0c660acc6bc5)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:38.425075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff3cdd-0731-4bff-bf41-e095ecce57d9 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:38.427646 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 62/128] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:00:38 2022] GET /identity/v3/projects/21716abeaba940d1bdae0c660acc6bc5 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:38.428054 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff3cdd-0731-4bff-bf41-e095ecce57d9 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:38.481150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34294d-c427-4283-a03e-6ee000fe13ee None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:38.517622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694e7a5-e7ee-43a0-911a-2e5bb4306027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:38.518704 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694e7a5-e7ee-43a0-911a-2e5bb4306027 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:38.519161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694e7a5-e7ee-43a0-911a-2e5bb4306027 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:38.519607 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694e7a5-e7ee-43a0-911a-2e5bb4306027 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:38.520537 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694e7a5-e7ee-43a0-911a-2e5bb4306027 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:38.521015 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694e7a5-e7ee-43a0-911a-2e5bb4306027 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:38.522700 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694e7a5-e7ee-43a0-911a-2e5bb4306027 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:38.531417 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 67/129] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:00:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:38.532986 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694e7a5-e7ee-43a0-911a-2e5bb4306027 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:38.534609 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff3cdd-0731-4bff-bf41-e095ecce57d9 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:38.582963 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7038445-2ee6-4f9d-a7ee-0c44f060d604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:38.583671 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7038445-2ee6-4f9d-a7ee-0c44f060d604 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:38.583949 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7038445-2ee6-4f9d-a7ee-0c44f060d604 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:38.584230 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7038445-2ee6-4f9d-a7ee-0c44f060d604 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:38.585011 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7038445-2ee6-4f9d-a7ee-0c44f060d604 None admin] RBAC: Adding query filter params (name=member) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:38.585320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7038445-2ee6-4f9d-a7ee-0c44f060d604 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:38.587003 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7038445-2ee6-4f9d-a7ee-0c44f060d604 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:38.612208 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 63/130] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:00:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:38.613178 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7038445-2ee6-4f9d-a7ee-0c44f060d604 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:38.646390 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694e7a5-e7ee-43a0-911a-2e5bb4306027 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:38.685553 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbc659-f4be-4cb0-bbdf-871b9d472f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:38.686723 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbc659-f4be-4cb0-bbdf-871b9d472f41 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:38.687479 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbc659-f4be-4cb0-bbdf-871b9d472f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:38.688519 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbc659-f4be-4cb0-bbdf-871b9d472f41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:38.689590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbc659-f4be-4cb0-bbdf-871b9d472f41 None admin] RBAC: Adding query filter params (role.id=046c7400e19f4144be943daf291f32db, scope.project.id=21716abeaba940d1bdae0c660acc6bc5, user.id=07b3d14137ce4f2abf1ed2ff6d0ba6f5) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:38.690098 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbc659-f4be-4cb0-bbdf-871b9d472f41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:38.692580 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbc659-f4be-4cb0-bbdf-871b9d472f41 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:38.700219 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 68/131] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:00:38 2022] GET /identity/v3/role_assignments?user.id=07b3d14137ce4f2abf1ed2ff6d0ba6f5&scope.project.id=21716abeaba940d1bdae0c660acc6bc5&role.id=046c7400e19f4144be943daf291f32db => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:38.701246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbc659-f4be-4cb0-bbdf-871b9d472f41 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:38.786818 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7038445-2ee6-4f9d-a7ee-0c44f060d604 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:38.844608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc34e4-2922-4990-a7a4-a3872de2752d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:38.845493 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc34e4-2922-4990-a7a4-a3872de2752d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:38.845780 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc34e4-2922-4990-a7a4-a3872de2752d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:38.846061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc34e4-2922-4990-a7a4-a3872de2752d None admin] PATH_INFO: `/v3/users/f5d2bf1ef38b459e901ca8c53d1dc02e` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:38.847348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc34e4-2922-4990-a7a4-a3872de2752d None admin] RBAC: Authorizing `identity:get_user(user_id=f5d2bf1ef38b459e901ca8c53d1dc02e)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:38.848834 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc34e4-2922-4990-a7a4-a3872de2752d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:38.850554 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 64/132] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:38 2022] GET /identity/v3/users/f5d2bf1ef38b459e901ca8c53d1dc02e => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:38.856132 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc34e4-2922-4990-a7a4-a3872de2752d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:38.881989 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbc659-f4be-4cb0-bbdf-871b9d472f41 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:38.978972 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa13f7-5ca1-48c3-8ad7-badd399a5a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:38.979884 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa13f7-5ca1-48c3-8ad7-badd399a5a28 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:38.980173 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa13f7-5ca1-48c3-8ad7-badd399a5a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:38.980460 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa13f7-5ca1-48c3-8ad7-badd399a5a28 None admin] PATH_INFO: `/v3/users/f5d2bf1ef38b459e901ca8c53d1dc02e` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:38.987079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa13f7-5ca1-48c3-8ad7-badd399a5a28 None admin] RBAC: Authorizing `identity:get_user(user_id=f5d2bf1ef38b459e901ca8c53d1dc02e)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:38.988599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa13f7-5ca1-48c3-8ad7-badd399a5a28 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:38.990713 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 69/133] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:38 2022] GET /identity/v3/users/f5d2bf1ef38b459e901ca8c53d1dc02e => generated 275 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:38.996080 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa13f7-5ca1-48c3-8ad7-badd399a5a28 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:39.030070 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc34e4-2922-4990-a7a4-a3872de2752d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:39.095039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7980f7-e185-4a68-84a2-84aae31647e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:39.095847 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7980f7-e185-4a68-84a2-84aae31647e1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:39.096130 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7980f7-e185-4a68-84a2-84aae31647e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:39.096699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7980f7-e185-4a68-84a2-84aae31647e1 None admin] PATH_INFO: `/v3/projects/21716abeaba940d1bdae0c660acc6bc5` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:39.097700 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7980f7-e185-4a68-84a2-84aae31647e1 None admin] RBAC: Authorizing `identity:get_project(project_id=21716abeaba940d1bdae0c660acc6bc5)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:39.099206 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7980f7-e185-4a68-84a2-84aae31647e1 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:39.101278 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 65/134] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:00:38 2022] GET /identity/v3/projects/21716abeaba940d1bdae0c660acc6bc5 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:00:39.107008 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7980f7-e185-4a68-84a2-84aae31647e1 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:39.143309 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa13f7-5ca1-48c3-8ad7-badd399a5a28 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:39.193279 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0678a3-d000-437d-9a18-1bc6dae30c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:39.194520 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0678a3-d000-437d-9a18-1bc6dae30c67 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:39.195095 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0678a3-d000-437d-9a18-1bc6dae30c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:39.195557 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0678a3-d000-437d-9a18-1bc6dae30c67 None admin] PATH_INFO: `/v3/projects/8830a506e3894ac980ab89554499a44a` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:39.202927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0678a3-d000-437d-9a18-1bc6dae30c67 None admin] RBAC: Authorizing `identity:get_project(project_id=8830a506e3894ac980ab89554499a44a)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:39.204802 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0678a3-d000-437d-9a18-1bc6dae30c67 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:39.206792 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 70/135] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:00:38 2022] GET /identity/v3/projects/8830a506e3894ac980ab89554499a44a => generated 312 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:00:39.212238 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0678a3-d000-437d-9a18-1bc6dae30c67 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:39.230196 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7980f7-e185-4a68-84a2-84aae31647e1 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:39.262279 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f49e9-55da-4f2d-b31f-8cddea435c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:39.263182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f49e9-55da-4f2d-b31f-8cddea435c8f None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:39.263471 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f49e9-55da-4f2d-b31f-8cddea435c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:39.263751 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f49e9-55da-4f2d-b31f-8cddea435c8f None admin] PATH_INFO: `/v3/projects/21716abeaba940d1bdae0c660acc6bc5/users/f5d2bf1ef38b459e901ca8c53d1dc02e/roles/00ecc8471dbb4296b40c8b8c0b29aedd` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:39.273183 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f49e9-55da-4f2d-b31f-8cddea435c8f None admin] RBAC: Authorizing `identity:create_grant(project_id=21716abeaba940d1bdae0c660acc6bc5, user_id=f5d2bf1ef38b459e901ca8c53d1dc02e, role_id=00ecc8471dbb4296b40c8b8c0b29aedd)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:39.274758 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f49e9-55da-4f2d-b31f-8cddea435c8f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:39.353030 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 66/136] 10.222.0.76 () {58 vars in 1439 bytes} [Mon May 16 15:00:39 2022] PUT /identity/v3/projects/21716abeaba940d1bdae0c660acc6bc5/users/f5d2bf1ef38b459e901ca8c53d1dc02e/roles/00ecc8471dbb4296b40c8b8c0b29aedd => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:00:39.387460 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0678a3-d000-437d-9a18-1bc6dae30c67 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:39.441406 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17187917-4d66-4a8c-9685-668d572d847e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:39.442693 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17187917-4d66-4a8c-9685-668d572d847e None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:39.443170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17187917-4d66-4a8c-9685-668d572d847e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:39.443672 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17187917-4d66-4a8c-9685-668d572d847e None admin] PATH_INFO: `/v3/projects/8830a506e3894ac980ab89554499a44a/users/f5d2bf1ef38b459e901ca8c53d1dc02e/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:39.451718 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17187917-4d66-4a8c-9685-668d572d847e None admin] RBAC: Authorizing `identity:create_grant(project_id=8830a506e3894ac980ab89554499a44a, user_id=f5d2bf1ef38b459e901ca8c53d1dc02e, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:39.453545 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17187917-4d66-4a8c-9685-668d572d847e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:39.544044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 71/137] 10.222.0.76 () {58 vars in 1439 bytes} [Mon May 16 15:00:39 2022] PUT /identity/v3/projects/8830a506e3894ac980ab89554499a44a/users/f5d2bf1ef38b459e901ca8c53d1dc02e/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:00:40.948171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6960b-a2e8-4342-a379-73d6b57b8593 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:40.948711 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6960b-a2e8-4342-a379-73d6b57b8593 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:40.948711 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6960b-a2e8-4342-a379-73d6b57b8593 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:40.950291 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 67/138] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:40.955872 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0aee0-e577-4825-8a28-2a2dfb742a3f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:40.956281 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0aee0-e577-4825-8a28-2a2dfb742a3f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:40.956483 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0aee0-e577-4825-8a28-2a2dfb742a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:40.979151 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-cdb0aee0-e577-4825-8a28-2a2dfb742a3f None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:40.980358 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cdb0aee0-e577-4825-8a28-2a2dfb742a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:40.985804 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbcd39-ceb0-4bf0-ac62-8e2054ea4255 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:40.986385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbcd39-ceb0-4bf0-ac62-8e2054ea4255 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:40.986897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbcd39-ceb0-4bf0-ac62-8e2054ea4255 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:40.988707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 68/139] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:41.002091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b713896-9df9-4a73-9f70-552e34bb8609 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:41.002721 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b713896-9df9-4a73-9f70-552e34bb8609 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:41.003222 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b713896-9df9-4a73-9f70-552e34bb8609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:41.042789 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-4b713896-9df9-4a73-9f70-552e34bb8609 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:41.043972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4b713896-9df9-4a73-9f70-552e34bb8609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:41.078847 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 72/140] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:41.112582 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0aee0-e577-4825-8a28-2a2dfb742a3f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:41.195887 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 69/141] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:00:41.232336 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b713896-9df9-4a73-9f70-552e34bb8609 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:41.252254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0aee0-e577-4825-8a28-2a2dfb742a3f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:41.294083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc54945-cc96-4b6f-834d-65fc4d7176c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:41.294909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc54945-cc96-4b6f-834d-65fc4d7176c7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:41.295187 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc54945-cc96-4b6f-834d-65fc4d7176c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:41.295458 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc54945-cc96-4b6f-834d-65fc4d7176c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:41.311173 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc54945-cc96-4b6f-834d-65fc4d7176c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:41.319759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-0bc54945-cc96-4b6f-834d-65fc4d7176c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:00:41.319759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:41.319759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:41.319759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:41.319759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:41.319759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:41.319759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:41.319759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:41.319759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:41.319759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:41.319759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:41.319759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:41.319759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:41.319759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:41.319759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:41.319759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:41.320628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:41.320628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:41.320628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:41.320628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:41.320628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:41.320628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:41.320628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:41.320628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:41.320628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:41.320628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:41.320628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:41.320628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:00:41.320628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:41.320628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:41.320628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:41.320628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:41.321385 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:41.321385 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:41.321385 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:41.321385 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:41.321385 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:41.321385 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:41.321385 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:41.321385 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:41.321385 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:41.321385 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:41.321385 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:00:41.321385 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:00:41.321385 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 73/142] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:00:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:00:41.327099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3380b6b-a9cb-490d-89ae-88d498620562 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:41.327385 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3380b6b-a9cb-490d-89ae-88d498620562 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:41.327664 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3380b6b-a9cb-490d-89ae-88d498620562 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:41.329643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 74/143] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:00:41.330249 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3380b6b-a9cb-490d-89ae-88d498620562 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:41.397130 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b713896-9df9-4a73-9f70-552e34bb8609 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:41.442760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173fa27-272d-48dd-b8e7-aab5d0770bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:41.443566 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173fa27-272d-48dd-b8e7-aab5d0770bef None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:41.443852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173fa27-272d-48dd-b8e7-aab5d0770bef None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:41.444130 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173fa27-272d-48dd-b8e7-aab5d0770bef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:41.445711 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173fa27-272d-48dd-b8e7-aab5d0770bef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:41.447221 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173fa27-272d-48dd-b8e7-aab5d0770bef None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:41.449063 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 70/144] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:00:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:00:41.450071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209ece7-69a4-4f29-b8c8-7593a2cabac5 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:41.450399 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209ece7-69a4-4f29-b8c8-7593a2cabac5 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:41.450784 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209ece7-69a4-4f29-b8c8-7593a2cabac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:41.459111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3380b6b-a9cb-490d-89ae-88d498620562 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:41.473236 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-3209ece7-69a4-4f29-b8c8-7593a2cabac5 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:41.475775 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3209ece7-69a4-4f29-b8c8-7593a2cabac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:41.524541 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26d5c0-6013-499d-964f-98de3c64e3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:41.526197 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26d5c0-6013-499d-964f-98de3c64e3fd None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:41.527236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26d5c0-6013-499d-964f-98de3c64e3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:41.528520 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26d5c0-6013-499d-964f-98de3c64e3fd None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:41.529918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26d5c0-6013-499d-964f-98de3c64e3fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:41.531227 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26d5c0-6013-499d-964f-98de3c64e3fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:41.534748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26d5c0-6013-499d-964f-98de3c64e3fd None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:41.549825 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 75/145] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:00:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:41.550628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26d5c0-6013-499d-964f-98de3c64e3fd None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:41.603647 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 71/146] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:41.604375 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209ece7-69a4-4f29-b8c8-7593a2cabac5 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:41.757116 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209ece7-69a4-4f29-b8c8-7593a2cabac5 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:41.773766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26d5c0-6013-499d-964f-98de3c64e3fd None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:41.794572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41ca26-6d44-4736-ac77-db99aa7d0819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:41.795436 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41ca26-6d44-4736-ac77-db99aa7d0819 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:41.795721 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41ca26-6d44-4736-ac77-db99aa7d0819 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:41.796000 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41ca26-6d44-4736-ac77-db99aa7d0819 None admin] PATH_INFO: `/v3/users/cfa3cc953e414bc0b20f729623352259` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:41.797283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41ca26-6d44-4736-ac77-db99aa7d0819 None admin] RBAC: Authorizing `identity:get_user(user_id=cfa3cc953e414bc0b20f729623352259)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:41.799002 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41ca26-6d44-4736-ac77-db99aa7d0819 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:41.801261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 72/147] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:41 2022] GET /identity/v3/users/cfa3cc953e414bc0b20f729623352259 => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:41.802170 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41ca26-6d44-4736-ac77-db99aa7d0819 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:41.847396 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea9fae-9385-496d-9a38-3d173588fc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:41.848085 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea9fae-9385-496d-9a38-3d173588fc2e None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:41.848375 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea9fae-9385-496d-9a38-3d173588fc2e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:41.848660 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea9fae-9385-496d-9a38-3d173588fc2e None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:41.849389 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea9fae-9385-496d-9a38-3d173588fc2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:41.850952 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea9fae-9385-496d-9a38-3d173588fc2e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:41.921507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41ca26-6d44-4736-ac77-db99aa7d0819 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:41.956737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def01ea9-acc7-4fa8-8633-42c2f50526f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:41.957541 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def01ea9-acc7-4fa8-8633-42c2f50526f2 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:41.957829 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def01ea9-acc7-4fa8-8633-42c2f50526f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:41.958109 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def01ea9-acc7-4fa8-8633-42c2f50526f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:41.968413 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def01ea9-acc7-4fa8-8633-42c2f50526f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:41.976612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-def01ea9-acc7-4fa8-8633-42c2f50526f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 15:00:41.976612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:41.976612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:41.976612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:41.976612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:41.976612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:41.976612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:41.976612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:41.976612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:41.976612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:41.976612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:41.976612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:41.976612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:41.976612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:41.976612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:41.976612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:41.977503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:41.977503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:41.977503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:41.977503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:41.977503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:41.977503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:41.977503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:41.977503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:41.977503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:41.977503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:41.977503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:41.977503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:00:41.977503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:41.977503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:41.977503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:41.977503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:41.978640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:41.978640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:41.978640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:41.978640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:41.978640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:41.978640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:41.978640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:41.978640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:41.978640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:41.978640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:41.978640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 15:00:41.978640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:00:41.978640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 73/148] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:00:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:00:41.978640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def01ea9-acc7-4fa8-8633-42c2f50526f2 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:42.005111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 76/149] 10.222.0.76 () {60 vars in 1132 bytes} [Mon May 16 15:00:41 2022] POST /identity/v3/users => generated 283 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:00:42.006636 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f181b33-b2ee-4c66-936b-3493c84c265f None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:42.006996 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f181b33-b2ee-4c66-936b-3493c84c265f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:42.007286 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f181b33-b2ee-4c66-936b-3493c84c265f None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:42.009471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 77/150] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:42.010356 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f181b33-b2ee-4c66-936b-3493c84c265f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:42.126288 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f181b33-b2ee-4c66-936b-3493c84c265f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:42.137068 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def01ea9-acc7-4fa8-8633-42c2f50526f2 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:42.185756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e035fd9-3829-4417-9423-430965859a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:42.187765 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e035fd9-3829-4417-9423-430965859a18 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:42.188052 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e035fd9-3829-4417-9423-430965859a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:42.188331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e035fd9-3829-4417-9423-430965859a18 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:42.190333 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e035fd9-3829-4417-9423-430965859a18 None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:42.190648 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e035fd9-3829-4417-9423-430965859a18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:42.192104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e035fd9-3829-4417-9423-430965859a18 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:42.213336 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29629189-9fb9-4fe7-8792-0fbe2ec3c33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:42.214059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29629189-9fb9-4fe7-8792-0fbe2ec3c33a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:42.214550 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29629189-9fb9-4fe7-8792-0fbe2ec3c33a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:42.214847 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29629189-9fb9-4fe7-8792-0fbe2ec3c33a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:42.215767 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 78/151] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:00:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:42.223898 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511843c9-0b94-4431-b804-99192c037426 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:42.224194 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511843c9-0b94-4431-b804-99192c037426 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:42.224447 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511843c9-0b94-4431-b804-99192c037426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:42.262736 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-511843c9-0b94-4431-b804-99192c037426 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:42.264343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-511843c9-0b94-4431-b804-99192c037426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:42.313874 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29629189-9fb9-4fe7-8792-0fbe2ec3c33a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:42.315421 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29629189-9fb9-4fe7-8792-0fbe2ec3c33a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:42.369940 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 79/152] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:42.371155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511843c9-0b94-4431-b804-99192c037426 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:42.426754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 74/153] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:00:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:00:42.427626 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29629189-9fb9-4fe7-8792-0fbe2ec3c33a None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:42.504908 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511843c9-0b94-4431-b804-99192c037426 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:42.542710 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29629189-9fb9-4fe7-8792-0fbe2ec3c33a None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:42.555466 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c00716-8646-47bf-92e1-5bf9d7222687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:42.556453 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c00716-8646-47bf-92e1-5bf9d7222687 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:42.556735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c00716-8646-47bf-92e1-5bf9d7222687 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:42.557007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c00716-8646-47bf-92e1-5bf9d7222687 None admin] PATH_INFO: `/v3/users/f5d2bf1ef38b459e901ca8c53d1dc02e` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:42.558886 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c00716-8646-47bf-92e1-5bf9d7222687 None admin] RBAC: Authorizing `identity:get_user(user_id=f5d2bf1ef38b459e901ca8c53d1dc02e)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:42.560598 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c00716-8646-47bf-92e1-5bf9d7222687 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:42.563187 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 80/154] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:42 2022] GET /identity/v3/users/f5d2bf1ef38b459e901ca8c53d1dc02e => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:42.564322 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c00716-8646-47bf-92e1-5bf9d7222687 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:42.593173 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c875746-3af7-4912-9cfc-684f43a27647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:42.594682 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c875746-3af7-4912-9cfc-684f43a27647 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:42.594972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c875746-3af7-4912-9cfc-684f43a27647 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:42.595254 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c875746-3af7-4912-9cfc-684f43a27647 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:42.608625 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c875746-3af7-4912-9cfc-684f43a27647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:42.621832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-4c875746-3af7-4912-9cfc-684f43a27647 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 15:00:42.621832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:42.621832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:42.621832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:42.621832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:42.621832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:42.621832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:42.621832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:42.621832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:42.621832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:42.621832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:42.621832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:42.621832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:42.621832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:42.621832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:42.621832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:42.622827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:42.622827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:42.622827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:42.622827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:42.622827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:42.622827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:42.622827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:42.622827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:42.622827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:42.622827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:42.622827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:42.622827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:00:42.622827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:42.622827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:42.622827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:42.622827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:42.624022 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:42.624022 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:42.624022 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:42.624022 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:42.624022 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:42.624022 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:42.624022 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:42.624022 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:42.624022 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:42.624022 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:42.624022 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 15:00:42.624022 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:00:42.624022 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 75/155] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:00:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:00:42.624022 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c875746-3af7-4912-9cfc-684f43a27647 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:42.694888 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c00716-8646-47bf-92e1-5bf9d7222687 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:42.731203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d7224-3fb2-455b-a844-651ff26acd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:42.732429 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d7224-3fb2-455b-a844-651ff26acd75 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:42.732965 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d7224-3fb2-455b-a844-651ff26acd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:42.733434 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d7224-3fb2-455b-a844-651ff26acd75 None admin] PATH_INFO: `/v3/projects/21716abeaba940d1bdae0c660acc6bc5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:42.734935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d7224-3fb2-455b-a844-651ff26acd75 None admin] RBAC: Authorizing `identity:get_project(project_id=21716abeaba940d1bdae0c660acc6bc5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:42.736657 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d7224-3fb2-455b-a844-651ff26acd75 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:42.739015 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 81/156] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:00:42 2022] GET /identity/v3/projects/21716abeaba940d1bdae0c660acc6bc5 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:42.739993 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d7224-3fb2-455b-a844-651ff26acd75 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:42.747375 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c875746-3af7-4912-9cfc-684f43a27647 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:42.789067 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c16d5-de86-4843-9c9c-86f838db59ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:42.789729 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c16d5-de86-4843-9c9c-86f838db59ac None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:42.790018 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c16d5-de86-4843-9c9c-86f838db59ac None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:42.790330 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c16d5-de86-4843-9c9c-86f838db59ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:42.858682 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d7224-3fb2-455b-a844-651ff26acd75 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:42.861572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c16d5-de86-4843-9c9c-86f838db59ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:42.863114 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c16d5-de86-4843-9c9c-86f838db59ac None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:42.903044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c37a9-1dc0-4297-9667-4c4cf2ee868e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:42.903740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c37a9-1dc0-4297-9667-4c4cf2ee868e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:42.904000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c37a9-1dc0-4297-9667-4c4cf2ee868e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:42.904275 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c37a9-1dc0-4297-9667-4c4cf2ee868e None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:42.905031 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c37a9-1dc0-4297-9667-4c4cf2ee868e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:42.905336 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c37a9-1dc0-4297-9667-4c4cf2ee868e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:42.907441 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c37a9-1dc0-4297-9667-4c4cf2ee868e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:42.919883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 82/157] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:00:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:42.920899 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c37a9-1dc0-4297-9667-4c4cf2ee868e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:42.989620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 76/158] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:00:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:00:42.990931 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5afdc7-7ec3-457a-96c1-eae75a1cdc3a None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:42.991219 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5afdc7-7ec3-457a-96c1-eae75a1cdc3a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:42.991498 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5afdc7-7ec3-457a-96c1-eae75a1cdc3a None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:42.992899 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 77/159] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:42.993814 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782d409-e672-4fc8-a3c8-7b37f548eb5b None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:42.994097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782d409-e672-4fc8-a3c8-7b37f548eb5b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:42.994401 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782d409-e672-4fc8-a3c8-7b37f548eb5b None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:42.995754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 78/160] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:42.996322 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782d409-e672-4fc8-a3c8-7b37f548eb5b None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:43.050916 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c37a9-1dc0-4297-9667-4c4cf2ee868e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:43.099340 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e9b0d-b1b0-4151-bd12-c82629124b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:43.100356 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e9b0d-b1b0-4151-bd12-c82629124b79 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:43.100836 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e9b0d-b1b0-4151-bd12-c82629124b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:43.101305 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e9b0d-b1b0-4151-bd12-c82629124b79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:43.102418 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e9b0d-b1b0-4151-bd12-c82629124b79 None admin] RBAC: Adding query filter params (role.id=f6c8fc0dc0f24de3907b0960a1201901, scope.project.id=21716abeaba940d1bdae0c660acc6bc5, user.id=cfa3cc953e414bc0b20f729623352259) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:43.102929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e9b0d-b1b0-4151-bd12-c82629124b79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:43.104597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e9b0d-b1b0-4151-bd12-c82629124b79 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:43.111948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 83/161] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:00:42 2022] GET /identity/v3/role_assignments?user.id=cfa3cc953e414bc0b20f729623352259&scope.project.id=21716abeaba940d1bdae0c660acc6bc5&role.id=f6c8fc0dc0f24de3907b0960a1201901 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:43.113435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4eea8-1aba-46fa-a2ea-acb77c99879c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:43.113939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4eea8-1aba-46fa-a2ea-acb77c99879c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:43.114450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4eea8-1aba-46fa-a2ea-acb77c99879c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:43.132865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-0cd4eea8-1aba-46fa-a2ea-acb77c99879c None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:43.134704 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0cd4eea8-1aba-46fa-a2ea-acb77c99879c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:43.143010 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782d409-e672-4fc8-a3c8-7b37f548eb5b None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:43.206977 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 84/162] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:43.208607 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049609b2-05ef-4858-a4f0-ad49c96cf15a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:43.209112 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049609b2-05ef-4858-a4f0-ad49c96cf15a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:43.209582 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049609b2-05ef-4858-a4f0-ad49c96cf15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:43.212214 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f4f77-e11d-4a5a-b5fe-1c7c6ade3b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:43.213096 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f4f77-e11d-4a5a-b5fe-1c7c6ade3b25 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:43.213385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f4f77-e11d-4a5a-b5fe-1c7c6ade3b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:43.213667 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f4f77-e11d-4a5a-b5fe-1c7c6ade3b25 None admin] PATH_INFO: `/v3/users/07b3d14137ce4f2abf1ed2ff6d0ba6f5` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:43.219424 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f4f77-e11d-4a5a-b5fe-1c7c6ade3b25 None admin] RBAC: Authorizing `identity:get_user(user_id=07b3d14137ce4f2abf1ed2ff6d0ba6f5)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:43.220901 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f4f77-e11d-4a5a-b5fe-1c7c6ade3b25 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:43.222818 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 79/163] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:42 2022] GET /identity/v3/users/07b3d14137ce4f2abf1ed2ff6d0ba6f5 => generated 289 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:43.223490 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f4f77-e11d-4a5a-b5fe-1c7c6ade3b25 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:43.229140 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-049609b2-05ef-4858-a4f0-ad49c96cf15a None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:43.230601 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-049609b2-05ef-4858-a4f0-ad49c96cf15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:43.303049 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 85/164] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:43.304249 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049609b2-05ef-4858-a4f0-ad49c96cf15a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:43.395596 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f4f77-e11d-4a5a-b5fe-1c7c6ade3b25 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:43.409177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049609b2-05ef-4858-a4f0-ad49c96cf15a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:43.447199 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce531c7-e8aa-45b6-9c37-82c78e557ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:43.448093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce531c7-e8aa-45b6-9c37-82c78e557ece None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:43.448372 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce531c7-e8aa-45b6-9c37-82c78e557ece None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:43.448645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce531c7-e8aa-45b6-9c37-82c78e557ece None admin] PATH_INFO: `/v3/projects/21716abeaba940d1bdae0c660acc6bc5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:43.451288 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce531c7-e8aa-45b6-9c37-82c78e557ece None admin] RBAC: Authorizing `identity:get_project(project_id=21716abeaba940d1bdae0c660acc6bc5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:43.452758 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce531c7-e8aa-45b6-9c37-82c78e557ece None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:43.457890 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 86/165] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:00:43 2022] GET /identity/v3/projects/21716abeaba940d1bdae0c660acc6bc5 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:43.459206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce531c7-e8aa-45b6-9c37-82c78e557ece None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:43.464227 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747c2fc-ee60-471f-b599-1d261fbe8591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:43.465108 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747c2fc-ee60-471f-b599-1d261fbe8591 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:43.465389 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747c2fc-ee60-471f-b599-1d261fbe8591 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:43.465666 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747c2fc-ee60-471f-b599-1d261fbe8591 None admin] PATH_INFO: `/v3/projects/21716abeaba940d1bdae0c660acc6bc5` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:43.468782 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747c2fc-ee60-471f-b599-1d261fbe8591 None admin] RBAC: Authorizing `identity:get_project(project_id=21716abeaba940d1bdae0c660acc6bc5)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:43.470310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747c2fc-ee60-471f-b599-1d261fbe8591 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:43.477658 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 80/166] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:00:43 2022] GET /identity/v3/projects/21716abeaba940d1bdae0c660acc6bc5 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:43.478572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747c2fc-ee60-471f-b599-1d261fbe8591 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:43.599713 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce531c7-e8aa-45b6-9c37-82c78e557ece None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:43.635560 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fea425-321d-42de-8458-a255d435b843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:43.636631 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fea425-321d-42de-8458-a255d435b843 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:43.637055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fea425-321d-42de-8458-a255d435b843 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:43.637551 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fea425-321d-42de-8458-a255d435b843 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:43.648997 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fea425-321d-42de-8458-a255d435b843 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:43.658158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-08fea425-321d-42de-8458-a255d435b843 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 15:00:43.658158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:43.658158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:43.658158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:43.658158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:43.658158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:43.658158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:43.658158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:43.658158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:43.658158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:43.658158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:43.658158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:43.658158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:43.658158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:43.658158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:43.658158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:43.659263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:43.659263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:43.659263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:43.659263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:43.659263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:43.659263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:43.659263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:43.659263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:43.659263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:43.659263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:43.659263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:43.659263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:00:43.659263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:43.659263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:43.659263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:43.659263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:43.660215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:43.660215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:43.660215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:43.660215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:43.660215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:43.660215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:43.660215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:43.660215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:43.660215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:43.660215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:43.660215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 15:00:43.660215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:00:43.662176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 87/167] 10.222.0.76 () {56 vars in 1114 bytes} [Mon May 16 15:00:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:00:43.663108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fea425-321d-42de-8458-a255d435b843 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:43.702856 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747c2fc-ee60-471f-b599-1d261fbe8591 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:43.747617 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789ec86-c8ee-40e3-bb97-4d166af3a5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:43.749388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789ec86-c8ee-40e3-bb97-4d166af3a5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:43.751651 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789ec86-c8ee-40e3-bb97-4d166af3a5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:43.752783 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789ec86-c8ee-40e3-bb97-4d166af3a5d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:43.777353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789ec86-c8ee-40e3-bb97-4d166af3a5d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:43.786053 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-1789ec86-c8ee-40e3-bb97-4d166af3a5d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 15:00:43.786053 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:43.786053 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:43.786053 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:43.786053 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:43.786053 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:43.786053 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:43.786053 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:43.786053 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:43.786053 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:43.786053 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:43.786053 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:43.786053 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:43.786053 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:43.786053 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:43.786053 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:43.786939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:43.786939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:43.786939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:43.786939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:43.786939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:43.786939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:43.786939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:43.786939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:43.786939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:43.786939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:43.786939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:43.786939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:00:43.786939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:43.786939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:43.786939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:43.786939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:43.787712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:43.787712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:43.787712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:43.787712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:43.787712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:43.787712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:43.787712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:43.787712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:43.787712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:43.787712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:43.787712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 15:00:43.787712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:00:43.793539 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 81/168] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:00:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:00:43.795458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789ec86-c8ee-40e3-bb97-4d166af3a5d6 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:43.820716 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fea425-321d-42de-8458-a255d435b843 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:43.894821 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20ede4-1068-4580-b20c-8812a5149fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:43.896101 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20ede4-1068-4580-b20c-8812a5149fab None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:43.896582 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20ede4-1068-4580-b20c-8812a5149fab None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:43.897052 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20ede4-1068-4580-b20c-8812a5149fab None admin] PATH_INFO: `/v3/projects/21716abeaba940d1bdae0c660acc6bc5/users/07b3d14137ce4f2abf1ed2ff6d0ba6f5/roles/046c7400e19f4144be943daf291f32db` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:43.899278 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20ede4-1068-4580-b20c-8812a5149fab None admin] RBAC: Authorizing `identity:create_grant(project_id=21716abeaba940d1bdae0c660acc6bc5, user_id=07b3d14137ce4f2abf1ed2ff6d0ba6f5, role_id=046c7400e19f4144be943daf291f32db)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:43.900964 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20ede4-1068-4580-b20c-8812a5149fab None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:43.909927 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789ec86-c8ee-40e3-bb97-4d166af3a5d6 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:43.948796 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3306eb7-a8cb-422d-8a9a-ec31c3f9c6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:43.949562 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3306eb7-a8cb-422d-8a9a-ec31c3f9c6dc None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:43.949852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3306eb7-a8cb-422d-8a9a-ec31c3f9c6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:43.950167 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3306eb7-a8cb-422d-8a9a-ec31c3f9c6dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:43.951040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3306eb7-a8cb-422d-8a9a-ec31c3f9c6dc None admin] RBAC: Adding query filter params (role.id=0e00f6ebfc2843a0992b3d01f50e262d, scope.project.id=21716abeaba940d1bdae0c660acc6bc5, user.id=f5d2bf1ef38b459e901ca8c53d1dc02e) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:43.951410 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3306eb7-a8cb-422d-8a9a-ec31c3f9c6dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:43.952939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3306eb7-a8cb-422d-8a9a-ec31c3f9c6dc None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:43.960366 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 82/169] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:00:43 2022] GET /identity/v3/role_assignments?user.id=f5d2bf1ef38b459e901ca8c53d1dc02e&scope.project.id=21716abeaba940d1bdae0c660acc6bc5&role.id=0e00f6ebfc2843a0992b3d01f50e262d => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:43.961201 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3306eb7-a8cb-422d-8a9a-ec31c3f9c6dc None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:44.015111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 88/170] 10.222.0.76 () {58 vars in 1439 bytes} [Mon May 16 15:00:43 2022] PUT /identity/v3/projects/21716abeaba940d1bdae0c660acc6bc5/users/07b3d14137ce4f2abf1ed2ff6d0ba6f5/roles/046c7400e19f4144be943daf291f32db => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:00:44.017057 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20ede4-1068-4580-b20c-8812a5149fab None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:44.079794 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3306eb7-a8cb-422d-8a9a-ec31c3f9c6dc None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:44.123116 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b75f3-0433-4509-9dd2-5a30c0e00284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:44.123816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b75f3-0433-4509-9dd2-5a30c0e00284 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:44.124102 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b75f3-0433-4509-9dd2-5a30c0e00284 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:44.124383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b75f3-0433-4509-9dd2-5a30c0e00284 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:44.125198 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b75f3-0433-4509-9dd2-5a30c0e00284 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:44.125509 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b75f3-0433-4509-9dd2-5a30c0e00284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:44.132215 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b75f3-0433-4509-9dd2-5a30c0e00284 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:44.160024 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 83/171] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:00:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:44.176416 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b75f3-0433-4509-9dd2-5a30c0e00284 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:44.254178 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20ede4-1068-4580-b20c-8812a5149fab None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:44.335560 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1d702-ce77-4fa4-8ca0-4507105b7644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:44.336253 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1d702-ce77-4fa4-8ca0-4507105b7644 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:44.336538 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1d702-ce77-4fa4-8ca0-4507105b7644 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:44.336813 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1d702-ce77-4fa4-8ca0-4507105b7644 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:44.337591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1d702-ce77-4fa4-8ca0-4507105b7644 None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:44.337894 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1d702-ce77-4fa4-8ca0-4507105b7644 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:44.339342 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1d702-ce77-4fa4-8ca0-4507105b7644 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:44.349801 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b75f3-0433-4509-9dd2-5a30c0e00284 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:44.353695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 89/172] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:00:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:44.377238 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1d702-ce77-4fa4-8ca0-4507105b7644 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:44.403296 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f88e66-d53d-46b6-aed6-ec50f27be6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:44.404179 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f88e66-d53d-46b6-aed6-ec50f27be6de None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:44.404464 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f88e66-d53d-46b6-aed6-ec50f27be6de None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:44.404743 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f88e66-d53d-46b6-aed6-ec50f27be6de None admin] PATH_INFO: `/v3/users/f5d2bf1ef38b459e901ca8c53d1dc02e` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:44.407735 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f88e66-d53d-46b6-aed6-ec50f27be6de None admin] RBAC: Authorizing `identity:get_user(user_id=f5d2bf1ef38b459e901ca8c53d1dc02e)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:44.418348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f88e66-d53d-46b6-aed6-ec50f27be6de None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:44.418348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 84/173] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:44 2022] GET /identity/v3/users/f5d2bf1ef38b459e901ca8c53d1dc02e => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:00:44.419923 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f88e66-d53d-46b6-aed6-ec50f27be6de None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:44.576583 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1d702-ce77-4fa4-8ca0-4507105b7644 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:44.592603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f88e66-d53d-46b6-aed6-ec50f27be6de None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:44.643810 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c83ce-ba99-4f6a-9333-8b556a6e6843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:44.644476 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c83ce-ba99-4f6a-9333-8b556a6e6843 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:44.644761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c83ce-ba99-4f6a-9333-8b556a6e6843 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:44.645040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c83ce-ba99-4f6a-9333-8b556a6e6843 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:44.659380 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db348177-f98f-4ec2-a748-89c23c0a54e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:44.660278 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db348177-f98f-4ec2-a748-89c23c0a54e8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:44.660561 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db348177-f98f-4ec2-a748-89c23c0a54e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:44.660840 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db348177-f98f-4ec2-a748-89c23c0a54e8 None admin] PATH_INFO: `/v3/users/f5d2bf1ef38b459e901ca8c53d1dc02e` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:44.662088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db348177-f98f-4ec2-a748-89c23c0a54e8 None admin] RBAC: Authorizing `identity:get_user(user_id=f5d2bf1ef38b459e901ca8c53d1dc02e)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:44.663718 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db348177-f98f-4ec2-a748-89c23c0a54e8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:44.666989 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 90/174] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:44 2022] GET /identity/v3/users/f5d2bf1ef38b459e901ca8c53d1dc02e => generated 275 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:44.675224 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db348177-f98f-4ec2-a748-89c23c0a54e8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:44.733567 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c83ce-ba99-4f6a-9333-8b556a6e6843 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:44.736213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c83ce-ba99-4f6a-9333-8b556a6e6843 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:44.895683 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 85/175] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:00:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:00:44.905651 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c83ce-ba99-4f6a-9333-8b556a6e6843 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:44.909294 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db348177-f98f-4ec2-a748-89c23c0a54e8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:44.999769 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e8396-96f1-4909-bc0b-bd5fd5aab880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:45.000321 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e8396-96f1-4909-bc0b-bd5fd5aab880 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:45.000612 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e8396-96f1-4909-bc0b-bd5fd5aab880 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:45.000895 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e8396-96f1-4909-bc0b-bd5fd5aab880 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:45.043512 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c83ce-ba99-4f6a-9333-8b556a6e6843 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:45.078229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330a809-c031-405b-b9f5-b606820d3749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:45.079102 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330a809-c031-405b-b9f5-b606820d3749 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:45.079382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330a809-c031-405b-b9f5-b606820d3749 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:45.079657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330a809-c031-405b-b9f5-b606820d3749 None admin] PATH_INFO: `/v3/projects/21716abeaba940d1bdae0c660acc6bc5` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:45.080861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330a809-c031-405b-b9f5-b606820d3749 None admin] RBAC: Authorizing `identity:get_project(project_id=21716abeaba940d1bdae0c660acc6bc5)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:45.082375 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330a809-c031-405b-b9f5-b606820d3749 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:45.084400 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 86/176] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:00:44 2022] GET /identity/v3/projects/21716abeaba940d1bdae0c660acc6bc5 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:00:45.090165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330a809-c031-405b-b9f5-b606820d3749 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:45.113730 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e8396-96f1-4909-bc0b-bd5fd5aab880 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:45.115237 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e8396-96f1-4909-bc0b-bd5fd5aab880 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:45.193468 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330a809-c031-405b-b9f5-b606820d3749 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:45.228816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39870f29-2515-4c7b-8374-b6c6cba18bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:45.229476 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39870f29-2515-4c7b-8374-b6c6cba18bfe None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:45.229762 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39870f29-2515-4c7b-8374-b6c6cba18bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:45.230039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39870f29-2515-4c7b-8374-b6c6cba18bfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:45.230916 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39870f29-2515-4c7b-8374-b6c6cba18bfe None admin] RBAC: Adding query filter params (role.id=00ecc8471dbb4296b40c8b8c0b29aedd, scope.project.id=21716abeaba940d1bdae0c660acc6bc5, user.id=f5d2bf1ef38b459e901ca8c53d1dc02e) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:45.231228 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39870f29-2515-4c7b-8374-b6c6cba18bfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:45.232694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39870f29-2515-4c7b-8374-b6c6cba18bfe None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:45.239684 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 87/177] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:00:45 2022] GET /identity/v3/role_assignments?user.id=f5d2bf1ef38b459e901ca8c53d1dc02e&scope.project.id=21716abeaba940d1bdae0c660acc6bc5&role.id=00ecc8471dbb4296b40c8b8c0b29aedd => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:45.266594 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 91/178] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:00:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:00:45.271815 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39870f29-2515-4c7b-8374-b6c6cba18bfe None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:45.414425 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39870f29-2515-4c7b-8374-b6c6cba18bfe None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:45.451444 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215daf9-99c8-42c0-8b50-cda6730772cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:45.452328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215daf9-99c8-42c0-8b50-cda6730772cf None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:45.452600 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215daf9-99c8-42c0-8b50-cda6730772cf None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:45.452906 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215daf9-99c8-42c0-8b50-cda6730772cf None admin] PATH_INFO: `/v3/projects/8830a506e3894ac980ab89554499a44a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:45.454249 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215daf9-99c8-42c0-8b50-cda6730772cf None admin] RBAC: Authorizing `identity:get_project(project_id=8830a506e3894ac980ab89554499a44a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:45.455780 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215daf9-99c8-42c0-8b50-cda6730772cf None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:45.457526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 88/179] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:00:45 2022] GET /identity/v3/projects/8830a506e3894ac980ab89554499a44a => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:45.467813 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e8396-96f1-4909-bc0b-bd5fd5aab880 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:45.625702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e8396-96f1-4909-bc0b-bd5fd5aab880 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:45.668658 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f87bc7-846a-42c8-962e-8d0f7f319d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:45.669321 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f87bc7-846a-42c8-962e-8d0f7f319d40 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:45.669605 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f87bc7-846a-42c8-962e-8d0f7f319d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:45.669884 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f87bc7-846a-42c8-962e-8d0f7f319d40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:45.670759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f87bc7-846a-42c8-962e-8d0f7f319d40 None admin] RBAC: Adding query filter params (role.id=0e00f6ebfc2843a0992b3d01f50e262d, scope.project.id=8830a506e3894ac980ab89554499a44a, user.id=f5d2bf1ef38b459e901ca8c53d1dc02e) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:45.671071 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f87bc7-846a-42c8-962e-8d0f7f319d40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:45.672582 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f87bc7-846a-42c8-962e-8d0f7f319d40 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:45.683381 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 92/180] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:00:45 2022] GET /identity/v3/role_assignments?user.id=f5d2bf1ef38b459e901ca8c53d1dc02e&scope.project.id=8830a506e3894ac980ab89554499a44a&role.id=0e00f6ebfc2843a0992b3d01f50e262d => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:46.013612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595140b9-8214-4c22-bff6-ef207c6ff24b None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:46.013991 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595140b9-8214-4c22-bff6-ef207c6ff24b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:46.014193 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595140b9-8214-4c22-bff6-ef207c6ff24b None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:46.016261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 89/181] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:46.021953 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae88fc4-f5df-4fb3-86bd-84be5c52f308 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:46.022273 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae88fc4-f5df-4fb3-86bd-84be5c52f308 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:46.022554 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae88fc4-f5df-4fb3-86bd-84be5c52f308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:46.042896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9ae88fc4-f5df-4fb3-86bd-84be5c52f308 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:46.044099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9ae88fc4-f5df-4fb3-86bd-84be5c52f308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:46.079353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b69fb2-35ae-4d09-b39f-ac58ae8b0c07 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:46.079655 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b69fb2-35ae-4d09-b39f-ac58ae8b0c07 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:46.079901 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b69fb2-35ae-4d09-b39f-ac58ae8b0c07 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:46.081416 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 90/182] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:46.088075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dbe57-1aee-4db2-8773-d3d808d68278 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:46.088358 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dbe57-1aee-4db2-8773-d3d808d68278 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:46.088640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dbe57-1aee-4db2-8773-d3d808d68278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:46.111286 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-842dbe57-1aee-4db2-8773-d3d808d68278 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:46.112796 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-842dbe57-1aee-4db2-8773-d3d808d68278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:46.149864 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 93/183] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:46.177688 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae88fc4-f5df-4fb3-86bd-84be5c52f308 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:46.201523 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 91/184] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:00:46.224903 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dbe57-1aee-4db2-8773-d3d808d68278 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:46.299104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae88fc4-f5df-4fb3-86bd-84be5c52f308 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:46.332838 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b298b9-e4a3-4f19-945d-6cc647efa62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:46.333750 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b298b9-e4a3-4f19-945d-6cc647efa62f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:46.334095 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b298b9-e4a3-4f19-945d-6cc647efa62f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:46.334464 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b298b9-e4a3-4f19-945d-6cc647efa62f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:46.334901 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dbe57-1aee-4db2-8773-d3d808d68278 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:46.345824 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b298b9-e4a3-4f19-945d-6cc647efa62f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:46.354030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-45b298b9-e4a3-4f19-945d-6cc647efa62f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 15:00:46.354030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:46.354030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:46.354030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:46.354030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:46.354030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:46.354030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:46.354030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:46.354030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:46.354030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:46.354030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:46.354030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:46.354030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:46.354030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:46.354030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:46.354030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:46.354948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:46.354948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:46.354948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:46.354948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:46.354948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:46.354948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:46.354948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:46.354948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:46.354948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:46.354948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:46.354948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:46.354948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:00:46.354948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:46.354948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:46.354948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:46.354948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:46.356030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:46.356030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:46.356030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:46.356030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:46.356030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:46.356030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:46.356030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:46.356030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:46.356030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:46.356030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:46.356030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 15:00:46.356030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:00:46.356030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 94/185] 10.222.0.76 () {56 vars in 1114 bytes} [Mon May 16 15:00:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:00:46.361634 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b298b9-e4a3-4f19-945d-6cc647efa62f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:46.373815 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162718e6-de5c-494d-9b1d-a012d024c39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:46.374976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162718e6-de5c-494d-9b1d-a012d024c39f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:46.375432 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162718e6-de5c-494d-9b1d-a012d024c39f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:46.375885 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162718e6-de5c-494d-9b1d-a012d024c39f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:46.387031 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162718e6-de5c-494d-9b1d-a012d024c39f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:46.395003 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-162718e6-de5c-494d-9b1d-a012d024c39f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:00:46.395003 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:46.395003 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:46.395003 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:46.395003 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:46.395003 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:46.395003 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:46.395003 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:46.395003 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:46.395003 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:46.395003 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:46.395003 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:46.395003 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:46.395003 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:46.395003 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:46.395003 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:46.395890 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:46.395890 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:46.395890 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:46.395890 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:46.395890 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:46.395890 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:46.395890 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:46.395890 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:46.395890 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:46.395890 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:46.395890 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:46.395890 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:00:46.395890 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:46.395890 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:46.395890 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:46.395890 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:46.396696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:46.396696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:46.396696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:46.396696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:46.396696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:46.396696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:46.396696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:46.396696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:46.396696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:46.396696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:46.396696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:00:46.396696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:00:46.399055 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 92/186] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:00:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:00:46.407953 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162718e6-de5c-494d-9b1d-a012d024c39f None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:46.464361 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b298b9-e4a3-4f19-945d-6cc647efa62f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:46.498013 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdf71f-5f6c-4762-b491-d44d94800b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:46.498724 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdf71f-5f6c-4762-b491-d44d94800b76 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:46.499007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdf71f-5f6c-4762-b491-d44d94800b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:46.499281 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdf71f-5f6c-4762-b491-d44d94800b76 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:46.500739 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdf71f-5f6c-4762-b491-d44d94800b76 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:46.500907 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdf71f-5f6c-4762-b491-d44d94800b76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:46.502301 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdf71f-5f6c-4762-b491-d44d94800b76 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:46.510681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 95/187] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:00:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:46.515878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a19325-b12e-40ab-9aae-fa69a33cda19 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:46.515878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a19325-b12e-40ab-9aae-fa69a33cda19 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:46.515878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a19325-b12e-40ab-9aae-fa69a33cda19 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:46.515878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 96/188] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:46.519025 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a19325-b12e-40ab-9aae-fa69a33cda19 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:46.519417 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162718e6-de5c-494d-9b1d-a012d024c39f None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:46.553327 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16339e-e2ff-4d36-bdae-df17638d95ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:46.553926 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16339e-e2ff-4d36-bdae-df17638d95ee None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:46.554247 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16339e-e2ff-4d36-bdae-df17638d95ee None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:46.554524 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16339e-e2ff-4d36-bdae-df17638d95ee None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:46.555271 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16339e-e2ff-4d36-bdae-df17638d95ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:46.555574 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16339e-e2ff-4d36-bdae-df17638d95ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:46.557009 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16339e-e2ff-4d36-bdae-df17638d95ee None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:46.570558 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 93/189] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:00:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:46.571897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945b7d6-dfce-407a-9387-a7a83fcfcad6 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:46.572185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945b7d6-dfce-407a-9387-a7a83fcfcad6 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:46.572461 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945b7d6-dfce-407a-9387-a7a83fcfcad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:46.589294 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-e945b7d6-dfce-407a-9387-a7a83fcfcad6 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:46.590514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e945b7d6-dfce-407a-9387-a7a83fcfcad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:46.625787 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a19325-b12e-40ab-9aae-fa69a33cda19 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:46.655878 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 94/190] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:46.656968 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945b7d6-dfce-407a-9387-a7a83fcfcad6 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:46.660694 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456c4d1-0345-44b9-a868-b8448a303d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:46.661565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456c4d1-0345-44b9-a868-b8448a303d95 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:46.661847 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456c4d1-0345-44b9-a868-b8448a303d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:46.662119 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456c4d1-0345-44b9-a868-b8448a303d95 None admin] PATH_INFO: `/v3/users/85f373368554415abdbcb3cfa20d5ced` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:46.676265 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456c4d1-0345-44b9-a868-b8448a303d95 None admin] RBAC: Authorizing `identity:get_user(user_id=85f373368554415abdbcb3cfa20d5ced)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:46.677876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456c4d1-0345-44b9-a868-b8448a303d95 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:46.682167 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 97/191] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:46 2022] GET /identity/v3/users/85f373368554415abdbcb3cfa20d5ced => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:46.682167 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456c4d1-0345-44b9-a868-b8448a303d95 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:46.765971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945b7d6-dfce-407a-9387-a7a83fcfcad6 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:46.781989 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456c4d1-0345-44b9-a868-b8448a303d95 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:46.804676 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61690ae-89fc-417d-9627-62620dea98d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:46.805478 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61690ae-89fc-417d-9627-62620dea98d4 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:46.805752 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61690ae-89fc-417d-9627-62620dea98d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:46.806019 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61690ae-89fc-417d-9627-62620dea98d4 None admin] PATH_INFO: `/v3/users/85f373368554415abdbcb3cfa20d5ced` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:46.807286 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61690ae-89fc-417d-9627-62620dea98d4 None admin] RBAC: Authorizing `identity:get_user(user_id=85f373368554415abdbcb3cfa20d5ced)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:46.808787 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61690ae-89fc-417d-9627-62620dea98d4 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:46.810498 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 95/192] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:46 2022] GET /identity/v3/users/85f373368554415abdbcb3cfa20d5ced => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:46.816404 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61690ae-89fc-417d-9627-62620dea98d4 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:46.820408 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93915cf3-44b4-4047-8cf0-02d2cb7d29c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:46.820651 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93915cf3-44b4-4047-8cf0-02d2cb7d29c3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:46.820918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93915cf3-44b4-4047-8cf0-02d2cb7d29c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:46.821202 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93915cf3-44b4-4047-8cf0-02d2cb7d29c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:46.822406 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93915cf3-44b4-4047-8cf0-02d2cb7d29c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:46.823864 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93915cf3-44b4-4047-8cf0-02d2cb7d29c3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:46.825630 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 98/193] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:00:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:46.826352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93915cf3-44b4-4047-8cf0-02d2cb7d29c3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:46.916793 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61690ae-89fc-417d-9627-62620dea98d4 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:46.928195 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93915cf3-44b4-4047-8cf0-02d2cb7d29c3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:46.951505 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84216282-8d26-4603-a85a-6c6e1b0d545e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:46.952441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84216282-8d26-4603-a85a-6c6e1b0d545e None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:46.953419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84216282-8d26-4603-a85a-6c6e1b0d545e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:46.953830 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84216282-8d26-4603-a85a-6c6e1b0d545e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:46.962770 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6403e03-3a09-46bb-9c17-ff360e47b7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:46.963424 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6403e03-3a09-46bb-9c17-ff360e47b7bf None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:46.963706 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6403e03-3a09-46bb-9c17-ff360e47b7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:46.963978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6403e03-3a09-46bb-9c17-ff360e47b7bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:47.019042 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84216282-8d26-4603-a85a-6c6e1b0d545e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:47.020498 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84216282-8d26-4603-a85a-6c6e1b0d545e None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:47.029801 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6403e03-3a09-46bb-9c17-ff360e47b7bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:47.031310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6403e03-3a09-46bb-9c17-ff360e47b7bf None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:47.112150 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 96/194] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:00:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:00:47.112785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84216282-8d26-4603-a85a-6c6e1b0d545e None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:47.123986 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 99/195] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:00:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:00:47.125860 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41b00b-d84a-49cf-b2e8-c33e4694676e None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:47.126171 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41b00b-d84a-49cf-b2e8-c33e4694676e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:47.126453 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41b00b-d84a-49cf-b2e8-c33e4694676e None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:47.127851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 100/196] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:47.130920 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41b00b-d84a-49cf-b2e8-c33e4694676e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:47.208718 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84216282-8d26-4603-a85a-6c6e1b0d545e None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:47.225799 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41b00b-d84a-49cf-b2e8-c33e4694676e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:47.241049 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa9af3-b760-44c6-a787-3e2dc3cad9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:47.241725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa9af3-b760-44c6-a787-3e2dc3cad9bc None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:47.242006 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa9af3-b760-44c6-a787-3e2dc3cad9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:47.242327 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa9af3-b760-44c6-a787-3e2dc3cad9bc None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:47.243025 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa9af3-b760-44c6-a787-3e2dc3cad9bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:47.244483 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa9af3-b760-44c6-a787-3e2dc3cad9bc None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:47.258055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7c8e6-1554-425a-853d-255aacd5e1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:47.258923 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7c8e6-1554-425a-853d-255aacd5e1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:47.259212 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7c8e6-1554-425a-853d-255aacd5e1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:47.259485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7c8e6-1554-425a-853d-255aacd5e1d6 None admin] PATH_INFO: `/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:47.260648 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7c8e6-1554-425a-853d-255aacd5e1d6 None admin] RBAC: Authorizing `identity:get_project(project_id=6ff53efad5ea4244a2a900acf4ee3f21)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:47.262077 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7c8e6-1554-425a-853d-255aacd5e1d6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:47.263792 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 101/197] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:00:47 2022] GET /identity/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21 => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:47.264544 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7c8e6-1554-425a-853d-255aacd5e1d6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:47.331816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 97/198] 10.222.0.76 () {60 vars in 1132 bytes} [Mon May 16 15:00:47 2022] POST /identity/v3/users => generated 297 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:00:47.333484 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c34e70-cdb7-493a-ab9f-1192ca9b9f46 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:47.334019 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c34e70-cdb7-493a-ab9f-1192ca9b9f46 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:47.334461 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c34e70-cdb7-493a-ab9f-1192ca9b9f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:47.352761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-32c34e70-cdb7-493a-ab9f-1192ca9b9f46 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:47.354080 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-32c34e70-cdb7-493a-ab9f-1192ca9b9f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:47.376442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7c8e6-1554-425a-853d-255aacd5e1d6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:47.415240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fbd22-b431-4770-9ee2-b412b7dacfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:47.416121 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fbd22-b431-4770-9ee2-b412b7dacfb0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:47.416399 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fbd22-b431-4770-9ee2-b412b7dacfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:47.416675 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fbd22-b431-4770-9ee2-b412b7dacfb0 None admin] PATH_INFO: `/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:47.417988 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94fbd22-b431-4770-9ee2-b412b7dacfb0 None admin] RBAC: Authorizing `identity:get_project(project_id=6ff53efad5ea4244a2a900acf4ee3f21)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:47.419571 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94fbd22-b431-4770-9ee2-b412b7dacfb0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:47.421474 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 102/199] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:00:47 2022] GET /identity/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:47.422719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fbd22-b431-4770-9ee2-b412b7dacfb0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:47.433730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 98/200] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:47.443045 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c34e70-cdb7-493a-ab9f-1192ca9b9f46 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:47.536058 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fbd22-b431-4770-9ee2-b412b7dacfb0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:47.553256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c34e70-cdb7-493a-ab9f-1192ca9b9f46 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:47.581404 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74df01c-309c-4aa5-9a0e-223c19e348bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:47.582102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74df01c-309c-4aa5-9a0e-223c19e348bf None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:47.582436 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74df01c-309c-4aa5-9a0e-223c19e348bf None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:47.582709 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74df01c-309c-4aa5-9a0e-223c19e348bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:47.583567 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74df01c-309c-4aa5-9a0e-223c19e348bf None admin] RBAC: Adding query filter params (role.id=00ecc8471dbb4296b40c8b8c0b29aedd, scope.project.id=6ff53efad5ea4244a2a900acf4ee3f21, user.id=85f373368554415abdbcb3cfa20d5ced) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:47.583880 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74df01c-309c-4aa5-9a0e-223c19e348bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:47.585356 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74df01c-309c-4aa5-9a0e-223c19e348bf None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:47.591985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 103/201] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:00:47 2022] GET /identity/v3/role_assignments?user.id=85f373368554415abdbcb3cfa20d5ced&scope.project.id=6ff53efad5ea4244a2a900acf4ee3f21&role.id=00ecc8471dbb4296b40c8b8c0b29aedd => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:47.592800 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74df01c-309c-4aa5-9a0e-223c19e348bf None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:47.602816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8834a-0005-4a34-95a8-fc15c5b50b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:47.603563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8834a-0005-4a34-95a8-fc15c5b50b94 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:47.603852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8834a-0005-4a34-95a8-fc15c5b50b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:47.604133 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8834a-0005-4a34-95a8-fc15c5b50b94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:47.605176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8834a-0005-4a34-95a8-fc15c5b50b94 None admin] RBAC: Adding query filter params (role.id=f6c8fc0dc0f24de3907b0960a1201901, scope.project.id=6ff53efad5ea4244a2a900acf4ee3f21, user.id=85f373368554415abdbcb3cfa20d5ced) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:47.605492 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8834a-0005-4a34-95a8-fc15c5b50b94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:47.608069 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8834a-0005-4a34-95a8-fc15c5b50b94 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:47.615496 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 99/202] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:00:47 2022] GET /identity/v3/role_assignments?user.id=85f373368554415abdbcb3cfa20d5ced&scope.project.id=6ff53efad5ea4244a2a900acf4ee3f21&role.id=f6c8fc0dc0f24de3907b0960a1201901 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:47.731671 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74df01c-309c-4aa5-9a0e-223c19e348bf None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:47.774393 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe800d-e19a-4205-9d19-cfd64f11894c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:47.775224 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe800d-e19a-4205-9d19-cfd64f11894c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:47.775513 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe800d-e19a-4205-9d19-cfd64f11894c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:47.775792 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe800d-e19a-4205-9d19-cfd64f11894c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:47.795447 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe800d-e19a-4205-9d19-cfd64f11894c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:47.803790 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-4afe800d-e19a-4205-9d19-cfd64f11894c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 15:00:47.803790 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:47.803790 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:47.803790 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:47.803790 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:47.803790 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:47.803790 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:47.803790 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:47.803790 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:47.803790 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:47.803790 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:47.803790 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:47.803790 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:47.803790 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:47.803790 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:47.803790 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:47.804751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:47.804751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:47.804751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:47.804751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:47.804751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:47.804751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:47.804751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:47.804751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:47.804751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:47.804751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:47.804751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:47.804751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:00:47.804751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:47.804751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:47.804751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:47.804751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:47.805974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:47.805974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:47.805974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:47.805974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:47.805974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:47.805974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:47.805974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:47.805974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:47.805974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:47.805974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:47.805974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 15:00:47.805974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:00:47.805974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 104/203] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:00:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:00:47.811147 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8834a-0005-4a34-95a8-fc15c5b50b94 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:47.920421 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8834a-0005-4a34-95a8-fc15c5b50b94 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:47.961239 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4d946-1ec4-4672-8ea4-117c604a439f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:47.961973 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4d946-1ec4-4672-8ea4-117c604a439f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:47.962288 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4d946-1ec4-4672-8ea4-117c604a439f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:47.962568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4d946-1ec4-4672-8ea4-117c604a439f None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:47.963338 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4d946-1ec4-4672-8ea4-117c604a439f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:47.963644 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4d946-1ec4-4672-8ea4-117c604a439f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:47.965025 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4d946-1ec4-4672-8ea4-117c604a439f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:47.974076 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 100/204] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:00:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:47.979314 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe800d-e19a-4205-9d19-cfd64f11894c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:48.113834 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe800d-e19a-4205-9d19-cfd64f11894c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:48.153866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708725e8-bffb-45d4-8e56-bc9388274144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:48.154832 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708725e8-bffb-45d4-8e56-bc9388274144 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:48.155112 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708725e8-bffb-45d4-8e56-bc9388274144 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:48.155388 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708725e8-bffb-45d4-8e56-bc9388274144 None admin] PATH_INFO: `/v3/users/07b3d14137ce4f2abf1ed2ff6d0ba6f5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:48.156750 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708725e8-bffb-45d4-8e56-bc9388274144 None admin] RBAC: Authorizing `identity:get_user(user_id=07b3d14137ce4f2abf1ed2ff6d0ba6f5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:48.162355 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708725e8-bffb-45d4-8e56-bc9388274144 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:48.164352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 105/205] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:47 2022] GET /identity/v3/users/07b3d14137ce4f2abf1ed2ff6d0ba6f5 => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:48.171772 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4d946-1ec4-4672-8ea4-117c604a439f None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:48.335763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4d946-1ec4-4672-8ea4-117c604a439f None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:48.382958 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23d0b1-9a6e-4bf5-bb46-da6b2b971d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:48.383953 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23d0b1-9a6e-4bf5-bb46-da6b2b971d7e None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:48.384436 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23d0b1-9a6e-4bf5-bb46-da6b2b971d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:48.384905 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23d0b1-9a6e-4bf5-bb46-da6b2b971d7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:48.475208 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23d0b1-9a6e-4bf5-bb46-da6b2b971d7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:48.477034 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23d0b1-9a6e-4bf5-bb46-da6b2b971d7e None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:48.589698 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 101/206] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:00:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:00:48.596296 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708725e8-bffb-45d4-8e56-bc9388274144 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:48.716491 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708725e8-bffb-45d4-8e56-bc9388274144 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:48.757567 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e7ff9-abad-477d-835a-8c407403e5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:48.759300 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e7ff9-abad-477d-835a-8c407403e5ee None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:48.759763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e7ff9-abad-477d-835a-8c407403e5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:48.760179 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e7ff9-abad-477d-835a-8c407403e5ee None admin] PATH_INFO: `/v3/projects/21716abeaba940d1bdae0c660acc6bc5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:48.761507 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e7ff9-abad-477d-835a-8c407403e5ee None admin] RBAC: Authorizing `identity:get_project(project_id=21716abeaba940d1bdae0c660acc6bc5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:48.763114 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e7ff9-abad-477d-835a-8c407403e5ee None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:48.765770 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 106/207] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:00:48 2022] GET /identity/v3/projects/21716abeaba940d1bdae0c660acc6bc5 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:48.775224 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23d0b1-9a6e-4bf5-bb46-da6b2b971d7e None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:48.934887 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23d0b1-9a6e-4bf5-bb46-da6b2b971d7e None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:48.983507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3444ab-29e3-4e5d-93e3-e52d100a8c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:48.984097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3444ab-29e3-4e5d-93e3-e52d100a8c4f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:48.984382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3444ab-29e3-4e5d-93e3-e52d100a8c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:48.984662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3444ab-29e3-4e5d-93e3-e52d100a8c4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:48.985514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3444ab-29e3-4e5d-93e3-e52d100a8c4f None admin] RBAC: Adding query filter params (role.id=046c7400e19f4144be943daf291f32db, scope.project.id=21716abeaba940d1bdae0c660acc6bc5, user.id=07b3d14137ce4f2abf1ed2ff6d0ba6f5) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:48.985823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3444ab-29e3-4e5d-93e3-e52d100a8c4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:48.987360 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3444ab-29e3-4e5d-93e3-e52d100a8c4f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:48.995074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 102/208] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:00:48 2022] GET /identity/v3/role_assignments?user.id=07b3d14137ce4f2abf1ed2ff6d0ba6f5&scope.project.id=21716abeaba940d1bdae0c660acc6bc5&role.id=046c7400e19f4144be943daf291f32db => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:50.078084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701b462-b4a3-43d5-8c70-b69c30cdc02c None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:50.078868 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701b462-b4a3-43d5-8c70-b69c30cdc02c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:50.078868 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701b462-b4a3-43d5-8c70-b69c30cdc02c None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:50.080138 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 107/209] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:50.086535 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cad050-0f61-4ed2-9696-83e3ee2daf95 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:50.087494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cad050-0f61-4ed2-9696-83e3ee2daf95 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:50.087990 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cad050-0f61-4ed2-9696-83e3ee2daf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:50.106649 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-f9cad050-0f61-4ed2-9696-83e3ee2daf95 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:50.108147 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f9cad050-0f61-4ed2-9696-83e3ee2daf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:50.175721 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 103/210] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:50.192712 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3cbeb-67fe-4804-b604-32880151ee1b None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:50.193250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3cbeb-67fe-4804-b604-32880151ee1b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:50.193741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3cbeb-67fe-4804-b604-32880151ee1b None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:50.195316 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 108/211] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:50.200689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681d566-1da6-4849-a774-5a694d8b2089 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:50.200976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681d566-1da6-4849-a774-5a694d8b2089 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:50.201251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681d566-1da6-4849-a774-5a694d8b2089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:50.209962 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3cbeb-67fe-4804-b604-32880151ee1b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:50.220594 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-7681d566-1da6-4849-a774-5a694d8b2089 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:50.221783 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7681d566-1da6-4849-a774-5a694d8b2089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:50.293032 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 104/212] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:50.294375 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a34a6-a43e-4f81-a693-6df2789b9731 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:50.294662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a34a6-a43e-4f81-a693-6df2789b9731 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:50.294933 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a34a6-a43e-4f81-a693-6df2789b9731 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:50.296472 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 105/213] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:50.297529 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc5788-3bda-4e98-8063-01a865ecaf1a None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:50.297803 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc5788-3bda-4e98-8063-01a865ecaf1a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:50.298073 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc5788-3bda-4e98-8063-01a865ecaf1a None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:50.299425 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 106/214] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:50.303522 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40150e08-b064-4c8c-ab52-afcd8e990556 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:50.303808 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40150e08-b064-4c8c-ab52-afcd8e990556 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:50.304088 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40150e08-b064-4c8c-ab52-afcd8e990556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:50.321416 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-40150e08-b064-4c8c-ab52-afcd8e990556 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:50.322629 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-40150e08-b064-4c8c-ab52-afcd8e990556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:50.323178 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3cbeb-67fe-4804-b604-32880151ee1b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:50.356166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43953b96-5049-4016-af3c-8e53a03b761b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:50.356885 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43953b96-5049-4016-af3c-8e53a03b761b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:50.357163 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43953b96-5049-4016-af3c-8e53a03b761b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:50.357436 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43953b96-5049-4016-af3c-8e53a03b761b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:50.359158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43953b96-5049-4016-af3c-8e53a03b761b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:50.360600 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43953b96-5049-4016-af3c-8e53a03b761b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:50.362238 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 109/215] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:00:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:50.364131 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d18e15-c34c-4ae5-bff5-0a1efda79ca6 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:50.364476 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d18e15-c34c-4ae5-bff5-0a1efda79ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:50.364761 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d18e15-c34c-4ae5-bff5-0a1efda79ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:50.380770 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-d5d18e15-c34c-4ae5-bff5-0a1efda79ca6 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:50.381927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d5d18e15-c34c-4ae5-bff5-0a1efda79ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:50.387403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 107/216] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:50.388244 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40150e08-b064-4c8c-ab52-afcd8e990556 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:50.447304 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 110/217] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:50.448148 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d18e15-c34c-4ae5-bff5-0a1efda79ca6 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:50.486585 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40150e08-b064-4c8c-ab52-afcd8e990556 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:50.519354 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97306e-06ad-405f-a965-e34c99e3fadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:50.520140 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97306e-06ad-405f-a965-e34c99e3fadc None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:50.520419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97306e-06ad-405f-a965-e34c99e3fadc None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:50.520700 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97306e-06ad-405f-a965-e34c99e3fadc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:50.530408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97306e-06ad-405f-a965-e34c99e3fadc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:50.537943 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-fe97306e-06ad-405f-a965-e34c99e3fadc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 15:00:50.537943 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:50.537943 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:50.537943 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:50.537943 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:50.537943 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:50.537943 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:50.537943 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:50.537943 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:50.537943 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:50.537943 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:50.537943 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:50.537943 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:50.537943 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:50.537943 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:50.537943 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:50.538884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:50.538884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:50.538884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:50.538884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:50.538884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:50.538884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:50.538884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:50.538884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:50.538884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:50.538884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:50.538884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:50.538884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:00:50.538884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:50.538884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:50.538884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:50.538884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:50.544694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:50.544694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:50.544694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:50.544694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:50.544694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:50.544694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:50.544694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:50.544694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:50.544694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:50.544694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:50.544694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 15:00:50.544694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:00:50.544694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 108/218] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:00:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:00:50.544694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97306e-06ad-405f-a965-e34c99e3fadc None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:50.545440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d18e15-c34c-4ae5-bff5-0a1efda79ca6 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:50.577724 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ecfb6-19cb-4403-8cc1-cdaf1bd2ce46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:50.578432 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ecfb6-19cb-4403-8cc1-cdaf1bd2ce46 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:50.578716 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ecfb6-19cb-4403-8cc1-cdaf1bd2ce46 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:50.578991 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ecfb6-19cb-4403-8cc1-cdaf1bd2ce46 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:50.579696 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ecfb6-19cb-4403-8cc1-cdaf1bd2ce46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:50.581157 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ecfb6-19cb-4403-8cc1-cdaf1bd2ce46 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:50.638507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97306e-06ad-405f-a965-e34c99e3fadc None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:50.670300 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edb4d0-b1c0-4114-b9fd-2e29d6c8cb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:50.671627 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edb4d0-b1c0-4114-b9fd-2e29d6c8cb95 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:50.671908 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edb4d0-b1c0-4114-b9fd-2e29d6c8cb95 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:50.672183 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edb4d0-b1c0-4114-b9fd-2e29d6c8cb95 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:50.676182 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 111/219] 10.222.0.76 () {60 vars in 1132 bytes} [Mon May 16 15:00:50 2022] POST /identity/v3/users => generated 297 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:00:50.677018 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ecfb6-19cb-4403-8cc1-cdaf1bd2ce46 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:50.690450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edb4d0-b1c0-4114-b9fd-2e29d6c8cb95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:50.698779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-c6edb4d0-b1c0-4114-b9fd-2e29d6c8cb95 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 15:00:50.698779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:50.698779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:50.698779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:50.698779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:50.698779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:50.698779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:50.698779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:50.698779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:50.698779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:50.698779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:50.698779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:50.698779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:50.698779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:50.698779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:50.698779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:50.699797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:50.699797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:50.699797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:50.699797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:50.699797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:50.699797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:50.699797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:50.699797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:50.699797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:50.699797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:50.699797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:50.699797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:00:50.699797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:50.699797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:50.699797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:50.699797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:50.700608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:50.700608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:50.700608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:50.700608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:50.700608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:50.700608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:50.700608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:50.700608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:50.700608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:50.700608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:50.700608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 15:00:50.700608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:00:50.700608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 109/220] 10.222.0.76 () {56 vars in 1114 bytes} [Mon May 16 15:00:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:00:50.701271 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edb4d0-b1c0-4114-b9fd-2e29d6c8cb95 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:50.791575 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ecfb6-19cb-4403-8cc1-cdaf1bd2ce46 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:50.808890 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edb4d0-b1c0-4114-b9fd-2e29d6c8cb95 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:50.827231 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22df68-002d-494b-95cb-5c453ce670c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:50.828042 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22df68-002d-494b-95cb-5c453ce670c3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:50.828322 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22df68-002d-494b-95cb-5c453ce670c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:50.828595 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22df68-002d-494b-95cb-5c453ce670c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:50.839839 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22df68-002d-494b-95cb-5c453ce670c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:50.842630 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ead865-a59a-496e-a880-43eb241295ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:50.843841 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ead865-a59a-496e-a880-43eb241295ff None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:50.844123 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ead865-a59a-496e-a880-43eb241295ff None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:50.844398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ead865-a59a-496e-a880-43eb241295ff None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:50.845160 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ead865-a59a-496e-a880-43eb241295ff None admin] RBAC: Adding query filter params (name=member) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:50.845468 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ead865-a59a-496e-a880-43eb241295ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:50.846986 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ead865-a59a-496e-a880-43eb241295ff None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:50.848115 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-be22df68-002d-494b-95cb-5c453ce670c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:00:50.848115 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:50.848115 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:50.848115 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:50.848115 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:50.848115 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:50.848115 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:50.848115 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:50.848115 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:50.848115 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:50.848115 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:50.848115 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:50.848115 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:50.848115 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:50.848115 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:50.848115 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:50.848948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:50.848948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:50.848948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:50.848948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:50.848948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:50.848948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:50.848948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:50.848948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:50.848948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:50.848948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:50.848948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:50.848948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:00:50.848948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:50.848948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:50.848948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:50.848948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:50.849755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:50.849755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:50.849755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:50.849755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:50.849755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:50.849755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:50.849755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:50.849755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:50.849755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:50.849755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:50.849755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:00:50.849755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:00:50.849755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 112/221] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:00:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:00:50.851456 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22df68-002d-494b-95cb-5c453ce670c3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:50.864866 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 110/222] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:00:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:50.865727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ead865-a59a-496e-a880-43eb241295ff None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:50.969123 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ead865-a59a-496e-a880-43eb241295ff None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:50.984833 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22df68-002d-494b-95cb-5c453ce670c3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:51.004891 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e2dd0-941c-463a-a12c-89bf9ba62907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:51.005680 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e2dd0-941c-463a-a12c-89bf9ba62907 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:51.005973 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e2dd0-941c-463a-a12c-89bf9ba62907 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:51.006399 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e2dd0-941c-463a-a12c-89bf9ba62907 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:51.007162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e2dd0-941c-463a-a12c-89bf9ba62907 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:51.007728 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e2dd0-941c-463a-a12c-89bf9ba62907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:51.009125 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e2dd0-941c-463a-a12c-89bf9ba62907 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:51.018082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 111/223] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:00:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:51.022330 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e2dd0-941c-463a-a12c-89bf9ba62907 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:51.029652 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a8a94-9ad2-4120-bb52-cc3c22a2aa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:51.031117 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a8a94-9ad2-4120-bb52-cc3c22a2aa8d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:51.031398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a8a94-9ad2-4120-bb52-cc3c22a2aa8d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:51.031668 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a8a94-9ad2-4120-bb52-cc3c22a2aa8d None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:51.032660 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a8a94-9ad2-4120-bb52-cc3c22a2aa8d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:51.032763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a8a94-9ad2-4120-bb52-cc3c22a2aa8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:51.034137 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a8a94-9ad2-4120-bb52-cc3c22a2aa8d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:51.042835 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 113/224] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:00:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:51.043617 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a8a94-9ad2-4120-bb52-cc3c22a2aa8d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:51.118533 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e2dd0-941c-463a-a12c-89bf9ba62907 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:51.148395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a8a94-9ad2-4120-bb52-cc3c22a2aa8d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:51.152388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f51bb-866e-4700-a1f3-89891961fb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:51.153261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f51bb-866e-4700-a1f3-89891961fb9a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:51.153540 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f51bb-866e-4700-a1f3-89891961fb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:51.153814 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f51bb-866e-4700-a1f3-89891961fb9a None admin] PATH_INFO: `/v3/users/f281a3becb2340708a575d806afabd26` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:51.167476 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f51bb-866e-4700-a1f3-89891961fb9a None admin] RBAC: Authorizing `identity:get_user(user_id=f281a3becb2340708a575d806afabd26)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:51.168953 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f51bb-866e-4700-a1f3-89891961fb9a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:51.170724 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 112/225] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:51 2022] GET /identity/v3/users/f281a3becb2340708a575d806afabd26 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:51.172094 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f51bb-866e-4700-a1f3-89891961fb9a None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:51.184244 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b054cf1-f698-469c-bffd-d9c70e26950f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:51.185129 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b054cf1-f698-469c-bffd-d9c70e26950f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:51.185410 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b054cf1-f698-469c-bffd-d9c70e26950f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:51.185688 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b054cf1-f698-469c-bffd-d9c70e26950f None admin] PATH_INFO: `/v3/users/85f373368554415abdbcb3cfa20d5ced` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:51.187486 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b054cf1-f698-469c-bffd-d9c70e26950f None admin] RBAC: Authorizing `identity:get_user(user_id=85f373368554415abdbcb3cfa20d5ced)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:51.189061 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b054cf1-f698-469c-bffd-d9c70e26950f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:51.190955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 114/226] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:51 2022] GET /identity/v3/users/85f373368554415abdbcb3cfa20d5ced => generated 283 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:51.191597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b054cf1-f698-469c-bffd-d9c70e26950f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:51.271490 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f51bb-866e-4700-a1f3-89891961fb9a None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:51.296323 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b054cf1-f698-469c-bffd-d9c70e26950f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:51.305578 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b8d2e-f392-4bc4-975b-34461fd19a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:51.306488 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b8d2e-f392-4bc4-975b-34461fd19a60 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:51.306939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b8d2e-f392-4bc4-975b-34461fd19a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:51.307213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b8d2e-f392-4bc4-975b-34461fd19a60 None admin] PATH_INFO: `/v3/users/85f373368554415abdbcb3cfa20d5ced` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:51.308414 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b8d2e-f392-4bc4-975b-34461fd19a60 None admin] RBAC: Authorizing `identity:get_user(user_id=85f373368554415abdbcb3cfa20d5ced)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:51.309873 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b8d2e-f392-4bc4-975b-34461fd19a60 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:51.311727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 113/227] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:51 2022] GET /identity/v3/users/85f373368554415abdbcb3cfa20d5ced => generated 283 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:51.312400 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b8d2e-f392-4bc4-975b-34461fd19a60 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:51.340442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ddcec-d296-41c3-8c90-ab65c38fc3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:51.341495 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ddcec-d296-41c3-8c90-ab65c38fc3ba None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:51.341980 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ddcec-d296-41c3-8c90-ab65c38fc3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:51.342517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ddcec-d296-41c3-8c90-ab65c38fc3ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:51.412156 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b8d2e-f392-4bc4-975b-34461fd19a60 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:51.414577 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ddcec-d296-41c3-8c90-ab65c38fc3ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:51.416367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ddcec-d296-41c3-8c90-ab65c38fc3ba None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:51.446922 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71720935-b1c4-457a-b413-51f632525bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:51.447948 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71720935-b1c4-457a-b413-51f632525bad None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:51.448128 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71720935-b1c4-457a-b413-51f632525bad None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:51.448347 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71720935-b1c4-457a-b413-51f632525bad None admin] PATH_INFO: `/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:51.449506 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71720935-b1c4-457a-b413-51f632525bad None admin] RBAC: Authorizing `identity:get_project(project_id=6ff53efad5ea4244a2a900acf4ee3f21)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:51.451025 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71720935-b1c4-457a-b413-51f632525bad None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:51.453246 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 114/228] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:00:51 2022] GET /identity/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:51.454040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71720935-b1c4-457a-b413-51f632525bad None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:51.524027 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 115/229] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:00:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:00:51.525254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ddcec-d296-41c3-8c90-ab65c38fc3ba None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:51.555791 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71720935-b1c4-457a-b413-51f632525bad None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:51.589585 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de278022-cab4-4e79-a233-be24f1f37253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:51.590495 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de278022-cab4-4e79-a233-be24f1f37253 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:51.590773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de278022-cab4-4e79-a233-be24f1f37253 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:51.591043 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de278022-cab4-4e79-a233-be24f1f37253 None admin] PATH_INFO: `/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:51.592278 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de278022-cab4-4e79-a233-be24f1f37253 None admin] RBAC: Authorizing `identity:get_project(project_id=6ff53efad5ea4244a2a900acf4ee3f21)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:51.594272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de278022-cab4-4e79-a233-be24f1f37253 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:51.600868 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 115/230] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:00:51 2022] GET /identity/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:51.600868 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de278022-cab4-4e79-a233-be24f1f37253 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:51.640333 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ddcec-d296-41c3-8c90-ab65c38fc3ba None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:51.676338 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01237d5a-5ea4-4786-a28a-d1e3b8059824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:51.677639 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01237d5a-5ea4-4786-a28a-d1e3b8059824 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:51.678171 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01237d5a-5ea4-4786-a28a-d1e3b8059824 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:51.678648 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01237d5a-5ea4-4786-a28a-d1e3b8059824 None admin] PATH_INFO: `/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21/users/85f373368554415abdbcb3cfa20d5ced/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:51.681042 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01237d5a-5ea4-4786-a28a-d1e3b8059824 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ff53efad5ea4244a2a900acf4ee3f21, user_id=85f373368554415abdbcb3cfa20d5ced, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:51.682759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01237d5a-5ea4-4786-a28a-d1e3b8059824 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:51.697135 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de278022-cab4-4e79-a233-be24f1f37253 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:51.731257 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bce086-f5b1-46b6-87e5-4a1272f2a51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:51.732107 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bce086-f5b1-46b6-87e5-4a1272f2a51c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:51.732432 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bce086-f5b1-46b6-87e5-4a1272f2a51c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:51.732710 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bce086-f5b1-46b6-87e5-4a1272f2a51c None admin] PATH_INFO: `/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:51.734502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bce086-f5b1-46b6-87e5-4a1272f2a51c None admin] RBAC: Authorizing `identity:get_project(project_id=6ff53efad5ea4244a2a900acf4ee3f21)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:51.735948 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bce086-f5b1-46b6-87e5-4a1272f2a51c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:51.737827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 116/231] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:00:51 2022] GET /identity/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:51.738523 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bce086-f5b1-46b6-87e5-4a1272f2a51c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:51.758841 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 116/232] 10.222.0.76 () {58 vars in 1439 bytes} [Mon May 16 15:00:51 2022] PUT /identity/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21/users/85f373368554415abdbcb3cfa20d5ced/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:00:51.760470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01237d5a-5ea4-4786-a28a-d1e3b8059824 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:51.909854 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bce086-f5b1-46b6-87e5-4a1272f2a51c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:51.950180 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01237d5a-5ea4-4786-a28a-d1e3b8059824 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:51.952513 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05ff5f-aba8-4cc8-a7ee-8eab869cc28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:51.953709 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05ff5f-aba8-4cc8-a7ee-8eab869cc28e None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:51.954266 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05ff5f-aba8-4cc8-a7ee-8eab869cc28e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:51.954741 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05ff5f-aba8-4cc8-a7ee-8eab869cc28e None admin] PATH_INFO: `/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21/users/85f373368554415abdbcb3cfa20d5ced/roles/00ecc8471dbb4296b40c8b8c0b29aedd` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:51.957322 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05ff5f-aba8-4cc8-a7ee-8eab869cc28e None admin] RBAC: Authorizing `identity:create_grant(project_id=6ff53efad5ea4244a2a900acf4ee3f21, user_id=85f373368554415abdbcb3cfa20d5ced, role_id=00ecc8471dbb4296b40c8b8c0b29aedd)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:51.959136 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05ff5f-aba8-4cc8-a7ee-8eab869cc28e None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:51.996299 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acc00a-304c-49d8-8eaf-c412e617f776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:51.997359 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acc00a-304c-49d8-8eaf-c412e617f776 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:51.997880 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acc00a-304c-49d8-8eaf-c412e617f776 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:51.998414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acc00a-304c-49d8-8eaf-c412e617f776 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:52.000130 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acc00a-304c-49d8-8eaf-c412e617f776 None admin] RBAC: Adding query filter params (role.id=0e00f6ebfc2843a0992b3d01f50e262d, scope.project.id=6ff53efad5ea4244a2a900acf4ee3f21, user.id=f281a3becb2340708a575d806afabd26) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:52.000694 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acc00a-304c-49d8-8eaf-c412e617f776 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:52.002420 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acc00a-304c-49d8-8eaf-c412e617f776 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:52.009112 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 117/233] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:00:51 2022] GET /identity/v3/role_assignments?user.id=f281a3becb2340708a575d806afabd26&scope.project.id=6ff53efad5ea4244a2a900acf4ee3f21&role.id=0e00f6ebfc2843a0992b3d01f50e262d => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:52.095309 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 117/234] 10.222.0.76 () {58 vars in 1439 bytes} [Mon May 16 15:00:51 2022] PUT /identity/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21/users/85f373368554415abdbcb3cfa20d5ced/roles/00ecc8471dbb4296b40c8b8c0b29aedd => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:00:53.206762 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c8187-1c8e-4321-ac7c-59cd34b08df0 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:53.207276 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c8187-1c8e-4321-ac7c-59cd34b08df0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:53.207354 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c8187-1c8e-4321-ac7c-59cd34b08df0 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:53.208937 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 118/235] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:53.214282 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406091ed-eb67-4604-ae29-7bc00acabdbc None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:53.214676 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406091ed-eb67-4604-ae29-7bc00acabdbc None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:53.214871 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406091ed-eb67-4604-ae29-7bc00acabdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:53.240355 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-406091ed-eb67-4604-ae29-7bc00acabdbc None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:53.241540 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-406091ed-eb67-4604-ae29-7bc00acabdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:53.330460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 118/236] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:00:53.345072 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ab2b2-7f2a-45de-9d9b-0395fa1ae920 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:53.345352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ab2b2-7f2a-45de-9d9b-0395fa1ae920 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:53.345632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ab2b2-7f2a-45de-9d9b-0395fa1ae920 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:53.347287 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 119/237] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:53.352628 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916f9cd-54df-4d07-a0f3-69effa689b62 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:53.352925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916f9cd-54df-4d07-a0f3-69effa689b62 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:53.353207 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916f9cd-54df-4d07-a0f3-69effa689b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:53.363397 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ab2b2-7f2a-45de-9d9b-0395fa1ae920 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:53.375143 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-4916f9cd-54df-4d07-a0f3-69effa689b62 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:53.376313 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4916f9cd-54df-4d07-a0f3-69effa689b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:53.448175 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 119/238] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:53.487874 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916f9cd-54df-4d07-a0f3-69effa689b62 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:53.585098 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ab2b2-7f2a-45de-9d9b-0395fa1ae920 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:53.601123 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916f9cd-54df-4d07-a0f3-69effa689b62 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:53.638500 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a82dbf-0056-410f-b077-5868564a5afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:53.639319 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a82dbf-0056-410f-b077-5868564a5afb None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:53.639598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a82dbf-0056-410f-b077-5868564a5afb None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:53.639866 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a82dbf-0056-410f-b077-5868564a5afb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:53.641021 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a82dbf-0056-410f-b077-5868564a5afb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:53.642488 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a82dbf-0056-410f-b077-5868564a5afb None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:53.644662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 120/239] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:00:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:00:53.651173 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a82dbf-0056-410f-b077-5868564a5afb None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:53.674091 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f758e02-e553-4994-a099-71d8ff9e1fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:53.675000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f758e02-e553-4994-a099-71d8ff9e1fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:53.675286 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f758e02-e553-4994-a099-71d8ff9e1fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:53.675717 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f758e02-e553-4994-a099-71d8ff9e1fa7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:53.696652 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f758e02-e553-4994-a099-71d8ff9e1fa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:53.710755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-0f758e02-e553-4994-a099-71d8ff9e1fa7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 15:00:53.710755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:53.710755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:53.710755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:53.710755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:53.710755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:53.710755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:53.710755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:53.710755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:53.710755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:53.710755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:53.710755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:53.710755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:53.710755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:53.710755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:53.710755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:53.711784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:53.711784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:53.711784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:53.711784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:53.711784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:53.711784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:53.711784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:53.711784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:53.711784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:53.711784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:53.711784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:53.711784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:00:53.711784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:53.711784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:53.711784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:53.711784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:53.712575 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:53.712575 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:53.712575 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:53.712575 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:53.712575 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:53.712575 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:53.712575 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:53.712575 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:53.712575 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:53.712575 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:53.712575 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 15:00:53.712575 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:00:53.712575 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 120/240] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:00:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:00:53.720109 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f758e02-e553-4994-a099-71d8ff9e1fa7 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:53.767099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a82dbf-0056-410f-b077-5868564a5afb None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:53.810466 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d977bec-e14f-4364-a7c7-31463982a33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:53.811534 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d977bec-e14f-4364-a7c7-31463982a33c None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:53.812016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d977bec-e14f-4364-a7c7-31463982a33c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:53.812509 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d977bec-e14f-4364-a7c7-31463982a33c None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:53.813434 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d977bec-e14f-4364-a7c7-31463982a33c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:53.815116 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d977bec-e14f-4364-a7c7-31463982a33c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:53.895219 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f758e02-e553-4994-a099-71d8ff9e1fa7 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:53.935530 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 121/241] 10.222.0.76 () {60 vars in 1132 bytes} [Mon May 16 15:00:53 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:00:53.948546 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426da0b-2294-4b5d-8784-47bf8b0e905d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:53.949609 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426da0b-2294-4b5d-8784-47bf8b0e905d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:53.950196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426da0b-2294-4b5d-8784-47bf8b0e905d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:53.950716 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426da0b-2294-4b5d-8784-47bf8b0e905d None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:53.951816 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426da0b-2294-4b5d-8784-47bf8b0e905d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:53.954108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426da0b-2294-4b5d-8784-47bf8b0e905d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:53.955935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426da0b-2294-4b5d-8784-47bf8b0e905d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:53.968658 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 121/242] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:00:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:00:53.974389 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d977bec-e14f-4364-a7c7-31463982a33c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:54.126782 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d977bec-e14f-4364-a7c7-31463982a33c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:54.181075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23518c9-083e-4f31-8cd9-a836b2aadea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:54.182410 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23518c9-083e-4f31-8cd9-a836b2aadea0 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:54.182895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23518c9-083e-4f31-8cd9-a836b2aadea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:54.183402 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23518c9-083e-4f31-8cd9-a836b2aadea0 None admin] PATH_INFO: `/v3/users/cc66748a9cf744d5b580cb8e77ca6a63` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:54.208513 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23518c9-083e-4f31-8cd9-a836b2aadea0 None admin] RBAC: Authorizing `identity:get_user(user_id=cc66748a9cf744d5b580cb8e77ca6a63)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:54.210399 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23518c9-083e-4f31-8cd9-a836b2aadea0 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:54.212441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 122/243] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:53 2022] GET /identity/v3/users/cc66748a9cf744d5b580cb8e77ca6a63 => generated 297 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:54.218625 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426da0b-2294-4b5d-8784-47bf8b0e905d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:54.356690 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426da0b-2294-4b5d-8784-47bf8b0e905d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:54.401053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c075ab-8d7d-4f4b-9dfe-9fbec52edfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:54.402095 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c075ab-8d7d-4f4b-9dfe-9fbec52edfee None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:54.402615 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c075ab-8d7d-4f4b-9dfe-9fbec52edfee None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:54.403094 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c075ab-8d7d-4f4b-9dfe-9fbec52edfee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:54.502668 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c075ab-8d7d-4f4b-9dfe-9fbec52edfee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:54.504580 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c075ab-8d7d-4f4b-9dfe-9fbec52edfee None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:54.604676 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699e56b-6405-4855-a962-07e7844f924b None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:54.605189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699e56b-6405-4855-a962-07e7844f924b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:54.605189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699e56b-6405-4855-a962-07e7844f924b None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:54.606828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 123/244] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:54.625387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6be57-bf38-467d-a251-5513e0cfa830 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:54.625993 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6be57-bf38-467d-a251-5513e0cfa830 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:54.626484 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6be57-bf38-467d-a251-5513e0cfa830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:54.628258 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 122/245] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:00:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:00:54.638493 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c075ab-8d7d-4f4b-9dfe-9fbec52edfee None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:54.649014 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9ca6be57-bf38-467d-a251-5513e0cfa830 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:54.650502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9ca6be57-bf38-467d-a251-5513e0cfa830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:54.718660 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 124/246] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:00:54.744353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6be57-bf38-467d-a251-5513e0cfa830 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:54.758510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c075ab-8d7d-4f4b-9dfe-9fbec52edfee None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:54.810724 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86362f9-37ee-47b8-a027-0258aeb8409b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:54.811621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86362f9-37ee-47b8-a027-0258aeb8409b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:54.811902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86362f9-37ee-47b8-a027-0258aeb8409b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:54.813286 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86362f9-37ee-47b8-a027-0258aeb8409b None admin] PATH_INFO: `/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:54.815610 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86362f9-37ee-47b8-a027-0258aeb8409b None admin] RBAC: Authorizing `identity:get_project(project_id=6ff53efad5ea4244a2a900acf4ee3f21)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:54.816072 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86362f9-37ee-47b8-a027-0258aeb8409b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:54.819412 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 123/247] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:00:54 2022] GET /identity/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:54.820656 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230d02f-7818-43db-8ef6-ac0e980793da None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:54.820942 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230d02f-7818-43db-8ef6-ac0e980793da None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:54.821218 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230d02f-7818-43db-8ef6-ac0e980793da None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:54.822738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 124/248] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:54.826195 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230d02f-7818-43db-8ef6-ac0e980793da None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:54.876128 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6be57-bf38-467d-a251-5513e0cfa830 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:54.922223 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41685c57-5a9a-4429-ba76-482894c07e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:54.923040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41685c57-5a9a-4429-ba76-482894c07e87 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:54.923305 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41685c57-5a9a-4429-ba76-482894c07e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:54.923579 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41685c57-5a9a-4429-ba76-482894c07e87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:54.940873 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41685c57-5a9a-4429-ba76-482894c07e87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:54.950112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-41685c57-5a9a-4429-ba76-482894c07e87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:00:54.950112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:54.950112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:54.950112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:54.950112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:54.950112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:54.950112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:54.950112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:54.950112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:54.950112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:54.950112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:54.950112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:54.950112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:54.950112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:54.950112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:54.950112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:54.951083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:54.951083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:54.951083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:54.951083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:54.951083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:54.951083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:54.951083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:54.951083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:54.951083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:54.951083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:54.951083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:54.951083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:00:54.951083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:54.951083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:54.951083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:54.951083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:54.951894 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:54.951894 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:54.951894 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:54.951894 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:54.951894 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:54.951894 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:54.951894 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:54.951894 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:54.951894 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:54.951894 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:54.951894 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:00:54.951894 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:00:54.956385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 125/249] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:00:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:00:54.957942 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8b20c-72b2-4731-890d-4d878485eb86 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:54.958258 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8b20c-72b2-4731-890d-4d878485eb86 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:54.958537 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8b20c-72b2-4731-890d-4d878485eb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:54.973417 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230d02f-7818-43db-8ef6-ac0e980793da None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:54.977591 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-c9d8b20c-72b2-4731-890d-4d878485eb86 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:54.978934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c9d8b20c-72b2-4731-890d-4d878485eb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:55.020123 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b552457-c771-4230-b07a-76967cf2eae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:55.021135 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b552457-c771-4230-b07a-76967cf2eae0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:55.021617 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b552457-c771-4230-b07a-76967cf2eae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:55.022112 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b552457-c771-4230-b07a-76967cf2eae0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:55.023175 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b552457-c771-4230-b07a-76967cf2eae0 None admin] RBAC: Adding query filter params (role.id=046c7400e19f4144be943daf291f32db, scope.project.id=6ff53efad5ea4244a2a900acf4ee3f21, user.id=cc66748a9cf744d5b580cb8e77ca6a63) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:55.024068 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b552457-c771-4230-b07a-76967cf2eae0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:55.025702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b552457-c771-4230-b07a-76967cf2eae0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:55.037818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 125/250] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:00:54 2022] GET /identity/v3/role_assignments?user.id=cc66748a9cf744d5b580cb8e77ca6a63&scope.project.id=6ff53efad5ea4244a2a900acf4ee3f21&role.id=046c7400e19f4144be943daf291f32db => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:00:55.038873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b552457-c771-4230-b07a-76967cf2eae0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:55.061844 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 126/251] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:55.161271 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8b20c-72b2-4731-890d-4d878485eb86 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:55.240762 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b552457-c771-4230-b07a-76967cf2eae0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:55.295013 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf0f2f-a86c-4197-bb41-92ddff26b5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:55.296038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf0f2f-a86c-4197-bb41-92ddff26b5de None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:55.296497 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf0f2f-a86c-4197-bb41-92ddff26b5de None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:55.296947 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf0f2f-a86c-4197-bb41-92ddff26b5de None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:55.297878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf0f2f-a86c-4197-bb41-92ddff26b5de None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:55.298383 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf0f2f-a86c-4197-bb41-92ddff26b5de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:55.299994 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf0f2f-a86c-4197-bb41-92ddff26b5de None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:55.308934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 126/252] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:00:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:55.310559 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befe29e-74b1-41a0-8f3e-4d7871dbe773 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:55.311599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befe29e-74b1-41a0-8f3e-4d7871dbe773 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:55.312073 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befe29e-74b1-41a0-8f3e-4d7871dbe773 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:55.313843 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 127/253] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:55.316200 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8b20c-72b2-4731-890d-4d878485eb86 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:55.319489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6eac0-40f0-4374-969a-1661541dd114 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:55.320019 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6eac0-40f0-4374-969a-1661541dd114 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:55.320493 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6eac0-40f0-4374-969a-1661541dd114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:55.351000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-80d6eac0-40f0-4374-969a-1661541dd114 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:55.351952 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a80196-7746-4dca-93d8-929f789140af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:55.352694 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-80d6eac0-40f0-4374-969a-1661541dd114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:55.352924 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a80196-7746-4dca-93d8-929f789140af None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:55.353279 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a80196-7746-4dca-93d8-929f789140af None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:55.353669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a80196-7746-4dca-93d8-929f789140af None admin] PATH_INFO: `/v3/roles/member` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:55.364670 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a80196-7746-4dca-93d8-929f789140af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:55.374159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-48a80196-7746-4dca-93d8-929f789140af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 15:00:55.374159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:55.374159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:55.374159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:55.374159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:55.374159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:55.374159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:55.374159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:55.374159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:55.374159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:55.374159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:55.374159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:55.374159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:55.374159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:55.374159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:55.374159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:55.375148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:55.375148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:55.375148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:55.375148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:55.375148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:55.375148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:55.375148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:55.375148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:55.375148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:55.375148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:55.375148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:55.375148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:00:55.375148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:55.375148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:55.375148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:55.375148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:55.375920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:55.375920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:55.375920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:55.375920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:55.375920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:55.375920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:55.375920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:55.375920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:55.375920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:55.375920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:55.375920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 15:00:55.375920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:00:55.379492 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 127/254] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:00:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:00:55.380424 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a80196-7746-4dca-93d8-929f789140af None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:55.460564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 128/255] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:55.461702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6eac0-40f0-4374-969a-1661541dd114 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:55.488262 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a80196-7746-4dca-93d8-929f789140af None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:55.524227 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb6469-65e4-4cdd-9869-19674f0d0a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:55.525134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb6469-65e4-4cdd-9869-19674f0d0a79 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:55.525736 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb6469-65e4-4cdd-9869-19674f0d0a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:55.525736 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb6469-65e4-4cdd-9869-19674f0d0a79 None admin] PATH_INFO: `/v3/users/85f373368554415abdbcb3cfa20d5ced` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:55.527186 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb6469-65e4-4cdd-9869-19674f0d0a79 None admin] RBAC: Authorizing `identity:get_user(user_id=85f373368554415abdbcb3cfa20d5ced)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:55.528739 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb6469-65e4-4cdd-9869-19674f0d0a79 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:55.534540 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 128/256] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:55 2022] GET /identity/v3/users/85f373368554415abdbcb3cfa20d5ced => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:55.535678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb6469-65e4-4cdd-9869-19674f0d0a79 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:55.612105 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6eac0-40f0-4374-969a-1661541dd114 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:55.649662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb6469-65e4-4cdd-9869-19674f0d0a79 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:55.659784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7f714-3267-4b8c-af9c-6a4a230c648e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:55.660729 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7f714-3267-4b8c-af9c-6a4a230c648e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:55.661180 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7f714-3267-4b8c-af9c-6a4a230c648e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:55.661626 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7f714-3267-4b8c-af9c-6a4a230c648e None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:55.662602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7f714-3267-4b8c-af9c-6a4a230c648e None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:55.663105 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7f714-3267-4b8c-af9c-6a4a230c648e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:55.664666 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7f714-3267-4b8c-af9c-6a4a230c648e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:55.681694 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 129/257] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:00:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:55.682832 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7f714-3267-4b8c-af9c-6a4a230c648e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:55.692048 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42320ae-c5fd-4dc9-88d1-81c0c64d0cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:55.694899 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42320ae-c5fd-4dc9-88d1-81c0c64d0cec None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:55.695185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42320ae-c5fd-4dc9-88d1-81c0c64d0cec None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:55.695460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42320ae-c5fd-4dc9-88d1-81c0c64d0cec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:55.716406 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42320ae-c5fd-4dc9-88d1-81c0c64d0cec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:55.735320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-a42320ae-c5fd-4dc9-88d1-81c0c64d0cec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 15:00:55.735320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:55.735320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:55.735320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:55.735320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:55.735320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:55.735320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:55.735320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:55.735320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:55.735320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:55.735320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:55.735320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:55.735320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:55.735320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:55.735320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:55.735320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:55.736272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:55.736272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:55.736272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:55.736272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:55.736272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:55.736272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:55.736272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:55.736272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:55.736272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:55.736272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:55.736272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:55.736272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:00:55.736272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:55.736272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:55.736272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:55.736272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:55.737073 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:55.737073 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:55.737073 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:55.737073 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:55.737073 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:55.737073 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:55.737073 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:55.737073 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:55.737073 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:55.737073 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:55.737073 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 15:00:55.737073 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:00:55.738916 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 129/258] 10.222.0.76 () {56 vars in 1114 bytes} [Mon May 16 15:00:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:00:55.739728 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42320ae-c5fd-4dc9-88d1-81c0c64d0cec None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:55.839714 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7f714-3267-4b8c-af9c-6a4a230c648e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:55.863369 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42320ae-c5fd-4dc9-88d1-81c0c64d0cec None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:55.883053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53d0d5-25a7-4dc6-a9d8-94622d0ce05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:55.883712 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53d0d5-25a7-4dc6-a9d8-94622d0ce05b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:55.884001 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53d0d5-25a7-4dc6-a9d8-94622d0ce05b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:55.884280 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53d0d5-25a7-4dc6-a9d8-94622d0ce05b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:55.903680 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a798d66-4bf9-411d-9c8c-27c68ce89b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:55.904632 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a798d66-4bf9-411d-9c8c-27c68ce89b5b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:55.905468 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a798d66-4bf9-411d-9c8c-27c68ce89b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:55.905749 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a798d66-4bf9-411d-9c8c-27c68ce89b5b None admin] PATH_INFO: `/v3/users/f281a3becb2340708a575d806afabd26` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:55.907076 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a798d66-4bf9-411d-9c8c-27c68ce89b5b None admin] RBAC: Authorizing `identity:get_user(user_id=f281a3becb2340708a575d806afabd26)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:55.908604 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a798d66-4bf9-411d-9c8c-27c68ce89b5b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:55.910465 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 130/259] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:55 2022] GET /identity/v3/users/f281a3becb2340708a575d806afabd26 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:55.914902 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a798d66-4bf9-411d-9c8c-27c68ce89b5b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:56.017032 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a798d66-4bf9-411d-9c8c-27c68ce89b5b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:56.046253 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53d0d5-25a7-4dc6-a9d8-94622d0ce05b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:56.048048 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53d0d5-25a7-4dc6-a9d8-94622d0ce05b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:56.058887 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011e9f4-abc7-4d1a-8f42-356c19e3d23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:56.058887 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011e9f4-abc7-4d1a-8f42-356c19e3d23f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:56.058887 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011e9f4-abc7-4d1a-8f42-356c19e3d23f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:56.058887 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011e9f4-abc7-4d1a-8f42-356c19e3d23f None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:56.059237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011e9f4-abc7-4d1a-8f42-356c19e3d23f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:56.059237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011e9f4-abc7-4d1a-8f42-356c19e3d23f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:56.059237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011e9f4-abc7-4d1a-8f42-356c19e3d23f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:56.064103 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 131/260] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:00:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:56.064818 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011e9f4-abc7-4d1a-8f42-356c19e3d23f None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:56.164863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 130/261] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:00:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:00:56.166073 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53d0d5-25a7-4dc6-a9d8-94622d0ce05b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:56.171695 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011e9f4-abc7-4d1a-8f42-356c19e3d23f None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:56.206861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837128d-0b4f-4dfa-88a5-5f3652627705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:56.207730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837128d-0b4f-4dfa-88a5-5f3652627705 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:56.208014 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837128d-0b4f-4dfa-88a5-5f3652627705 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:56.208289 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837128d-0b4f-4dfa-88a5-5f3652627705 None admin] PATH_INFO: `/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:56.209611 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837128d-0b4f-4dfa-88a5-5f3652627705 None admin] RBAC: Authorizing `identity:get_project(project_id=6ff53efad5ea4244a2a900acf4ee3f21)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:56.211170 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837128d-0b4f-4dfa-88a5-5f3652627705 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:56.218050 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 132/262] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:00:56 2022] GET /identity/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:56.218965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837128d-0b4f-4dfa-88a5-5f3652627705 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:56.284062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53d0d5-25a7-4dc6-a9d8-94622d0ce05b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:56.318548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0294251-b8f1-4866-b7fd-32185f4f12e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:56.319759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0294251-b8f1-4866-b7fd-32185f4f12e0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:56.320240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0294251-b8f1-4866-b7fd-32185f4f12e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:56.320729 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0294251-b8f1-4866-b7fd-32185f4f12e0 None admin] PATH_INFO: `/v3/users/85f373368554415abdbcb3cfa20d5ced` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:56.321033 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837128d-0b4f-4dfa-88a5-5f3652627705 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:56.322352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0294251-b8f1-4866-b7fd-32185f4f12e0 None admin] RBAC: Authorizing `identity:get_user(user_id=85f373368554415abdbcb3cfa20d5ced)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:56.324013 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0294251-b8f1-4866-b7fd-32185f4f12e0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:56.325902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 131/263] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:56 2022] GET /identity/v3/users/85f373368554415abdbcb3cfa20d5ced => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:56.327442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0294251-b8f1-4866-b7fd-32185f4f12e0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:56.356603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c9729-1f1a-4d16-952b-8abd7ee74ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:56.357485 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c9729-1f1a-4d16-952b-8abd7ee74ccc None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:56.358390 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c9729-1f1a-4d16-952b-8abd7ee74ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:56.361458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c9729-1f1a-4d16-952b-8abd7ee74ccc None admin] PATH_INFO: `/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:56.362632 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c9729-1f1a-4d16-952b-8abd7ee74ccc None admin] RBAC: Authorizing `identity:get_project(project_id=6ff53efad5ea4244a2a900acf4ee3f21)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:56.365165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c9729-1f1a-4d16-952b-8abd7ee74ccc None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:56.367172 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 133/264] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:00:56 2022] GET /identity/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:56.367964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c9729-1f1a-4d16-952b-8abd7ee74ccc None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:56.441424 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0294251-b8f1-4866-b7fd-32185f4f12e0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:56.472877 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c9729-1f1a-4d16-952b-8abd7ee74ccc None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:56.476942 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9e966-eed5-4507-a314-27925acff615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:56.478063 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9e966-eed5-4507-a314-27925acff615 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:56.478572 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9e966-eed5-4507-a314-27925acff615 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:56.479041 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9e966-eed5-4507-a314-27925acff615 None admin] PATH_INFO: `/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21/users/f281a3becb2340708a575d806afabd26/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:56.481237 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9e966-eed5-4507-a314-27925acff615 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ff53efad5ea4244a2a900acf4ee3f21, user_id=f281a3becb2340708a575d806afabd26, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:56.482987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9e966-eed5-4507-a314-27925acff615 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:56.512122 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11b179-f38e-4dd8-a9cf-a22d9bd9dcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:56.512778 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11b179-f38e-4dd8-a9cf-a22d9bd9dcd1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:56.513062 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11b179-f38e-4dd8-a9cf-a22d9bd9dcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:56.513339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11b179-f38e-4dd8-a9cf-a22d9bd9dcd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:56.594159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11b179-f38e-4dd8-a9cf-a22d9bd9dcd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:56.594159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11b179-f38e-4dd8-a9cf-a22d9bd9dcd1 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:56.594376 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 132/265] 10.222.0.76 () {58 vars in 1439 bytes} [Mon May 16 15:00:56 2022] PUT /identity/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21/users/f281a3becb2340708a575d806afabd26/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:00:56.594376 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9e966-eed5-4507-a314-27925acff615 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:56.707435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 134/266] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:00:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:00:56.714031 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11b179-f38e-4dd8-a9cf-a22d9bd9dcd1 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:56.830026 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11b179-f38e-4dd8-a9cf-a22d9bd9dcd1 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:56.869839 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88f016-4f20-4a79-9464-772e2cf13b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:56.870739 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88f016-4f20-4a79-9464-772e2cf13b95 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:56.871019 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88f016-4f20-4a79-9464-772e2cf13b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:56.871297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88f016-4f20-4a79-9464-772e2cf13b95 None admin] PATH_INFO: `/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:56.873097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88f016-4f20-4a79-9464-772e2cf13b95 None admin] RBAC: Authorizing `identity:get_project(project_id=6ff53efad5ea4244a2a900acf4ee3f21)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:56.875411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88f016-4f20-4a79-9464-772e2cf13b95 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:56.877495 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 135/267] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:00:56 2022] GET /identity/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:00:56.884554 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88f016-4f20-4a79-9464-772e2cf13b95 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:56.897002 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9e966-eed5-4507-a314-27925acff615 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:57.015191 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3b25e-5e9f-4d79-a1a3-364bac2b8837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:57.015191 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3b25e-5e9f-4d79-a1a3-364bac2b8837 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:57.015543 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88f016-4f20-4a79-9464-772e2cf13b95 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:57.015632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3b25e-5e9f-4d79-a1a3-364bac2b8837 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:57.015632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3b25e-5e9f-4d79-a1a3-364bac2b8837 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:57.015632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3b25e-5e9f-4d79-a1a3-364bac2b8837 None admin] RBAC: Adding query filter params (role.id=f6c8fc0dc0f24de3907b0960a1201901, scope.project.id=6ff53efad5ea4244a2a900acf4ee3f21, user.id=85f373368554415abdbcb3cfa20d5ced) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:57.015632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3b25e-5e9f-4d79-a1a3-364bac2b8837 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:57.015632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3b25e-5e9f-4d79-a1a3-364bac2b8837 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:57.016916 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 133/268] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:00:56 2022] GET /identity/v3/role_assignments?user.id=85f373368554415abdbcb3cfa20d5ced&scope.project.id=6ff53efad5ea4244a2a900acf4ee3f21&role.id=f6c8fc0dc0f24de3907b0960a1201901 => generated 608 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:57.037057 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d664d38-5c99-4ae9-9cb6-f758d42580ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:57.037737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d664d38-5c99-4ae9-9cb6-f758d42580ea None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:57.038022 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d664d38-5c99-4ae9-9cb6-f758d42580ea None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:57.038338 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d664d38-5c99-4ae9-9cb6-f758d42580ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:57.039204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d664d38-5c99-4ae9-9cb6-f758d42580ea None admin] RBAC: Adding query filter params (role.id=00ecc8471dbb4296b40c8b8c0b29aedd, scope.project.id=6ff53efad5ea4244a2a900acf4ee3f21, user.id=85f373368554415abdbcb3cfa20d5ced) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:57.039517 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d664d38-5c99-4ae9-9cb6-f758d42580ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:57.041027 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d664d38-5c99-4ae9-9cb6-f758d42580ea None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:57.048567 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 136/269] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:00:56 2022] GET /identity/v3/role_assignments?user.id=85f373368554415abdbcb3cfa20d5ced&scope.project.id=6ff53efad5ea4244a2a900acf4ee3f21&role.id=00ecc8471dbb4296b40c8b8c0b29aedd => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:00:57.664837 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb97f05-41f7-41cb-895a-4d165beb1d33 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:57.665337 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb97f05-41f7-41cb-895a-4d165beb1d33 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:57.665433 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb97f05-41f7-41cb-895a-4d165beb1d33 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:57.667077 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 134/270] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:57.673281 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c59d0-4874-4b35-819f-4cb96915348e None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:57.673572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c59d0-4874-4b35-819f-4cb96915348e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:57.673851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c59d0-4874-4b35-819f-4cb96915348e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:57.691489 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a56c59d0-4874-4b35-819f-4cb96915348e None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:57.692680 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a56c59d0-4874-4b35-819f-4cb96915348e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:57.726231 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf267be-ade8-4b59-8008-94517bb1ed90 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:57.726514 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf267be-ade8-4b59-8008-94517bb1ed90 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:57.727033 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf267be-ade8-4b59-8008-94517bb1ed90 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:57.728620 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 135/271] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:57.740201 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34e99e-507c-405b-8958-a559b3599d54 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:57.740485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34e99e-507c-405b-8958-a559b3599d54 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:57.740931 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34e99e-507c-405b-8958-a559b3599d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:57.760530 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-2c34e99e-507c-405b-8958-a559b3599d54 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:57.761953 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2c34e99e-507c-405b-8958-a559b3599d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:57.767260 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 137/272] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:00:57.793259 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c59d0-4874-4b35-819f-4cb96915348e None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:57.834961 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 136/273] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:00:57.859826 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34e99e-507c-405b-8958-a559b3599d54 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:57.894324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c59d0-4874-4b35-819f-4cb96915348e None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:57.932637 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c3be7-fc30-4335-acf8-eb620e7a0634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:57.933449 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c3be7-fc30-4335-acf8-eb620e7a0634 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:57.933729 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c3be7-fc30-4335-acf8-eb620e7a0634 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:57.934005 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c3be7-fc30-4335-acf8-eb620e7a0634 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:57.947957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c3be7-fc30-4335-acf8-eb620e7a0634 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:57.958819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-8a6c3be7-fc30-4335-acf8-eb620e7a0634 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 15:00:57.958819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:57.958819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:57.958819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:57.958819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:57.958819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:57.958819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:57.958819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:57.958819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:57.958819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:57.958819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:57.958819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:57.958819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:57.958819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:57.958819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:57.958819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:57.959760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:57.959760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:57.959760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:57.959760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:57.959760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:57.959760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:57.959760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:57.959760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:57.959760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:57.959760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:57.959760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:57.959760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:00:57.959760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:57.959760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:57.959760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:57.959760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:57.960584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:57.960584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:57.960584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:57.960584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:57.960584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:57.960584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:57.960584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:57.960584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:57.960584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:57.960584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:57.960584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 15:00:57.960584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:00:57.960584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 138/274] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:00:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:00:57.967649 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c3be7-fc30-4335-acf8-eb620e7a0634 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:57.974515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34e99e-507c-405b-8958-a559b3599d54 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:58.009936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3e1f1-ca8e-4407-8957-ad9e03824bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:58.011127 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3e1f1-ca8e-4407-8957-ad9e03824bdd None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:58.011623 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3e1f1-ca8e-4407-8957-ad9e03824bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:58.012103 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3e1f1-ca8e-4407-8957-ad9e03824bdd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:58.013460 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3e1f1-ca8e-4407-8957-ad9e03824bdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:58.015736 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3e1f1-ca8e-4407-8957-ad9e03824bdd None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:58.022223 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 137/275] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:00:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:58.023269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3e1f1-ca8e-4407-8957-ad9e03824bdd None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:58.070713 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c3be7-fc30-4335-acf8-eb620e7a0634 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:58.109420 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2549e-1cbe-4299-b5df-ef2d874906c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:58.110173 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2549e-1cbe-4299-b5df-ef2d874906c2 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:58.110402 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2549e-1cbe-4299-b5df-ef2d874906c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:58.110683 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2549e-1cbe-4299-b5df-ef2d874906c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:58.111465 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2549e-1cbe-4299-b5df-ef2d874906c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:58.111771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2549e-1cbe-4299-b5df-ef2d874906c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:58.113169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2549e-1cbe-4299-b5df-ef2d874906c2 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:58.124898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 139/276] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:00:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:58.124898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b575d15-d3fe-40c2-8af6-ed117eb074d9 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:58.124898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b575d15-d3fe-40c2-8af6-ed117eb074d9 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:58.124898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b575d15-d3fe-40c2-8af6-ed117eb074d9 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:58.124898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 140/277] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:58.127715 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3e1f1-ca8e-4407-8957-ad9e03824bdd None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:58.128095 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b575d15-d3fe-40c2-8af6-ed117eb074d9 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:58.161921 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b905a54-10ee-49cb-87d5-a79a01e25f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:58.162619 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b905a54-10ee-49cb-87d5-a79a01e25f51 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:58.162899 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b905a54-10ee-49cb-87d5-a79a01e25f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:58.163172 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b905a54-10ee-49cb-87d5-a79a01e25f51 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:58.163873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b905a54-10ee-49cb-87d5-a79a01e25f51 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:58.165328 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b905a54-10ee-49cb-87d5-a79a01e25f51 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:58.226023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b575d15-d3fe-40c2-8af6-ed117eb074d9 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:58.260554 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae62317-8a72-4023-8c28-1bf4b5852c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:58.261422 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae62317-8a72-4023-8c28-1bf4b5852c02 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:58.261705 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae62317-8a72-4023-8c28-1bf4b5852c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:58.261978 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae62317-8a72-4023-8c28-1bf4b5852c02 None admin] PATH_INFO: `/v3/users/428c67b69e18423d922af8359fd1fceb` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:58.275592 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae62317-8a72-4023-8c28-1bf4b5852c02 None admin] RBAC: Authorizing `identity:get_user(user_id=428c67b69e18423d922af8359fd1fceb)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:58.277043 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae62317-8a72-4023-8c28-1bf4b5852c02 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:58.278758 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 141/278] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:58 2022] GET /identity/v3/users/428c67b69e18423d922af8359fd1fceb => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:00:58.281016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20064ec6-b39e-4b6b-8479-8e8584bff854 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:58.281299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20064ec6-b39e-4b6b-8479-8e8584bff854 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:58.281570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20064ec6-b39e-4b6b-8479-8e8584bff854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:58.297173 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-20064ec6-b39e-4b6b-8479-8e8584bff854 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:58.298379 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-20064ec6-b39e-4b6b-8479-8e8584bff854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:58.304108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 138/279] 10.222.0.76 () {60 vars in 1132 bytes} [Mon May 16 15:00:58 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:00:58.315348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b905a54-10ee-49cb-87d5-a79a01e25f51 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:58.371180 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 142/280] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:00:58.394945 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20064ec6-b39e-4b6b-8479-8e8584bff854 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:58.445832 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b905a54-10ee-49cb-87d5-a79a01e25f51 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:58.531190 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20064ec6-b39e-4b6b-8479-8e8584bff854 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:58.535673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b71ac-9a7f-4394-9ce0-d49f719f38d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:58.536604 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b71ac-9a7f-4394-9ce0-d49f719f38d6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:58.537100 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b71ac-9a7f-4394-9ce0-d49f719f38d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:58.537587 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b71ac-9a7f-4394-9ce0-d49f719f38d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:58.538766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b71ac-9a7f-4394-9ce0-d49f719f38d6 None admin] RBAC: Adding query filter params (role.id=0e00f6ebfc2843a0992b3d01f50e262d, user.id=428c67b69e18423d922af8359fd1fceb, scope.system=all) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:58.539298 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b71ac-9a7f-4394-9ce0-d49f719f38d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:58.540977 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b71ac-9a7f-4394-9ce0-d49f719f38d6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:58.549807 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 139/281] 10.222.0.76 () {56 vars in 1308 bytes} [Mon May 16 15:00:58 2022] GET /identity/v3/role_assignments?user.id=428c67b69e18423d922af8359fd1fceb&scope.system=all&role.id=0e00f6ebfc2843a0992b3d01f50e262d => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:58.571281 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b32d7-9302-4819-b77e-74df298a8fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:58.572251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b32d7-9302-4819-b77e-74df298a8fed None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:58.572375 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b32d7-9302-4819-b77e-74df298a8fed None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:58.572612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b32d7-9302-4819-b77e-74df298a8fed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:58.592244 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b32d7-9302-4819-b77e-74df298a8fed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:58.600523 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-f29b32d7-9302-4819-b77e-74df298a8fed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 15:00:58.600523 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:58.600523 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:58.600523 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:58.600523 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:58.600523 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:58.600523 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:58.600523 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:58.600523 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:58.600523 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:58.600523 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:58.600523 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:58.600523 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:58.600523 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:58.600523 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:58.600523 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:58.601479 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:58.601479 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:58.601479 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:58.601479 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:58.601479 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:58.601479 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:58.601479 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:58.601479 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:58.601479 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:58.601479 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:58.601479 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:58.601479 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:00:58.601479 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:58.601479 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:58.601479 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:58.601479 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:58.602317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:58.602317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:58.602317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:58.602317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:58.602317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:58.602317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:58.602317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:58.602317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:58.602317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:58.602317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:58.602317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 15:00:58.602317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:00:58.605463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 143/282] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:00:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:00:58.611655 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b71ac-9a7f-4394-9ce0-d49f719f38d6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:58.729324 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b71ac-9a7f-4394-9ce0-d49f719f38d6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:58.766045 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a310d-5075-4266-94aa-572d6bbbdb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:58.766754 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a310d-5075-4266-94aa-572d6bbbdb84 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:58.767038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a310d-5075-4266-94aa-572d6bbbdb84 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:58.767315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a310d-5075-4266-94aa-572d6bbbdb84 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:58.768081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a310d-5075-4266-94aa-572d6bbbdb84 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:00:58.768377 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a310d-5075-4266-94aa-572d6bbbdb84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:58.769777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a310d-5075-4266-94aa-572d6bbbdb84 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:58.778502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 140/283] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:00:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:58.784819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b32d7-9302-4819-b77e-74df298a8fed None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:58.914418 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b32d7-9302-4819-b77e-74df298a8fed None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:58.960678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4e2a8-eb53-460c-be21-97dfe61c58be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:58.961862 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4e2a8-eb53-460c-be21-97dfe61c58be None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:58.962317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4e2a8-eb53-460c-be21-97dfe61c58be None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:58.962754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4e2a8-eb53-460c-be21-97dfe61c58be None admin] PATH_INFO: `/v3/users/cc66748a9cf744d5b580cb8e77ca6a63` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:58.964114 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4e2a8-eb53-460c-be21-97dfe61c58be None admin] RBAC: Authorizing `identity:get_user(user_id=cc66748a9cf744d5b580cb8e77ca6a63)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:58.965708 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4e2a8-eb53-460c-be21-97dfe61c58be None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:58.968365 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 144/284] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:00:58 2022] GET /identity/v3/users/cc66748a9cf744d5b580cb8e77ca6a63 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:58.973707 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a310d-5075-4266-94aa-572d6bbbdb84 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:59.094518 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a310d-5075-4266-94aa-572d6bbbdb84 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:59.137660 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c961f02-50cf-4ff9-8158-c7b8ba578bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:59.138559 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c961f02-50cf-4ff9-8158-c7b8ba578bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:59.138896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c961f02-50cf-4ff9-8158-c7b8ba578bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:59.139170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c961f02-50cf-4ff9-8158-c7b8ba578bd5 None admin] PATH_INFO: `/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:59.140362 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c961f02-50cf-4ff9-8158-c7b8ba578bd5 None admin] RBAC: Authorizing `identity:get_project(project_id=6ff53efad5ea4244a2a900acf4ee3f21)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:59.141803 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c961f02-50cf-4ff9-8158-c7b8ba578bd5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:59.143856 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 141/285] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:00:58 2022] GET /identity/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:00:59.149378 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4e2a8-eb53-460c-be21-97dfe61c58be None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:59.258382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4e2a8-eb53-460c-be21-97dfe61c58be None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:59.291248 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95785a-e6cc-4fcb-a18a-2dab27ce533c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:59.292131 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95785a-e6cc-4fcb-a18a-2dab27ce533c None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:59.292407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95785a-e6cc-4fcb-a18a-2dab27ce533c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:59.292676 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95785a-e6cc-4fcb-a18a-2dab27ce533c None admin] PATH_INFO: `/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21/users/cc66748a9cf744d5b580cb8e77ca6a63/roles/046c7400e19f4144be943daf291f32db` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:59.294838 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95785a-e6cc-4fcb-a18a-2dab27ce533c None admin] RBAC: Authorizing `identity:create_grant(project_id=6ff53efad5ea4244a2a900acf4ee3f21, user_id=cc66748a9cf744d5b580cb8e77ca6a63, role_id=046c7400e19f4144be943daf291f32db)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:00:59.297706 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95785a-e6cc-4fcb-a18a-2dab27ce533c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:00:59.377011 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 145/286] 10.222.0.76 () {58 vars in 1439 bytes} [Mon May 16 15:00:59 2022] PUT /identity/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21/users/cc66748a9cf744d5b580cb8e77ca6a63/roles/046c7400e19f4144be943daf291f32db => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:00:59.391564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64428bf7-fa02-4a12-897c-97cf3feb584d None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:59.392177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64428bf7-fa02-4a12-897c-97cf3feb584d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:59.392677 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64428bf7-fa02-4a12-897c-97cf3feb584d None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:59.394592 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 142/287] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:00:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:00:59.403603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7218e-16d5-4284-9148-2418267eba49 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:59.404107 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7218e-16d5-4284-9148-2418267eba49 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:59.404644 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7218e-16d5-4284-9148-2418267eba49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:59.447877 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-97b7218e-16d5-4284-9148-2418267eba49 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:00:59.449123 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-97b7218e-16d5-4284-9148-2418267eba49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:00:59.569001 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 146/288] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:00:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:00:59.599089 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64428bf7-fa02-4a12-897c-97cf3feb584d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:59.744305 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64428bf7-fa02-4a12-897c-97cf3feb584d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:00:59.785655 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ef905-6423-47b8-905c-b66f0a5c9e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:00:59.786826 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ef905-6423-47b8-905c-b66f0a5c9e9b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:00:59.787303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ef905-6423-47b8-905c-b66f0a5c9e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:00:59.787787 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ef905-6423-47b8-905c-b66f0a5c9e9b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:00:59.803281 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ef905-6423-47b8-905c-b66f0a5c9e9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:00:59.811935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-878ef905-6423-47b8-905c-b66f0a5c9e9b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 15:00:59.811935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:00:59.811935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:00:59.811935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:00:59.811935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:00:59.811935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:00:59.811935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:00:59.811935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:00:59.811935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:00:59.811935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:00:59.811935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:00:59.811935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:00:59.811935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:00:59.811935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:00:59.811935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:00:59.811935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:00:59.812782 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:00:59.812782 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:00:59.812782 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:00:59.812782 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:00:59.812782 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:00:59.812782 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:00:59.812782 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:00:59.812782 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:00:59.812782 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:00:59.812782 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:00:59.812782 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:00:59.812782 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:00:59.812782 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:00:59.812782 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:00:59.812782 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:00:59.812782 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:00:59.813572 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:00:59.813572 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:00:59.813572 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:00:59.813572 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:00:59.813572 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:00:59.813572 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:00:59.813572 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:00:59.813572 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:00:59.813572 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:00:59.813572 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:00:59.813572 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 15:00:59.813572 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:00:59.820233 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 143/289] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:00:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:00:59.825726 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7218e-16d5-4284-9148-2418267eba49 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:00:59.954106 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7218e-16d5-4284-9148-2418267eba49 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:00.002892 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75422b4c-57cb-4d3e-80b7-c516dac1df2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:00.003485 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75422b4c-57cb-4d3e-80b7-c516dac1df2d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:00.003759 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75422b4c-57cb-4d3e-80b7-c516dac1df2d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:00.004024 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75422b4c-57cb-4d3e-80b7-c516dac1df2d None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:00.004832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75422b4c-57cb-4d3e-80b7-c516dac1df2d None admin] RBAC: Adding query filter params (name=member) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:00.005131 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75422b4c-57cb-4d3e-80b7-c516dac1df2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:00.006586 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75422b4c-57cb-4d3e-80b7-c516dac1df2d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:00.018051 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 147/290] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:00:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:00.026242 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ef905-6423-47b8-905c-b66f0a5c9e9b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:00.192949 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ef905-6423-47b8-905c-b66f0a5c9e9b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:00.234405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a330044-86c6-4732-9c3f-b7ce81de1f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:00.235362 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a330044-86c6-4732-9c3f-b7ce81de1f08 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:00.235638 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a330044-86c6-4732-9c3f-b7ce81de1f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:00.235898 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a330044-86c6-4732-9c3f-b7ce81de1f08 None admin] PATH_INFO: `/v3/users/f281a3becb2340708a575d806afabd26` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:00.237175 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a330044-86c6-4732-9c3f-b7ce81de1f08 None admin] RBAC: Authorizing `identity:get_user(user_id=f281a3becb2340708a575d806afabd26)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:00.238664 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a330044-86c6-4732-9c3f-b7ce81de1f08 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:00.240395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 144/291] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:01:00 2022] GET /identity/v3/users/f281a3becb2340708a575d806afabd26 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:00.245877 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75422b4c-57cb-4d3e-80b7-c516dac1df2d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:00.383666 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75422b4c-57cb-4d3e-80b7-c516dac1df2d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:00.430314 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75ce79-53dd-4646-ae23-9da2383cc271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:00.431434 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75ce79-53dd-4646-ae23-9da2383cc271 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:00.431940 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75ce79-53dd-4646-ae23-9da2383cc271 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:00.432443 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75ce79-53dd-4646-ae23-9da2383cc271 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:00.529193 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75ce79-53dd-4646-ae23-9da2383cc271 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:00.530684 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75ce79-53dd-4646-ae23-9da2383cc271 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:00.652317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 148/292] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:01:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:01:00.658019 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a330044-86c6-4732-9c3f-b7ce81de1f08 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:00.805319 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a330044-86c6-4732-9c3f-b7ce81de1f08 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:00.853455 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcec18-028e-4156-a9bc-9ea902cf7de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:00.854379 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcec18-028e-4156-a9bc-9ea902cf7de8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:00.854665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcec18-028e-4156-a9bc-9ea902cf7de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:00.854940 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcec18-028e-4156-a9bc-9ea902cf7de8 None admin] PATH_INFO: `/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:00.859052 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcec18-028e-4156-a9bc-9ea902cf7de8 None admin] RBAC: Authorizing `identity:get_project(project_id=6ff53efad5ea4244a2a900acf4ee3f21)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:00.860565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcec18-028e-4156-a9bc-9ea902cf7de8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:00.862426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 145/293] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:01:00 2022] GET /identity/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:00.868263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75ce79-53dd-4646-ae23-9da2383cc271 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:01.018112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75ce79-53dd-4646-ae23-9da2383cc271 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:01.070044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc7ec0-1f76-4e0e-be27-e863fad590f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:01.070737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc7ec0-1f76-4e0e-be27-e863fad590f9 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:01.071017 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc7ec0-1f76-4e0e-be27-e863fad590f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:01.071291 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc7ec0-1f76-4e0e-be27-e863fad590f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:01.072135 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc7ec0-1f76-4e0e-be27-e863fad590f9 None admin] RBAC: Adding query filter params (role.id=0e00f6ebfc2843a0992b3d01f50e262d, scope.project.id=6ff53efad5ea4244a2a900acf4ee3f21, user.id=f281a3becb2340708a575d806afabd26) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:01.072446 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc7ec0-1f76-4e0e-be27-e863fad590f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:01.073891 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc7ec0-1f76-4e0e-be27-e863fad590f9 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:01.080789 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 149/294] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:01:00 2022] GET /identity/v3/role_assignments?user.id=f281a3becb2340708a575d806afabd26&scope.project.id=6ff53efad5ea4244a2a900acf4ee3f21&role.id=0e00f6ebfc2843a0992b3d01f50e262d => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:01.427829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79fbc4-8dd1-44a4-8e83-f906e316e973 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:01.428565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79fbc4-8dd1-44a4-8e83-f906e316e973 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:01.429046 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79fbc4-8dd1-44a4-8e83-f906e316e973 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:01.430673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 146/295] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:01.437997 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97d0dc-27ca-44f0-85c5-2cdc0df1b80b None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:01.438568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97d0dc-27ca-44f0-85c5-2cdc0df1b80b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:01.439002 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97d0dc-27ca-44f0-85c5-2cdc0df1b80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:01.457221 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-2e97d0dc-27ca-44f0-85c5-2cdc0df1b80b None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:01.458768 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2e97d0dc-27ca-44f0-85c5-2cdc0df1b80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:01.505120 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f434a-30ec-44f0-8898-efc143b3c2e2 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:01.505747 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f434a-30ec-44f0-8898-efc143b3c2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:01.506310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f434a-30ec-44f0-8898-efc143b3c2e2 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:01.508139 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 147/296] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:01:01.517505 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28918e33-c077-46b1-8417-36042c343b6c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:01.517776 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28918e33-c077-46b1-8417-36042c343b6c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:01.518052 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28918e33-c077-46b1-8417-36042c343b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:01.537373 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-28918e33-c077-46b1-8417-36042c343b6c None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:01.538628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-28918e33-c077-46b1-8417-36042c343b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:01.542329 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 150/297] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:01.570608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97d0dc-27ca-44f0-85c5-2cdc0df1b80b None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:01.613334 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 148/298] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:01:01.616726 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2324d-ad48-493a-956f-72f40b94aaef None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:01.616726 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2324d-ad48-493a-956f-72f40b94aaef None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:01.616726 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2324d-ad48-493a-956f-72f40b94aaef None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:01.616726 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 149/299] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:01.624065 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef553f9-2a67-4192-9a64-2981a7b3ee57 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:01.624349 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef553f9-2a67-4192-9a64-2981a7b3ee57 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:01.624622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef553f9-2a67-4192-9a64-2981a7b3ee57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:01.645672 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9ef553f9-2a67-4192-9a64-2981a7b3ee57 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:01.646932 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9ef553f9-2a67-4192-9a64-2981a7b3ee57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:01.686646 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97d0dc-27ca-44f0-85c5-2cdc0df1b80b None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:01.718569 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 150/300] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:01.722311 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef553f9-2a67-4192-9a64-2981a7b3ee57 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:01.732314 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139f71c-8119-48b9-80ae-01445a1507c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:01.733282 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139f71c-8119-48b9-80ae-01445a1507c0 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:01.733668 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139f71c-8119-48b9-80ae-01445a1507c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:01.734057 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139f71c-8119-48b9-80ae-01445a1507c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:01.745970 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139f71c-8119-48b9-80ae-01445a1507c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:01.753755 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-5139f71c-8119-48b9-80ae-01445a1507c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 15:01:01.753755 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:01.753755 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:01.753755 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:01.753755 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:01.753755 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:01.753755 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:01.753755 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:01.753755 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:01.753755 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:01.753755 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:01.753755 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:01.753755 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:01.753755 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:01.753755 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:01.753755 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:01.754773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:01.754773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:01.754773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:01.754773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:01.754773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:01.754773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:01.754773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:01.754773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:01.754773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:01.754773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:01.754773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:01.754773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:01.754773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:01.754773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:01.754773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:01.754773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:01.755813 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:01.755813 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:01.755813 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:01.755813 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:01.755813 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:01.755813 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:01.755813 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:01.755813 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:01.755813 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:01.755813 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:01.755813 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 15:01:01.755813 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:01.755813 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 151/301] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:01:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:01.760621 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139f71c-8119-48b9-80ae-01445a1507c0 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:01.822397 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef553f9-2a67-4192-9a64-2981a7b3ee57 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:01.857289 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139f71c-8119-48b9-80ae-01445a1507c0 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:01.859117 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca15292-028c-4976-9b13-4eafa251fafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:01.860107 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca15292-028c-4976-9b13-4eafa251fafc None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:01.860228 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca15292-028c-4976-9b13-4eafa251fafc None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:01.860464 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca15292-028c-4976-9b13-4eafa251fafc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:01.871048 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca15292-028c-4976-9b13-4eafa251fafc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:01.879301 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-bca15292-028c-4976-9b13-4eafa251fafc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 15:01:01.879301 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:01.879301 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:01.879301 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:01.879301 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:01.879301 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:01.879301 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:01.879301 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:01.879301 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:01.879301 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:01.879301 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:01.879301 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:01.879301 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:01.879301 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:01.879301 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:01.879301 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:01.880160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:01.880160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:01.880160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:01.880160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:01.880160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:01.880160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:01.880160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:01.880160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:01.880160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:01.880160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:01.880160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:01.880160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:01.880160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:01.880160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:01.880160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:01.880160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:01.886284 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:01.886284 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:01.886284 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:01.886284 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:01.886284 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:01.886284 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:01.886284 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:01.886284 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:01.886284 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:01.886284 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:01.886284 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 15:01:01.886284 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:01.886284 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 151/302] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:01:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:01.886284 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca15292-028c-4976-9b13-4eafa251fafc None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:01.898653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a944f-189e-468f-9ec4-238e44204994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:01.899474 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a944f-189e-468f-9ec4-238e44204994 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:01.899737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a944f-189e-468f-9ec4-238e44204994 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:01.900013 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a944f-189e-468f-9ec4-238e44204994 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:01.901175 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a944f-189e-468f-9ec4-238e44204994 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:01.902673 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a944f-189e-468f-9ec4-238e44204994 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:01.909029 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 152/303] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:01.909029 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a944f-189e-468f-9ec4-238e44204994 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:01.991897 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca15292-028c-4976-9b13-4eafa251fafc None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:02.008317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a944f-189e-468f-9ec4-238e44204994 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:02.026905 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f42c9b-fea0-47d9-9b85-f0d6bfc9ff2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:02.027577 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f42c9b-fea0-47d9-9b85-f0d6bfc9ff2f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:02.027865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f42c9b-fea0-47d9-9b85-f0d6bfc9ff2f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:02.028143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f42c9b-fea0-47d9-9b85-f0d6bfc9ff2f None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:02.029267 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f42c9b-fea0-47d9-9b85-f0d6bfc9ff2f None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:02.029585 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f42c9b-fea0-47d9-9b85-f0d6bfc9ff2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:02.030998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f42c9b-fea0-47d9-9b85-f0d6bfc9ff2f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:02.038962 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 152/304] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:01:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:02.038962 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f42c9b-fea0-47d9-9b85-f0d6bfc9ff2f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:02.046545 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d316a0-2482-4473-881b-2959dea215d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:02.047415 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d316a0-2482-4473-881b-2959dea215d5 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:02.047847 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d316a0-2482-4473-881b-2959dea215d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:02.048267 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d316a0-2482-4473-881b-2959dea215d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:02.049163 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d316a0-2482-4473-881b-2959dea215d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:02.049611 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d316a0-2482-4473-881b-2959dea215d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:02.051173 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d316a0-2482-4473-881b-2959dea215d5 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:02.064344 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 153/305] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:01:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:02.064344 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d316a0-2482-4473-881b-2959dea215d5 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:02.140383 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f42c9b-fea0-47d9-9b85-f0d6bfc9ff2f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:02.159372 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d316a0-2482-4473-881b-2959dea215d5 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:02.173487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451a8d8-09b3-4331-b9e1-fd184d752b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:02.174176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451a8d8-09b3-4331-b9e1-fd184d752b5e None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:02.174469 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451a8d8-09b3-4331-b9e1-fd184d752b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:02.174750 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451a8d8-09b3-4331-b9e1-fd184d752b5e None admin] PATH_INFO: `/v3/groups` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:02.175441 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451a8d8-09b3-4331-b9e1-fd184d752b5e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:02.176893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451a8d8-09b3-4331-b9e1-fd184d752b5e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:02.190523 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f83a77-9265-4079-8dab-20a320eeacf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:02.191372 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f83a77-9265-4079-8dab-20a320eeacf4 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:02.191649 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f83a77-9265-4079-8dab-20a320eeacf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:02.191924 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f83a77-9265-4079-8dab-20a320eeacf4 None admin] PATH_INFO: `/v3/users/428c67b69e18423d922af8359fd1fceb` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:02.193084 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f83a77-9265-4079-8dab-20a320eeacf4 None admin] RBAC: Authorizing `identity:get_user(user_id=428c67b69e18423d922af8359fd1fceb)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:02.194544 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f83a77-9265-4079-8dab-20a320eeacf4 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:02.196148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 154/306] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:01:02 2022] GET /identity/v3/users/428c67b69e18423d922af8359fd1fceb => generated 293 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:02.199310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f83a77-9265-4079-8dab-20a320eeacf4 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:02.264066 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 153/307] 10.222.0.76 () {60 vars in 1134 bytes} [Mon May 16 15:01:02 2022] POST /identity/v3/groups => generated 229 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:01:02.265305 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568a080-d270-4b09-a2de-42524132f75f None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:02.265600 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568a080-d270-4b09-a2de-42524132f75f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:02.265877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568a080-d270-4b09-a2de-42524132f75f None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:02.270186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 154/308] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:02.270186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568a080-d270-4b09-a2de-42524132f75f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:02.294532 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f83a77-9265-4079-8dab-20a320eeacf4 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:02.329862 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce626c7-3b9d-482b-bfa8-386f3638d108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:02.331094 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce626c7-3b9d-482b-bfa8-386f3638d108 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:02.331366 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce626c7-3b9d-482b-bfa8-386f3638d108 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:02.331644 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce626c7-3b9d-482b-bfa8-386f3638d108 None admin] PATH_INFO: `/v3/users/d9388b165f7647e9a02a042eeed86d68` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:02.345865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce626c7-3b9d-482b-bfa8-386f3638d108 None admin] RBAC: Authorizing `identity:get_user(user_id=d9388b165f7647e9a02a042eeed86d68)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:02.347395 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce626c7-3b9d-482b-bfa8-386f3638d108 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:02.349341 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 155/309] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:01:02 2022] GET /identity/v3/users/d9388b165f7647e9a02a042eeed86d68 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:02.350441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94887f-ae1e-4c32-a3b7-5c932cdc85f6 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:02.350724 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94887f-ae1e-4c32-a3b7-5c932cdc85f6 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:02.350995 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94887f-ae1e-4c32-a3b7-5c932cdc85f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:02.369312 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0a94887f-ae1e-4c32-a3b7-5c932cdc85f6 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:02.370580 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0a94887f-ae1e-4c32-a3b7-5c932cdc85f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:02.384037 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568a080-d270-4b09-a2de-42524132f75f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:02.420789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8d7a7-df21-4efd-ba59-42926bf26a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:02.421670 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8d7a7-df21-4efd-ba59-42926bf26a4d None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:02.421959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8d7a7-df21-4efd-ba59-42926bf26a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:02.422273 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8d7a7-df21-4efd-ba59-42926bf26a4d None admin] PATH_INFO: `/v3/system/users/428c67b69e18423d922af8359fd1fceb/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:02.423859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8d7a7-df21-4efd-ba59-42926bf26a4d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=428c67b69e18423d922af8359fd1fceb, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:02.425297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8d7a7-df21-4efd-ba59-42926bf26a4d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:02.439929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 156/310] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:02.440896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94887f-ae1e-4c32-a3b7-5c932cdc85f6 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:02.538865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 155/311] 10.222.0.76 () {58 vars in 1334 bytes} [Mon May 16 15:01:02 2022] PUT /identity/v3/system/users/428c67b69e18423d922af8359fd1fceb/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:01:02.540035 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8d7a7-df21-4efd-ba59-42926bf26a4d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:02.548562 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94887f-ae1e-4c32-a3b7-5c932cdc85f6 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:02.591246 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c087a-b0c6-4f9f-80be-39e6e47724c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:02.592550 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c087a-b0c6-4f9f-80be-39e6e47724c1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:02.592835 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c087a-b0c6-4f9f-80be-39e6e47724c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:02.593109 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c087a-b0c6-4f9f-80be-39e6e47724c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:02.593965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c087a-b0c6-4f9f-80be-39e6e47724c1 None admin] RBAC: Adding query filter params (role.id=046c7400e19f4144be943daf291f32db, user.id=d9388b165f7647e9a02a042eeed86d68, scope.system=all) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:02.594361 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c087a-b0c6-4f9f-80be-39e6e47724c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:02.595920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c087a-b0c6-4f9f-80be-39e6e47724c1 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:02.602960 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 157/312] 10.222.0.76 () {56 vars in 1308 bytes} [Mon May 16 15:01:02 2022] GET /identity/v3/role_assignments?user.id=d9388b165f7647e9a02a042eeed86d68&scope.system=all&role.id=046c7400e19f4144be943daf291f32db => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:02.662074 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8d7a7-df21-4efd-ba59-42926bf26a4d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:02.703981 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aace32-71e6-4d62-9692-62d75f6174ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:02.704807 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aace32-71e6-4d62-9692-62d75f6174ac None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:02.705089 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aace32-71e6-4d62-9692-62d75f6174ac None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:02.705365 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aace32-71e6-4d62-9692-62d75f6174ac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:02.718642 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aace32-71e6-4d62-9692-62d75f6174ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:02.726686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e9aace32-71e6-4d62-9692-62d75f6174ac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 15:01:02.726686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:02.726686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:02.726686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:02.726686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:02.726686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:02.726686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:02.726686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:02.726686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:02.726686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:02.726686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:02.726686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:02.726686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:02.726686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:02.726686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:02.726686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:02.727654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:02.727654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:02.727654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:02.727654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:02.727654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:02.727654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:02.727654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:02.727654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:02.727654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:02.727654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:02.727654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:02.727654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:02.727654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:02.727654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:02.727654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:02.727654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:02.729079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:02.729079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:02.729079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:02.729079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:02.729079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:02.729079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:02.729079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:02.729079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:02.729079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:02.729079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:02.729079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 15:01:02.729079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:02.729079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 156/313] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:01:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:02.734839 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c087a-b0c6-4f9f-80be-39e6e47724c1 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:02.847125 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c087a-b0c6-4f9f-80be-39e6e47724c1 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:02.881286 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd99bda-d6f2-4968-81d9-276096aabc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:02.882249 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd99bda-d6f2-4968-81d9-276096aabc57 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:02.882526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd99bda-d6f2-4968-81d9-276096aabc57 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:02.882796 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd99bda-d6f2-4968-81d9-276096aabc57 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:02.883545 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd99bda-d6f2-4968-81d9-276096aabc57 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:02.883847 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd99bda-d6f2-4968-81d9-276096aabc57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:02.885223 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd99bda-d6f2-4968-81d9-276096aabc57 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:02.894715 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 158/314] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:01:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:02.899995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aace32-71e6-4d62-9692-62d75f6174ac None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:03.003356 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aace32-71e6-4d62-9692-62d75f6174ac None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:03.038220 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e0c7b-81b2-474e-9328-89f4644c6053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:03.039462 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e0c7b-81b2-474e-9328-89f4644c6053 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:03.039942 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e0c7b-81b2-474e-9328-89f4644c6053 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:03.040410 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e0c7b-81b2-474e-9328-89f4644c6053 None admin] PATH_INFO: `/v3/users/cc66748a9cf744d5b580cb8e77ca6a63` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:03.041820 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e0c7b-81b2-474e-9328-89f4644c6053 None admin] RBAC: Authorizing `identity:get_user(user_id=cc66748a9cf744d5b580cb8e77ca6a63)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:03.043487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e0c7b-81b2-474e-9328-89f4644c6053 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:03.050234 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 157/315] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:01:02 2022] GET /identity/v3/users/cc66748a9cf744d5b580cb8e77ca6a63 => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:03.051981 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd99bda-d6f2-4968-81d9-276096aabc57 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:03.178740 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd99bda-d6f2-4968-81d9-276096aabc57 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:03.216551 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e6e73-5f52-4bea-957c-8cd8562e4752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:03.217197 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e6e73-5f52-4bea-957c-8cd8562e4752 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:03.217477 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e6e73-5f52-4bea-957c-8cd8562e4752 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:03.217751 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e6e73-5f52-4bea-957c-8cd8562e4752 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:03.285154 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e6e73-5f52-4bea-957c-8cd8562e4752 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:03.286652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e6e73-5f52-4bea-957c-8cd8562e4752 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:03.390251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 159/316] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:01:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:01:03.391809 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e0c7b-81b2-474e-9328-89f4644c6053 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:03.515095 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e0c7b-81b2-474e-9328-89f4644c6053 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:03.567332 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f509a-69ed-4e46-a51a-ad8197c1ff65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:03.567332 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f509a-69ed-4e46-a51a-ad8197c1ff65 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:03.567332 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f509a-69ed-4e46-a51a-ad8197c1ff65 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:03.567332 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f509a-69ed-4e46-a51a-ad8197c1ff65 None admin] PATH_INFO: `/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:03.568101 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f509a-69ed-4e46-a51a-ad8197c1ff65 None admin] RBAC: Authorizing `identity:get_project(project_id=6ff53efad5ea4244a2a900acf4ee3f21)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:03.574147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f509a-69ed-4e46-a51a-ad8197c1ff65 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:03.578249 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 158/317] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:01:03 2022] GET /identity/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:03.580951 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e6e73-5f52-4bea-957c-8cd8562e4752 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:03.684181 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e6e73-5f52-4bea-957c-8cd8562e4752 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:03.719852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd31e7e-d886-4121-bc9c-30f418fc6ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:03.720531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd31e7e-d886-4121-bc9c-30f418fc6ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:03.720813 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd31e7e-d886-4121-bc9c-30f418fc6ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:03.721090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd31e7e-d886-4121-bc9c-30f418fc6ea2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:03.721941 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd31e7e-d886-4121-bc9c-30f418fc6ea2 None admin] RBAC: Adding query filter params (role.id=046c7400e19f4144be943daf291f32db, scope.project.id=6ff53efad5ea4244a2a900acf4ee3f21, user.id=cc66748a9cf744d5b580cb8e77ca6a63) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:03.722288 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd31e7e-d886-4121-bc9c-30f418fc6ea2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:03.723788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd31e7e-d886-4121-bc9c-30f418fc6ea2 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:03.730609 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 160/318] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:01:03 2022] GET /identity/v3/role_assignments?user.id=cc66748a9cf744d5b580cb8e77ca6a63&scope.project.id=6ff53efad5ea4244a2a900acf4ee3f21&role.id=046c7400e19f4144be943daf291f32db => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:04.588144 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44715fe5-d91e-48dc-aded-02bfc80cda85 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:04.588523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44715fe5-d91e-48dc-aded-02bfc80cda85 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:04.588714 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44715fe5-d91e-48dc-aded-02bfc80cda85 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:04.590073 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 159/319] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:04.595436 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68682d57-991b-491e-ad7f-6c0b4eefa965 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:04.595861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68682d57-991b-491e-ad7f-6c0b4eefa965 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:04.595975 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68682d57-991b-491e-ad7f-6c0b4eefa965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:04.612674 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-68682d57-991b-491e-ad7f-6c0b4eefa965 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:04.613832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-68682d57-991b-491e-ad7f-6c0b4eefa965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:04.682358 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 161/320] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:04.704940 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44715fe5-d91e-48dc-aded-02bfc80cda85 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:04.805295 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44715fe5-d91e-48dc-aded-02bfc80cda85 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:04.837042 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dee470-47a5-48e7-9d00-e16ace13a7da None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:04.837251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dee470-47a5-48e7-9d00-e16ace13a7da None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:04.837375 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a806f-35c0-4f30-9780-07f61de2e967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:04.837860 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dee470-47a5-48e7-9d00-e16ace13a7da None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:04.838169 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a806f-35c0-4f30-9780-07f61de2e967 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:04.838454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a806f-35c0-4f30-9780-07f61de2e967 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:04.838728 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a806f-35c0-4f30-9780-07f61de2e967 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:04.839560 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 162/321] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:01:04.839873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a806f-35c0-4f30-9780-07f61de2e967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:04.841869 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a806f-35c0-4f30-9780-07f61de2e967 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:04.843627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 160/322] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:04.845728 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2f1f1-dec3-4909-a22a-9e2c9a9e4b02 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:04.846007 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2f1f1-dec3-4909-a22a-9e2c9a9e4b02 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:04.846334 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2f1f1-dec3-4909-a22a-9e2c9a9e4b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:04.849481 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a806f-35c0-4f30-9780-07f61de2e967 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:04.863619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d7b2f1f1-dec3-4909-a22a-9e2c9a9e4b02 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:04.864792 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d7b2f1f1-dec3-4909-a22a-9e2c9a9e4b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:04.929814 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 163/323] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:01:04.931717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624e422-b5c5-4afc-a59c-83062eb6ed86 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:04.932010 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624e422-b5c5-4afc-a59c-83062eb6ed86 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:04.932297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624e422-b5c5-4afc-a59c-83062eb6ed86 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:04.933592 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 164/324] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:04.939296 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16ef1c-ba72-4ffa-96a5-daaffb138fd9 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:04.939589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16ef1c-ba72-4ffa-96a5-daaffb138fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:04.939888 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16ef1c-ba72-4ffa-96a5-daaffb138fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:04.953146 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a806f-35c0-4f30-9780-07f61de2e967 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:04.956408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9e16ef1c-ba72-4ffa-96a5-daaffb138fd9 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:04.957595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9e16ef1c-ba72-4ffa-96a5-daaffb138fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:04.984591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd431c4-b9f9-418d-bd24-7965b48b0680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:04.985243 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd431c4-b9f9-418d-bd24-7965b48b0680 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:04.985527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd431c4-b9f9-418d-bd24-7965b48b0680 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:04.985804 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd431c4-b9f9-418d-bd24-7965b48b0680 None admin] PATH_INFO: `/v3/groups` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:04.986519 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd431c4-b9f9-418d-bd24-7965b48b0680 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:04.987974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd431c4-b9f9-418d-bd24-7965b48b0680 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:05.021260 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 165/325] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:01:05.022354 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16ef1c-ba72-4ffa-96a5-daaffb138fd9 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:05.090246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 161/326] 10.222.0.76 () {60 vars in 1134 bytes} [Mon May 16 15:01:04 2022] POST /identity/v3/groups => generated 226 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:01:05.090246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd431c4-b9f9-418d-bd24-7965b48b0680 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:05.120722 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16ef1c-ba72-4ffa-96a5-daaffb138fd9 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:05.157537 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f7441-c468-4570-9cfc-acc4234198b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:05.158383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f7441-c468-4570-9cfc-acc4234198b8 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:05.158667 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f7441-c468-4570-9cfc-acc4234198b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:05.158943 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f7441-c468-4570-9cfc-acc4234198b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:05.170705 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f7441-c468-4570-9cfc-acc4234198b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:05.178635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-7f4f7441-c468-4570-9cfc-acc4234198b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 15:01:05.178635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:05.178635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:05.178635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:05.178635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:05.178635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:05.178635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:05.178635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:05.178635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:05.178635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:05.178635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:05.178635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:05.178635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:05.178635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:05.178635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:05.178635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:05.179620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:05.179620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:05.179620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:05.179620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:05.179620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:05.179620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:05.179620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:05.179620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:05.179620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:05.179620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:05.179620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:05.179620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:05.179620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:05.179620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:05.179620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:05.179620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:05.180393 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:05.180393 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:05.180393 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:05.180393 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:05.180393 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:05.180393 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:05.180393 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:05.180393 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:05.180393 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:05.180393 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:05.180393 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 15:01:05.180393 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:05.180393 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 166/327] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:01:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:05.186058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f7441-c468-4570-9cfc-acc4234198b8 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:05.190085 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd431c4-b9f9-418d-bd24-7965b48b0680 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:05.228491 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa12fd-2b53-4f98-bef1-783a113e5010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:05.229627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa12fd-2b53-4f98-bef1-783a113e5010 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:05.229904 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa12fd-2b53-4f98-bef1-783a113e5010 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:05.230269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa12fd-2b53-4f98-bef1-783a113e5010 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:05.241808 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa12fd-2b53-4f98-bef1-783a113e5010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:05.249586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-2baa12fd-2b53-4f98-bef1-783a113e5010 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 15:01:05.249586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:05.249586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:05.249586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:05.249586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:05.249586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:05.249586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:05.249586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:05.249586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:05.249586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:05.249586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:05.249586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:05.249586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:05.249586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:05.249586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:05.249586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:05.250542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:05.250542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:05.250542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:05.250542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:05.250542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:05.250542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:05.250542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:05.250542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:05.250542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:05.250542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:05.250542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:05.250542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:05.250542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:05.250542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:05.250542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:05.250542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:05.256405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:05.256405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:05.256405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:05.256405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:05.256405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:05.256405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:05.256405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:05.256405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:05.256405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:05.256405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:05.256405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 15:01:05.256405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:05.256405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 162/328] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:01:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:05.257414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa12fd-2b53-4f98-bef1-783a113e5010 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:05.295964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f7441-c468-4570-9cfc-acc4234198b8 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:05.334536 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc41f41-d738-4a64-8ee6-55a65e74ce40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:05.335209 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc41f41-d738-4a64-8ee6-55a65e74ce40 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:05.335491 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc41f41-d738-4a64-8ee6-55a65e74ce40 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:05.335764 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc41f41-d738-4a64-8ee6-55a65e74ce40 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:05.336579 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc41f41-d738-4a64-8ee6-55a65e74ce40 None admin] RBAC: Adding query filter params (name=member) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:05.336889 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc41f41-d738-4a64-8ee6-55a65e74ce40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:05.338773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc41f41-d738-4a64-8ee6-55a65e74ce40 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:05.354367 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 167/329] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:01:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:05.357994 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc41f41-d738-4a64-8ee6-55a65e74ce40 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:05.362487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa12fd-2b53-4f98-bef1-783a113e5010 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:05.399371 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3c112-3923-432d-a42a-bc5e51bc8042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:05.400053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3c112-3923-432d-a42a-bc5e51bc8042 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:05.400339 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3c112-3923-432d-a42a-bc5e51bc8042 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:05.400620 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3c112-3923-432d-a42a-bc5e51bc8042 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:05.402219 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3c112-3923-432d-a42a-bc5e51bc8042 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:05.402537 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3c112-3923-432d-a42a-bc5e51bc8042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:05.404524 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3c112-3923-432d-a42a-bc5e51bc8042 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:05.415264 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 163/330] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:01:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:05.421199 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3c112-3923-432d-a42a-bc5e51bc8042 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:05.476072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc41f41-d738-4a64-8ee6-55a65e74ce40 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:05.514725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9e4b3-6b13-4fb2-8663-a563781b8548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:05.515808 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9e4b3-6b13-4fb2-8663-a563781b8548 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:05.515927 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9e4b3-6b13-4fb2-8663-a563781b8548 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:05.516201 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9e4b3-6b13-4fb2-8663-a563781b8548 None admin] PATH_INFO: `/v3/users/428c67b69e18423d922af8359fd1fceb` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:05.517463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9e4b3-6b13-4fb2-8663-a563781b8548 None admin] RBAC: Authorizing `identity:get_user(user_id=428c67b69e18423d922af8359fd1fceb)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:05.519004 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9e4b3-6b13-4fb2-8663-a563781b8548 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:05.520713 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 168/331] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:01:05 2022] GET /identity/v3/users/428c67b69e18423d922af8359fd1fceb => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:05.525839 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3c112-3923-432d-a42a-bc5e51bc8042 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:05.526459 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9e4b3-6b13-4fb2-8663-a563781b8548 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:05.561819 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68857d-46ae-46da-9f65-e1c89d2e49c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:05.563081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68857d-46ae-46da-9f65-e1c89d2e49c3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:05.563616 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68857d-46ae-46da-9f65-e1c89d2e49c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:05.564094 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68857d-46ae-46da-9f65-e1c89d2e49c3 None admin] PATH_INFO: `/v3/users/d9388b165f7647e9a02a042eeed86d68` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:05.565548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68857d-46ae-46da-9f65-e1c89d2e49c3 None admin] RBAC: Authorizing `identity:get_user(user_id=d9388b165f7647e9a02a042eeed86d68)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:05.567253 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68857d-46ae-46da-9f65-e1c89d2e49c3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:05.569438 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 164/332] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:01:05 2022] GET /identity/v3/users/d9388b165f7647e9a02a042eeed86d68 => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:05.574567 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68857d-46ae-46da-9f65-e1c89d2e49c3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:05.646268 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9e4b3-6b13-4fb2-8663-a563781b8548 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:05.681284 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3e3b4-f7ab-4b8d-8451-3208b91ff951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:05.681950 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e3b4-f7ab-4b8d-8451-3208b91ff951 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:05.682264 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e3b4-f7ab-4b8d-8451-3208b91ff951 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:05.682539 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e3b4-f7ab-4b8d-8451-3208b91ff951 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:05.683385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3e3b4-f7ab-4b8d-8451-3208b91ff951 None admin] RBAC: Adding query filter params (role.id=0e00f6ebfc2843a0992b3d01f50e262d, user.id=428c67b69e18423d922af8359fd1fceb, scope.system=all) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:05.683694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3e3b4-f7ab-4b8d-8451-3208b91ff951 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:05.685163 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3e3b4-f7ab-4b8d-8451-3208b91ff951 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:05.686588 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68857d-46ae-46da-9f65-e1c89d2e49c3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:05.697871 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 169/333] 10.222.0.76 () {56 vars in 1308 bytes} [Mon May 16 15:01:05 2022] GET /identity/v3/role_assignments?user.id=428c67b69e18423d922af8359fd1fceb&scope.system=all&role.id=0e00f6ebfc2843a0992b3d01f50e262d => generated 510 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:05.733491 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535be6f2-8862-4f08-82ce-d199e4cc657f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:05.734415 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535be6f2-8862-4f08-82ce-d199e4cc657f None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:05.734700 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535be6f2-8862-4f08-82ce-d199e4cc657f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:05.734982 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535be6f2-8862-4f08-82ce-d199e4cc657f None admin] PATH_INFO: `/v3/system/users/d9388b165f7647e9a02a042eeed86d68/roles/046c7400e19f4144be943daf291f32db` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:05.736588 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535be6f2-8862-4f08-82ce-d199e4cc657f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d9388b165f7647e9a02a042eeed86d68, role_id=046c7400e19f4144be943daf291f32db)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:05.738018 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535be6f2-8862-4f08-82ce-d199e4cc657f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:05.844520 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 165/334] 10.222.0.76 () {58 vars in 1334 bytes} [Mon May 16 15:01:05 2022] PUT /identity/v3/system/users/d9388b165f7647e9a02a042eeed86d68/roles/046c7400e19f4144be943daf291f32db => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:01:07.930379 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f74a9-a701-42c5-8bb6-85351244b348 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:07.931067 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f74a9-a701-42c5-8bb6-85351244b348 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:07.931067 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f74a9-a701-42c5-8bb6-85351244b348 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:07.932291 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 170/335] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:07.943713 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c05947-c4c3-4e61-af69-569e9414ad62 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:07.944255 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c05947-c4c3-4e61-af69-569e9414ad62 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:07.944255 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c05947-c4c3-4e61-af69-569e9414ad62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:07.982249 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-85c05947-c4c3-4e61-af69-569e9414ad62 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:07.983437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-85c05947-c4c3-4e61-af69-569e9414ad62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:07.990529 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ce92f-fb19-4bcd-8f8f-11381995d628 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:07.991315 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ce92f-fb19-4bcd-8f8f-11381995d628 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:07.991986 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ce92f-fb19-4bcd-8f8f-11381995d628 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:07.996349 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 171/336] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:08.016062 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500ec9b-2b63-43ad-b61d-f594f3a67f4d None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:08.016866 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500ec9b-2b63-43ad-b61d-f594f3a67f4d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:08.017574 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500ec9b-2b63-43ad-b61d-f594f3a67f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:08.046014 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5500ec9b-2b63-43ad-b61d-f594f3a67f4d None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:08.054151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5500ec9b-2b63-43ad-b61d-f594f3a67f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:08.084707 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 166/337] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:01:08.125998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c05947-c4c3-4e61-af69-569e9414ad62 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:08.152038 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 172/338] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:01:08.188270 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500ec9b-2b63-43ad-b61d-f594f3a67f4d None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:08.305039 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c05947-c4c3-4e61-af69-569e9414ad62 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:08.362710 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500ec9b-2b63-43ad-b61d-f594f3a67f4d None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:08.377277 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07aebd-4a10-4c19-8862-a436920ceaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:08.378094 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07aebd-4a10-4c19-8862-a436920ceaa3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:08.378418 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07aebd-4a10-4c19-8862-a436920ceaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:08.378690 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07aebd-4a10-4c19-8862-a436920ceaa3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:08.402419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07aebd-4a10-4c19-8862-a436920ceaa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:08.411108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-8b07aebd-4a10-4c19-8862-a436920ceaa3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 15:01:08.411108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:08.411108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:08.411108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:08.411108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:08.411108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:08.411108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:08.411108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:08.411108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:08.411108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:08.411108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:08.411108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:08.411108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:08.411108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:08.411108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:08.411108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:08.412070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:08.412070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:08.412070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:08.412070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:08.412070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:08.412070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:08.412070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:08.412070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:08.412070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:08.412070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:08.412070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:08.412070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:08.412070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:08.412070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:08.412070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:08.412070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:08.412851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:08.412851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:08.412851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:08.412851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:08.412851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:08.412851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:08.412851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:08.412851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:08.412851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:08.412851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:08.412851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 15:01:08.412851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:08.422672 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 167/339] 10.222.0.76 () {56 vars in 1114 bytes} [Mon May 16 15:01:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:08.423577 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07aebd-4a10-4c19-8862-a436920ceaa3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:08.435810 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22282d-ba82-45c7-a30d-8a1f835bc335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:08.436639 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22282d-ba82-45c7-a30d-8a1f835bc335 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:08.436912 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22282d-ba82-45c7-a30d-8a1f835bc335 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:08.437181 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22282d-ba82-45c7-a30d-8a1f835bc335 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:08.452969 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22282d-ba82-45c7-a30d-8a1f835bc335 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:08.460730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-1c22282d-ba82-45c7-a30d-8a1f835bc335 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 15:01:08.460730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:08.460730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:08.460730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:08.460730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:08.460730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:08.460730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:08.460730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:08.460730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:08.460730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:08.460730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:08.460730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:08.460730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:08.460730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:08.460730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:08.460730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:08.462075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:08.462075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:08.462075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:08.462075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:08.462075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:08.462075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:08.462075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:08.462075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:08.462075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:08.462075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:08.462075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:08.462075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:08.462075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:08.462075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:08.462075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:08.462075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:08.463304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:08.463304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:08.463304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:08.463304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:08.463304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:08.463304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:08.463304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:08.463304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:08.463304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:08.463304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:08.463304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 15:01:08.463304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:08.463304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 173/340] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:01:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:01:08.470667 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22282d-ba82-45c7-a30d-8a1f835bc335 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:08.623332 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22282d-ba82-45c7-a30d-8a1f835bc335 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:08.665921 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e920777-ad1a-4bdb-b428-5991905b6dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:08.666626 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e920777-ad1a-4bdb-b428-5991905b6dfa None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:08.666905 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e920777-ad1a-4bdb-b428-5991905b6dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:08.667178 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e920777-ad1a-4bdb-b428-5991905b6dfa None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:08.667929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e920777-ad1a-4bdb-b428-5991905b6dfa None admin] RBAC: Adding query filter params (name=member) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:08.668232 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e920777-ad1a-4bdb-b428-5991905b6dfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:08.670731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e920777-ad1a-4bdb-b428-5991905b6dfa None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:08.679709 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 174/341] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:01:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:08.685305 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e920777-ad1a-4bdb-b428-5991905b6dfa None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:08.689296 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07aebd-4a10-4c19-8862-a436920ceaa3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:08.755539 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1df1c9-d21e-43a8-87a0-c81db422dba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:08.756130 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1df1c9-d21e-43a8-87a0-c81db422dba6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:08.756677 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1df1c9-d21e-43a8-87a0-c81db422dba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:08.756952 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1df1c9-d21e-43a8-87a0-c81db422dba6 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:08.757801 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1df1c9-d21e-43a8-87a0-c81db422dba6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:08.758112 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1df1c9-d21e-43a8-87a0-c81db422dba6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:08.759543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1df1c9-d21e-43a8-87a0-c81db422dba6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:08.774777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 168/342] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:08.780901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1df1c9-d21e-43a8-87a0-c81db422dba6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:08.814980 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e920777-ad1a-4bdb-b428-5991905b6dfa None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:08.886849 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51768fcc-3f05-4198-89b2-40bff069a003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:08.887518 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51768fcc-3f05-4198-89b2-40bff069a003 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:08.888408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51768fcc-3f05-4198-89b2-40bff069a003 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:08.888689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51768fcc-3f05-4198-89b2-40bff069a003 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:08.932091 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1df1c9-d21e-43a8-87a0-c81db422dba6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:08.970141 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc77698-6340-4357-9f9a-d271caf81604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:08.970915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc77698-6340-4357-9f9a-d271caf81604 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:08.971104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc77698-6340-4357-9f9a-d271caf81604 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:08.971379 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc77698-6340-4357-9f9a-d271caf81604 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:09.025843 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51768fcc-3f05-4198-89b2-40bff069a003 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:09.027282 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51768fcc-3f05-4198-89b2-40bff069a003 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:09.045566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc77698-6340-4357-9f9a-d271caf81604 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:09.047072 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc77698-6340-4357-9f9a-d271caf81604 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:09.152605 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 169/343] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:01:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 15:01:09.154571 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d00dfc-90d4-4707-a18c-f82199082ece None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:09.154858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d00dfc-90d4-4707-a18c-f82199082ece None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:09.155150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d00dfc-90d4-4707-a18c-f82199082ece None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:09.156671 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 170/344] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:09.158606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d00dfc-90d4-4707-a18c-f82199082ece None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:09.245045 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 175/345] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:01:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:01:09.246427 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e75502-82a5-4cab-a9b3-ec6cf52a700f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:09.246718 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e75502-82a5-4cab-a9b3-ec6cf52a700f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:09.247021 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e75502-82a5-4cab-a9b3-ec6cf52a700f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:09.269631 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d00dfc-90d4-4707-a18c-f82199082ece None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:09.272818 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-e2e75502-82a5-4cab-a9b3-ec6cf52a700f None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:09.274004 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e2e75502-82a5-4cab-a9b3-ec6cf52a700f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:09.307795 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3acc1-cb0c-4230-aee9-7c6bd29cba53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:09.308872 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3acc1-cb0c-4230-aee9-7c6bd29cba53 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:09.309156 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3acc1-cb0c-4230-aee9-7c6bd29cba53 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:09.309436 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3acc1-cb0c-4230-aee9-7c6bd29cba53 None admin] PATH_INFO: `/v3/projects/21716abeaba940d1bdae0c660acc6bc5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:09.310800 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3acc1-cb0c-4230-aee9-7c6bd29cba53 None admin] RBAC: Authorizing `identity:get_project(project_id=21716abeaba940d1bdae0c660acc6bc5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:09.312721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3acc1-cb0c-4230-aee9-7c6bd29cba53 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:09.314458 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 171/346] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:01:09 2022] GET /identity/v3/projects/21716abeaba940d1bdae0c660acc6bc5 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:09.315232 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3acc1-cb0c-4230-aee9-7c6bd29cba53 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:09.393183 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 176/347] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:09.394412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e75502-82a5-4cab-a9b3-ec6cf52a700f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:09.453096 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3acc1-cb0c-4230-aee9-7c6bd29cba53 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:09.500747 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07090412-5b6a-476b-ab08-5f4e1a8032f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:09.503229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07090412-5b6a-476b-ab08-5f4e1a8032f7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:09.503768 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07090412-5b6a-476b-ab08-5f4e1a8032f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:09.504704 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07090412-5b6a-476b-ab08-5f4e1a8032f7 None admin] PATH_INFO: `/v3/projects/21716abeaba940d1bdae0c660acc6bc5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:09.506749 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07090412-5b6a-476b-ab08-5f4e1a8032f7 None admin] RBAC: Authorizing `identity:get_project(project_id=21716abeaba940d1bdae0c660acc6bc5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:09.509125 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07090412-5b6a-476b-ab08-5f4e1a8032f7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:09.514364 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 172/348] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:01:09 2022] GET /identity/v3/projects/21716abeaba940d1bdae0c660acc6bc5 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:09.515570 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d3123-08a3-4fcb-a5d3-9b278feb0acf None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:09.515855 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d3123-08a3-4fcb-a5d3-9b278feb0acf None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:09.516129 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d3123-08a3-4fcb-a5d3-9b278feb0acf None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:09.518559 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 173/349] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:09.519207 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d3123-08a3-4fcb-a5d3-9b278feb0acf None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:09.522644 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e75502-82a5-4cab-a9b3-ec6cf52a700f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:09.574401 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687f998-5a74-4b45-acd5-d29171925204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:09.575218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687f998-5a74-4b45-acd5-d29171925204 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:09.575497 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687f998-5a74-4b45-acd5-d29171925204 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:09.575769 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687f998-5a74-4b45-acd5-d29171925204 None admin] PATH_INFO: `/v3/groups/c7ccd8ad94de4afb8df700ca9e94b2d9` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:09.586471 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687f998-5a74-4b45-acd5-d29171925204 None admin] RBAC: Authorizing `identity:get_group(group_id=c7ccd8ad94de4afb8df700ca9e94b2d9)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:09.589229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687f998-5a74-4b45-acd5-d29171925204 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:09.592392 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 177/350] 10.222.0.76 () {56 vars in 1180 bytes} [Mon May 16 15:01:09 2022] GET /identity/v3/groups/c7ccd8ad94de4afb8df700ca9e94b2d9 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:09.593705 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687f998-5a74-4b45-acd5-d29171925204 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:09.664001 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d3123-08a3-4fcb-a5d3-9b278feb0acf None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:09.706828 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1326c6e-8e7b-47e9-9d8f-17ed141c3a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:09.707623 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1326c6e-8e7b-47e9-9d8f-17ed141c3a6a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:09.707900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1326c6e-8e7b-47e9-9d8f-17ed141c3a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:09.708170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1326c6e-8e7b-47e9-9d8f-17ed141c3a6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:09.721142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1326c6e-8e7b-47e9-9d8f-17ed141c3a6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:09.727328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687f998-5a74-4b45-acd5-d29171925204 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:09.729401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-c1326c6e-8e7b-47e9-9d8f-17ed141c3a6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 15:01:09.729401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:09.729401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:09.729401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:09.729401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:09.729401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:09.729401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:09.729401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:09.729401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:09.729401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:09.729401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:09.729401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:09.729401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:09.729401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:09.729401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:09.729401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:09.730496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:09.730496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:09.730496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:09.730496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:09.730496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:09.730496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:09.730496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:09.730496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:09.730496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:09.730496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:09.730496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:09.730496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:09.730496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:09.730496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:09.730496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:09.730496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:09.731331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:09.731331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:09.731331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:09.731331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:09.731331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:09.731331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:09.731331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:09.731331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:09.731331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:09.731331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:09.731331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 15:01:09.731331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:09.733611 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 174/351] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:01:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:09.735247 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ff1ea-b98f-46e4-91e2-09258465ab92 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:09.735767 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ff1ea-b98f-46e4-91e2-09258465ab92 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:09.736236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ff1ea-b98f-46e4-91e2-09258465ab92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:09.755076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c51ff1ea-b98f-46e4-91e2-09258465ab92 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:09.756898 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c51ff1ea-b98f-46e4-91e2-09258465ab92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:09.774145 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc56e5-30c2-41d4-8e58-241c08daadd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:09.775233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc56e5-30c2-41d4-8e58-241c08daadd4 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:09.775526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc56e5-30c2-41d4-8e58-241c08daadd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:09.775783 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc56e5-30c2-41d4-8e58-241c08daadd4 None admin] PATH_INFO: `/v3/groups/c7ccd8ad94de4afb8df700ca9e94b2d9` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:09.776989 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc56e5-30c2-41d4-8e58-241c08daadd4 None admin] RBAC: Authorizing `identity:get_group(group_id=c7ccd8ad94de4afb8df700ca9e94b2d9)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:09.778893 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc56e5-30c2-41d4-8e58-241c08daadd4 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:09.780344 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 178/352] 10.222.0.76 () {56 vars in 1180 bytes} [Mon May 16 15:01:09 2022] GET /identity/v3/groups/c7ccd8ad94de4afb8df700ca9e94b2d9 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:09.780987 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc56e5-30c2-41d4-8e58-241c08daadd4 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:09.854587 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 175/353] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:09.855651 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa914bea-c29b-4d7e-bbd0-b1c56e980d9e None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:09.855940 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa914bea-c29b-4d7e-bbd0-b1c56e980d9e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:09.856219 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa914bea-c29b-4d7e-bbd0-b1c56e980d9e None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:09.858370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 176/354] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:09.859345 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa914bea-c29b-4d7e-bbd0-b1c56e980d9e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:09.905464 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc56e5-30c2-41d4-8e58-241c08daadd4 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:09.949941 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507349f-b991-4f16-a3c3-964fc1621bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:09.951602 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507349f-b991-4f16-a3c3-964fc1621bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:09.952087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507349f-b991-4f16-a3c3-964fc1621bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:09.952563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507349f-b991-4f16-a3c3-964fc1621bd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:09.953648 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507349f-b991-4f16-a3c3-964fc1621bd5 None admin] RBAC: Adding query filter params (group.id=c7ccd8ad94de4afb8df700ca9e94b2d9, role.id=00ecc8471dbb4296b40c8b8c0b29aedd, scope.project.id=21716abeaba940d1bdae0c660acc6bc5) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:09.954195 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507349f-b991-4f16-a3c3-964fc1621bd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:09.955871 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507349f-b991-4f16-a3c3-964fc1621bd5 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:09.962191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 179/355] 10.222.0.76 () {56 vars in 1376 bytes} [Mon May 16 15:01:09 2022] GET /identity/v3/role_assignments?group.id=c7ccd8ad94de4afb8df700ca9e94b2d9&scope.project.id=21716abeaba940d1bdae0c660acc6bc5&role.id=00ecc8471dbb4296b40c8b8c0b29aedd => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:09.962982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507349f-b991-4f16-a3c3-964fc1621bd5 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:09.989012 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa914bea-c29b-4d7e-bbd0-b1c56e980d9e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:10.029544 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd477a-ec32-471d-ba17-3841a3c0aed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:10.030263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd477a-ec32-471d-ba17-3841a3c0aed9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:10.030550 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd477a-ec32-471d-ba17-3841a3c0aed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:10.030832 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd477a-ec32-471d-ba17-3841a3c0aed9 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:10.031609 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd477a-ec32-471d-ba17-3841a3c0aed9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:10.031918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd477a-ec32-471d-ba17-3841a3c0aed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:10.033602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd477a-ec32-471d-ba17-3841a3c0aed9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:10.044720 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 177/356] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:01:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:10.046063 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e4af6-f57d-4d18-8005-762c20220439 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:10.046395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e4af6-f57d-4d18-8005-762c20220439 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:10.046677 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e4af6-f57d-4d18-8005-762c20220439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:10.065608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-eb5e4af6-f57d-4d18-8005-762c20220439 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:10.066978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-eb5e4af6-f57d-4d18-8005-762c20220439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:10.082356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507349f-b991-4f16-a3c3-964fc1621bd5 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:10.120796 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce4191-06c0-484a-97ad-74090eed52f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:10.121861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce4191-06c0-484a-97ad-74090eed52f2 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:10.122936 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce4191-06c0-484a-97ad-74090eed52f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:10.123435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce4191-06c0-484a-97ad-74090eed52f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:10.124502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce4191-06c0-484a-97ad-74090eed52f2 None admin] RBAC: Adding query filter params (group.id=c7ccd8ad94de4afb8df700ca9e94b2d9, role.id=0e00f6ebfc2843a0992b3d01f50e262d, scope.project.id=21716abeaba940d1bdae0c660acc6bc5) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:10.125064 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce4191-06c0-484a-97ad-74090eed52f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:10.126786 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce4191-06c0-484a-97ad-74090eed52f2 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:10.133833 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 180/357] 10.222.0.76 () {56 vars in 1376 bytes} [Mon May 16 15:01:09 2022] GET /identity/v3/role_assignments?group.id=c7ccd8ad94de4afb8df700ca9e94b2d9&scope.project.id=21716abeaba940d1bdae0c660acc6bc5&role.id=0e00f6ebfc2843a0992b3d01f50e262d => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:10.135111 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce4191-06c0-484a-97ad-74090eed52f2 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:10.142898 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 178/358] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:10.143828 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e4af6-f57d-4d18-8005-762c20220439 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:10.263689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce4191-06c0-484a-97ad-74090eed52f2 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:10.288918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e4af6-f57d-4d18-8005-762c20220439 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:10.302189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8896d-b7a5-46b6-84f6-db473a2950f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:10.303403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8896d-b7a5-46b6-84f6-db473a2950f0 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:10.303889 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8896d-b7a5-46b6-84f6-db473a2950f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:10.304419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8896d-b7a5-46b6-84f6-db473a2950f0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:10.319567 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8896d-b7a5-46b6-84f6-db473a2950f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:10.327600 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-97e8896d-b7a5-46b6-84f6-db473a2950f0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 15:01:10.327600 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:10.327600 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:10.327600 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:10.327600 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:10.327600 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:10.327600 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:10.327600 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:10.327600 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:10.327600 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:10.327600 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:10.327600 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:10.327600 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:10.327600 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:10.327600 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:10.327600 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:10.328589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:10.328589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:10.328589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:10.328589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:10.328589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:10.328589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:10.328589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:10.328589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:10.328589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:10.328589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:10.328589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:10.328589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:10.328589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:10.328589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:10.328589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:10.328589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:10.329408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:10.329408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:10.329408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:10.329408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:10.329408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:10.329408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:10.329408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:10.329408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:10.329408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:10.329408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:10.329408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 15:01:10.329408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:10.329408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 181/359] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:01:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:10.330617 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2b13f-4753-4245-b3ae-7e979d3a557f None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:10.330906 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2b13f-4753-4245-b3ae-7e979d3a557f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:10.331271 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2b13f-4753-4245-b3ae-7e979d3a557f None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:10.332684 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 182/360] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:10.333191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2b13f-4753-4245-b3ae-7e979d3a557f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:10.338473 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b72ce6-1660-462d-9206-81533a40413f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:10.340303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b72ce6-1660-462d-9206-81533a40413f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:10.341327 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b72ce6-1660-462d-9206-81533a40413f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:10.341781 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b72ce6-1660-462d-9206-81533a40413f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:10.425904 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b72ce6-1660-462d-9206-81533a40413f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:10.428605 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b72ce6-1660-462d-9206-81533a40413f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:10.463195 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2b13f-4753-4245-b3ae-7e979d3a557f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:10.508098 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b51f40-59f0-49ba-b751-71a7fe396f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:10.509020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b51f40-59f0-49ba-b751-71a7fe396f0b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:10.509374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b51f40-59f0-49ba-b751-71a7fe396f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:10.509721 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b51f40-59f0-49ba-b751-71a7fe396f0b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:10.522770 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b51f40-59f0-49ba-b751-71a7fe396f0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:10.533299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-04b51f40-59f0-49ba-b751-71a7fe396f0b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 15:01:10.533299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:10.533299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:10.533299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:10.533299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:10.533299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:10.533299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:10.533299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:10.533299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:10.533299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:10.533299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:10.533299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:10.533299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:10.533299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:10.533299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:10.533299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:10.534260 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:10.534260 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:10.534260 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:10.534260 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:10.534260 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:10.534260 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:10.534260 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:10.534260 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:10.534260 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:10.534260 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:10.534260 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:10.534260 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:10.534260 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:10.534260 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:10.534260 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:10.534260 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:10.535086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:10.535086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:10.535086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:10.535086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:10.535086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:10.535086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:10.535086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:10.535086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:10.535086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:10.535086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:10.535086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 15:01:10.535086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:10.535086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 183/361] 10.222.0.76 () {56 vars in 1114 bytes} [Mon May 16 15:01:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:10.535744 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b51f40-59f0-49ba-b751-71a7fe396f0b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:10.547646 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 179/362] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:01:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:01:10.550058 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15377001-8e68-4ace-8367-71a2815c3267 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:10.550583 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15377001-8e68-4ace-8367-71a2815c3267 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:10.551038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15377001-8e68-4ace-8367-71a2815c3267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:10.574553 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-15377001-8e68-4ace-8367-71a2815c3267 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:10.576645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-15377001-8e68-4ace-8367-71a2815c3267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:10.655887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 180/363] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:10.656505 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15377001-8e68-4ace-8367-71a2815c3267 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:10.677684 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b51f40-59f0-49ba-b751-71a7fe396f0b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:10.739014 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4a248-aabb-4e5f-beb8-212b70548364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:10.740031 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4a248-aabb-4e5f-beb8-212b70548364 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:10.740449 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4a248-aabb-4e5f-beb8-212b70548364 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:10.740866 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4a248-aabb-4e5f-beb8-212b70548364 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:10.742033 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4a248-aabb-4e5f-beb8-212b70548364 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:10.742528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4a248-aabb-4e5f-beb8-212b70548364 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:10.746117 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4a248-aabb-4e5f-beb8-212b70548364 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:10.762358 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 184/364] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:01:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:10.763257 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4a248-aabb-4e5f-beb8-212b70548364 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:10.775315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15377001-8e68-4ace-8367-71a2815c3267 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:10.818438 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5cff23-4be6-4566-bc4a-5b2726971b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:10.819415 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5cff23-4be6-4566-bc4a-5b2726971b29 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:10.819700 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5cff23-4be6-4566-bc4a-5b2726971b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:10.820033 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5cff23-4be6-4566-bc4a-5b2726971b29 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:10.820797 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5cff23-4be6-4566-bc4a-5b2726971b29 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:10.821105 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5cff23-4be6-4566-bc4a-5b2726971b29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:10.823248 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5cff23-4be6-4566-bc4a-5b2726971b29 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:10.833837 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 181/365] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:10.834612 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5cff23-4be6-4566-bc4a-5b2726971b29 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:10.898257 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4a248-aabb-4e5f-beb8-212b70548364 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:10.938836 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b52aca-e803-47c8-81b7-a4fbacbbb57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:10.939625 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b52aca-e803-47c8-81b7-a4fbacbbb57a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:10.939906 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b52aca-e803-47c8-81b7-a4fbacbbb57a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:10.940183 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b52aca-e803-47c8-81b7-a4fbacbbb57a None admin] PATH_INFO: `/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:10.941705 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b52aca-e803-47c8-81b7-a4fbacbbb57a None admin] RBAC: Authorizing `identity:get_project(project_id=6ff53efad5ea4244a2a900acf4ee3f21)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:10.942971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b52aca-e803-47c8-81b7-a4fbacbbb57a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:10.946399 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 185/366] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:01:10 2022] GET /identity/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:10.947151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b52aca-e803-47c8-81b7-a4fbacbbb57a None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:10.955548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5cff23-4be6-4566-bc4a-5b2726971b29 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:10.996192 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287798e3-a126-4219-9432-a3fe5b6234b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:10.997657 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287798e3-a126-4219-9432-a3fe5b6234b8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:10.997974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287798e3-a126-4219-9432-a3fe5b6234b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:10.998277 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287798e3-a126-4219-9432-a3fe5b6234b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:11.013260 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287798e3-a126-4219-9432-a3fe5b6234b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:11.021435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-287798e3-a126-4219-9432-a3fe5b6234b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:01:11.021435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:11.021435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:11.021435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:11.021435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:11.021435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:11.021435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:11.021435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:11.021435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:11.021435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:11.021435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:11.021435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:11.021435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:11.021435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:11.021435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:11.021435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:11.022467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:11.022467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:11.022467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:11.022467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:11.022467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:11.022467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:11.022467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:11.022467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:11.022467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:11.022467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:11.022467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:11.022467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:11.022467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:11.022467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:11.022467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:11.022467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:11.023234 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:11.023234 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:11.023234 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:11.023234 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:11.023234 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:11.023234 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:11.023234 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:11.023234 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:11.023234 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:11.023234 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:11.023234 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:01:11.023234 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:11.026488 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 182/367] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:01:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:11.027532 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287798e3-a126-4219-9432-a3fe5b6234b8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:11.070355 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b52aca-e803-47c8-81b7-a4fbacbbb57a None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:11.112369 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122206f-828b-45b3-827e-5a0c55ccc1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:11.113244 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122206f-828b-45b3-827e-5a0c55ccc1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:11.113525 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122206f-828b-45b3-827e-5a0c55ccc1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:11.113799 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122206f-828b-45b3-827e-5a0c55ccc1f2 None admin] PATH_INFO: `/v3/users/d9388b165f7647e9a02a042eeed86d68` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:11.115252 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122206f-828b-45b3-827e-5a0c55ccc1f2 None admin] RBAC: Authorizing `identity:get_user(user_id=d9388b165f7647e9a02a042eeed86d68)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:11.116534 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122206f-828b-45b3-827e-5a0c55ccc1f2 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:11.118390 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 186/368] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:01:10 2022] GET /identity/v3/users/d9388b165f7647e9a02a042eeed86d68 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:11.119074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122206f-828b-45b3-827e-5a0c55ccc1f2 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:11.144431 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287798e3-a126-4219-9432-a3fe5b6234b8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:11.180204 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61536d7d-ebcb-4d2f-9a6c-79bcb7c8e0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:11.181188 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61536d7d-ebcb-4d2f-9a6c-79bcb7c8e0dc None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:11.181661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61536d7d-ebcb-4d2f-9a6c-79bcb7c8e0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:11.182179 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61536d7d-ebcb-4d2f-9a6c-79bcb7c8e0dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:11.224533 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122206f-828b-45b3-827e-5a0c55ccc1f2 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:11.251224 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61536d7d-ebcb-4d2f-9a6c-79bcb7c8e0dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:11.253123 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61536d7d-ebcb-4d2f-9a6c-79bcb7c8e0dc None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:11.259603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714baa66-d7ee-4e18-aa1e-d43f6b61c86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:11.260465 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714baa66-d7ee-4e18-aa1e-d43f6b61c86f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:11.260749 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714baa66-d7ee-4e18-aa1e-d43f6b61c86f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:11.261025 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714baa66-d7ee-4e18-aa1e-d43f6b61c86f None admin] PATH_INFO: `/v3/groups/c7ccd8ad94de4afb8df700ca9e94b2d9` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:11.262234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714baa66-d7ee-4e18-aa1e-d43f6b61c86f None admin] RBAC: Authorizing `identity:get_group(group_id=c7ccd8ad94de4afb8df700ca9e94b2d9)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:11.265093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714baa66-d7ee-4e18-aa1e-d43f6b61c86f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:11.267374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 187/369] 10.222.0.76 () {56 vars in 1180 bytes} [Mon May 16 15:01:11 2022] GET /identity/v3/groups/c7ccd8ad94de4afb8df700ca9e94b2d9 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:11.268152 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714baa66-d7ee-4e18-aa1e-d43f6b61c86f None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:11.358963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 183/370] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:01:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:01:11.360169 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61536d7d-ebcb-4d2f-9a6c-79bcb7c8e0dc None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:11.373100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714baa66-d7ee-4e18-aa1e-d43f6b61c86f None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:11.423942 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37b0bd-9b06-41ea-b697-2ab0570f22e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:11.425041 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37b0bd-9b06-41ea-b697-2ab0570f22e2 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:11.425041 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37b0bd-9b06-41ea-b697-2ab0570f22e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:11.425355 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37b0bd-9b06-41ea-b697-2ab0570f22e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:11.426559 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37b0bd-9b06-41ea-b697-2ab0570f22e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:11.427026 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37b0bd-9b06-41ea-b697-2ab0570f22e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:11.429346 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37b0bd-9b06-41ea-b697-2ab0570f22e2 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:11.443769 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 188/371] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:01:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:11.445020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37b0bd-9b06-41ea-b697-2ab0570f22e2 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:11.476288 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61536d7d-ebcb-4d2f-9a6c-79bcb7c8e0dc None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:11.510707 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0c73f-229f-4f8f-89d0-f6f09f640153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:11.511727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0c73f-229f-4f8f-89d0-f6f09f640153 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:11.512197 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0c73f-229f-4f8f-89d0-f6f09f640153 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:11.513202 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0c73f-229f-4f8f-89d0-f6f09f640153 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:11.514276 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0c73f-229f-4f8f-89d0-f6f09f640153 None admin] RBAC: Adding query filter params (role.id=046c7400e19f4144be943daf291f32db, user.id=d9388b165f7647e9a02a042eeed86d68, scope.system=all) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:11.514802 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0c73f-229f-4f8f-89d0-f6f09f640153 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:11.516421 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0c73f-229f-4f8f-89d0-f6f09f640153 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:11.529347 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 184/372] 10.222.0.76 () {56 vars in 1308 bytes} [Mon May 16 15:01:11 2022] GET /identity/v3/role_assignments?user.id=d9388b165f7647e9a02a042eeed86d68&scope.system=all&role.id=046c7400e19f4144be943daf291f32db => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:11.531547 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0c73f-229f-4f8f-89d0-f6f09f640153 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:11.552315 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37b0bd-9b06-41ea-b697-2ab0570f22e2 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:11.593840 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472a1e6-f420-42ab-8b6f-952a5e0d39ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:11.593840 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472a1e6-f420-42ab-8b6f-952a5e0d39ea None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:11.593840 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472a1e6-f420-42ab-8b6f-952a5e0d39ea None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:11.593840 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472a1e6-f420-42ab-8b6f-952a5e0d39ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:11.596425 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472a1e6-f420-42ab-8b6f-952a5e0d39ea None admin] RBAC: Adding query filter params (group.id=c7ccd8ad94de4afb8df700ca9e94b2d9, role.id=0e00f6ebfc2843a0992b3d01f50e262d, scope.project.id=6ff53efad5ea4244a2a900acf4ee3f21) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:11.597922 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472a1e6-f420-42ab-8b6f-952a5e0d39ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:11.599159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472a1e6-f420-42ab-8b6f-952a5e0d39ea None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:11.606277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 189/373] 10.222.0.76 () {56 vars in 1376 bytes} [Mon May 16 15:01:11 2022] GET /identity/v3/role_assignments?group.id=c7ccd8ad94de4afb8df700ca9e94b2d9&scope.project.id=6ff53efad5ea4244a2a900acf4ee3f21&role.id=0e00f6ebfc2843a0992b3d01f50e262d => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:11.607145 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472a1e6-f420-42ab-8b6f-952a5e0d39ea None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:11.657495 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0c73f-229f-4f8f-89d0-f6f09f640153 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:11.693256 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18e0d4-a99f-4ad1-966c-ebcf9a507506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:11.694529 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18e0d4-a99f-4ad1-966c-ebcf9a507506 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:11.695010 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18e0d4-a99f-4ad1-966c-ebcf9a507506 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:11.695508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18e0d4-a99f-4ad1-966c-ebcf9a507506 None admin] PATH_INFO: `/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:11.697022 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18e0d4-a99f-4ad1-966c-ebcf9a507506 None admin] RBAC: Authorizing `identity:get_project(project_id=6ff53efad5ea4244a2a900acf4ee3f21)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:11.698778 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18e0d4-a99f-4ad1-966c-ebcf9a507506 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:11.701153 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 185/374] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:01:11 2022] GET /identity/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:11.706576 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18e0d4-a99f-4ad1-966c-ebcf9a507506 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:11.717714 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472a1e6-f420-42ab-8b6f-952a5e0d39ea None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:11.770324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba1505-cff1-46b8-9f87-6cd17f898aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:11.772885 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba1505-cff1-46b8-9f87-6cd17f898aef None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:11.773172 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba1505-cff1-46b8-9f87-6cd17f898aef None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:11.773455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba1505-cff1-46b8-9f87-6cd17f898aef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:11.823305 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18e0d4-a99f-4ad1-966c-ebcf9a507506 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:11.867681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06ae3c-2d39-4e3c-b253-ec3e702fde07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:11.868916 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06ae3c-2d39-4e3c-b253-ec3e702fde07 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:11.869389 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06ae3c-2d39-4e3c-b253-ec3e702fde07 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:11.869853 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06ae3c-2d39-4e3c-b253-ec3e702fde07 None admin] PATH_INFO: `/v3/groups/c7ccd8ad94de4afb8df700ca9e94b2d9` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:11.871324 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06ae3c-2d39-4e3c-b253-ec3e702fde07 None admin] RBAC: Authorizing `identity:get_group(group_id=c7ccd8ad94de4afb8df700ca9e94b2d9)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:11.872575 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba1505-cff1-46b8-9f87-6cd17f898aef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:11.873778 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06ae3c-2d39-4e3c-b253-ec3e702fde07 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:11.874097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba1505-cff1-46b8-9f87-6cd17f898aef None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:11.876281 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 186/375] 10.222.0.76 () {56 vars in 1180 bytes} [Mon May 16 15:01:11 2022] GET /identity/v3/groups/c7ccd8ad94de4afb8df700ca9e94b2d9 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:11.882598 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06ae3c-2d39-4e3c-b253-ec3e702fde07 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:11.980464 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 190/376] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:01:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:01:11.986394 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba1505-cff1-46b8-9f87-6cd17f898aef None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:11.986883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06ae3c-2d39-4e3c-b253-ec3e702fde07 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:12.023753 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb4524-fe72-4c92-bf64-dc5fbf5fa068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:12.025189 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb4524-fe72-4c92-bf64-dc5fbf5fa068 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:12.025714 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb4524-fe72-4c92-bf64-dc5fbf5fa068 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:12.026215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb4524-fe72-4c92-bf64-dc5fbf5fa068 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:12.027266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb4524-fe72-4c92-bf64-dc5fbf5fa068 None admin] RBAC: Adding query filter params (group.id=c7ccd8ad94de4afb8df700ca9e94b2d9, role.id=00ecc8471dbb4296b40c8b8c0b29aedd, scope.project.id=6ff53efad5ea4244a2a900acf4ee3f21) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:12.027799 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb4524-fe72-4c92-bf64-dc5fbf5fa068 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:12.029528 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb4524-fe72-4c92-bf64-dc5fbf5fa068 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:12.036189 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 187/377] 10.222.0.76 () {56 vars in 1376 bytes} [Mon May 16 15:01:11 2022] GET /identity/v3/role_assignments?group.id=c7ccd8ad94de4afb8df700ca9e94b2d9&scope.project.id=6ff53efad5ea4244a2a900acf4ee3f21&role.id=00ecc8471dbb4296b40c8b8c0b29aedd => generated 260 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:12.098638 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba1505-cff1-46b8-9f87-6cd17f898aef None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:12.149419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd653fc-d2b9-44c2-a114-dd0d22eb7bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:12.150510 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd653fc-d2b9-44c2-a114-dd0d22eb7bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:12.150789 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd653fc-d2b9-44c2-a114-dd0d22eb7bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:12.151063 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd653fc-d2b9-44c2-a114-dd0d22eb7bf8 None admin] PATH_INFO: `/v3/projects/1c01b64ed2e84249921cacc6ee5ef7ac` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:12.152364 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd653fc-d2b9-44c2-a114-dd0d22eb7bf8 None admin] RBAC: Authorizing `identity:get_project(project_id=1c01b64ed2e84249921cacc6ee5ef7ac)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:12.153942 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd653fc-d2b9-44c2-a114-dd0d22eb7bf8 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:12.157120 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 191/378] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:01:11 2022] GET /identity/v3/projects/1c01b64ed2e84249921cacc6ee5ef7ac => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:12.163679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb4524-fe72-4c92-bf64-dc5fbf5fa068 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:12.278938 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb4524-fe72-4c92-bf64-dc5fbf5fa068 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:12.321276 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8d80a-7af0-41ce-a04c-ec4e9d3920d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:12.322523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8d80a-7af0-41ce-a04c-ec4e9d3920d3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:12.323011 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8d80a-7af0-41ce-a04c-ec4e9d3920d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:12.323458 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8d80a-7af0-41ce-a04c-ec4e9d3920d3 None admin] PATH_INFO: `/v3/groups/09977c3cbdf34a659c022034691f53ff` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:12.332221 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8d80a-7af0-41ce-a04c-ec4e9d3920d3 None admin] RBAC: Authorizing `identity:get_group(group_id=09977c3cbdf34a659c022034691f53ff)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:12.333912 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8d80a-7af0-41ce-a04c-ec4e9d3920d3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:12.336178 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 188/379] 10.222.0.76 () {56 vars in 1180 bytes} [Mon May 16 15:01:12 2022] GET /identity/v3/groups/09977c3cbdf34a659c022034691f53ff => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:12.342843 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd653fc-d2b9-44c2-a114-dd0d22eb7bf8 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:12.453470 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd653fc-d2b9-44c2-a114-dd0d22eb7bf8 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:12.498263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb056b90-006b-4691-ab94-c741b04a7cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:12.499241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb056b90-006b-4691-ab94-c741b04a7cec None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:12.499698 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb056b90-006b-4691-ab94-c741b04a7cec None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:12.500163 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb056b90-006b-4691-ab94-c741b04a7cec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:12.501175 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb056b90-006b-4691-ab94-c741b04a7cec None admin] RBAC: Adding query filter params (group.id=09977c3cbdf34a659c022034691f53ff, role.id=f6c8fc0dc0f24de3907b0960a1201901, scope.project.id=1c01b64ed2e84249921cacc6ee5ef7ac) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:12.501659 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb056b90-006b-4691-ab94-c741b04a7cec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:12.503304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb056b90-006b-4691-ab94-c741b04a7cec None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:12.511693 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 192/380] 10.222.0.76 () {56 vars in 1376 bytes} [Mon May 16 15:01:12 2022] GET /identity/v3/role_assignments?group.id=09977c3cbdf34a659c022034691f53ff&scope.project.id=1c01b64ed2e84249921cacc6ee5ef7ac&role.id=f6c8fc0dc0f24de3907b0960a1201901 => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:12.931941 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e143eb3-cbac-4607-861c-5569eb81a9c9 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:12.932545 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e143eb3-cbac-4607-861c-5569eb81a9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:12.933012 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e143eb3-cbac-4607-861c-5569eb81a9c9 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:12.935534 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 189/381] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:12.940691 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bee0a9-9301-48de-b683-f2a0933e8205 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:12.941284 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bee0a9-9301-48de-b683-f2a0933e8205 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:12.941757 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bee0a9-9301-48de-b683-f2a0933e8205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:12.960639 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a6bee0a9-9301-48de-b683-f2a0933e8205 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:12.962324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a6bee0a9-9301-48de-b683-f2a0933e8205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:13.056815 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 193/382] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:13.091291 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e143eb3-cbac-4607-861c-5569eb81a9c9 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:13.160209 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314e5e7-db0a-42a7-9455-14fb9c67b83d None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:13.161229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314e5e7-db0a-42a7-9455-14fb9c67b83d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:13.161700 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314e5e7-db0a-42a7-9455-14fb9c67b83d None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:13.163588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 194/383] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:13.168537 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf7dea-58ef-4e44-b401-f61755d66df6 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:13.169374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf7dea-58ef-4e44-b401-f61755d66df6 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:13.169650 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf7dea-58ef-4e44-b401-f61755d66df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:13.199096 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-f4cf7dea-58ef-4e44-b401-f61755d66df6 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:13.200747 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f4cf7dea-58ef-4e44-b401-f61755d66df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:13.218453 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e143eb3-cbac-4607-861c-5569eb81a9c9 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:13.263337 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec62781-b0be-475e-9272-18c15c6a69d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:13.264466 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec62781-b0be-475e-9272-18c15c6a69d2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:13.264924 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec62781-b0be-475e-9272-18c15c6a69d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:13.265394 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec62781-b0be-475e-9272-18c15c6a69d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:13.276955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec62781-b0be-475e-9272-18c15c6a69d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:13.287177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-8ec62781-b0be-475e-9272-18c15c6a69d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 15:01:13.287177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:13.287177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:13.287177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:13.287177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:13.287177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:13.287177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:13.287177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:13.287177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:13.287177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:13.287177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:13.287177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:13.287177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:13.287177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:13.287177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:13.287177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:13.288168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:13.288168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:13.288168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:13.288168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:13.288168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:13.288168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:13.288168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:13.288168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:13.288168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:13.288168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:13.288168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:13.288168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:13.288168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:13.288168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:13.288168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:13.288168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:13.288955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:13.288955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:13.288955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:13.288955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:13.288955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:13.288955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:13.288955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:13.288955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:13.288955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:13.288955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:13.288955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 15:01:13.288955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:13.291473 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 190/384] 10.222.0.76 () {56 vars in 1114 bytes} [Mon May 16 15:01:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:13.297600 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec62781-b0be-475e-9272-18c15c6a69d2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:13.355622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 195/385] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:13.388909 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf7dea-58ef-4e44-b401-f61755d66df6 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:13.409611 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec62781-b0be-475e-9272-18c15c6a69d2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:13.448801 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec8323-8e63-41f1-8958-d86fb905aa99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:13.450588 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec8323-8e63-41f1-8958-d86fb905aa99 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:13.451015 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec8323-8e63-41f1-8958-d86fb905aa99 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:13.451431 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec8323-8e63-41f1-8958-d86fb905aa99 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:13.452627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec8323-8e63-41f1-8958-d86fb905aa99 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:13.453075 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec8323-8e63-41f1-8958-d86fb905aa99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:13.454719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec8323-8e63-41f1-8958-d86fb905aa99 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:13.464762 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 191/386] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:13.470262 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec8323-8e63-41f1-8958-d86fb905aa99 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:13.593159 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec8323-8e63-41f1-8958-d86fb905aa99 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:13.631893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6ea1d-f762-4ddf-9689-2d7f592e83e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:13.632910 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6ea1d-f762-4ddf-9689-2d7f592e83e4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:13.633396 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6ea1d-f762-4ddf-9689-2d7f592e83e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:13.633676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6ea1d-f762-4ddf-9689-2d7f592e83e4 None admin] PATH_INFO: `/v3/groups/c7ccd8ad94de4afb8df700ca9e94b2d9` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:13.635206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6ea1d-f762-4ddf-9689-2d7f592e83e4 None admin] RBAC: Authorizing `identity:get_group(group_id=c7ccd8ad94de4afb8df700ca9e94b2d9)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:13.636821 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6ea1d-f762-4ddf-9689-2d7f592e83e4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:13.639669 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 192/387] 10.222.0.76 () {56 vars in 1180 bytes} [Mon May 16 15:01:13 2022] GET /identity/v3/groups/c7ccd8ad94de4afb8df700ca9e94b2d9 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:13.640201 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf7dea-58ef-4e44-b401-f61755d66df6 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:13.649641 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6ea1d-f762-4ddf-9689-2d7f592e83e4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:13.710675 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe55b3-88d4-4132-a046-84fd86ec6a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:13.711775 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe55b3-88d4-4132-a046-84fd86ec6a9d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:13.714216 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe55b3-88d4-4132-a046-84fd86ec6a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:13.714676 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe55b3-88d4-4132-a046-84fd86ec6a9d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:13.739489 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe55b3-88d4-4132-a046-84fd86ec6a9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:13.749056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-5dfe55b3-88d4-4132-a046-84fd86ec6a9d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 15:01:13.749056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:13.749056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:13.749056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:13.749056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:13.749056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:13.749056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:13.749056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:13.749056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:13.749056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:13.749056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:13.749056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:13.749056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:13.749056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:13.749056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:13.749056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:13.750763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:13.750763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:13.750763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:13.750763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:13.750763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:13.750763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:13.750763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:13.750763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:13.750763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:13.750763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:13.750763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:13.750763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:13.750763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:13.750763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:13.750763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:13.750763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:13.752324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:13.752324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:13.752324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:13.752324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:13.752324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:13.752324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:13.752324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:13.752324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:13.752324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:13.752324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:13.752324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 15:01:13.752324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:13.768295 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 196/388] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:01:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:01:13.774062 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe55b3-88d4-4132-a046-84fd86ec6a9d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:13.851972 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6ea1d-f762-4ddf-9689-2d7f592e83e4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:13.899996 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3b165-d802-4263-afe6-a600ecbd1bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:13.901903 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3b165-d802-4263-afe6-a600ecbd1bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:13.902361 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3b165-d802-4263-afe6-a600ecbd1bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:13.904165 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3b165-d802-4263-afe6-a600ecbd1bf1 None admin] PATH_INFO: `/v3/projects/21716abeaba940d1bdae0c660acc6bc5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:13.906037 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3b165-d802-4263-afe6-a600ecbd1bf1 None admin] RBAC: Authorizing `identity:get_project(project_id=21716abeaba940d1bdae0c660acc6bc5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:13.909361 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3b165-d802-4263-afe6-a600ecbd1bf1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:13.912647 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 193/389] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:01:13 2022] GET /identity/v3/projects/21716abeaba940d1bdae0c660acc6bc5 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:13.918332 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3b165-d802-4263-afe6-a600ecbd1bf1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:13.980651 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe55b3-88d4-4132-a046-84fd86ec6a9d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:14.022247 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50699f-0351-4abe-b4e3-0ae326c307eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:14.023171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50699f-0351-4abe-b4e3-0ae326c307eb None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:14.023631 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50699f-0351-4abe-b4e3-0ae326c307eb None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:14.024053 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50699f-0351-4abe-b4e3-0ae326c307eb None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:14.024952 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50699f-0351-4abe-b4e3-0ae326c307eb None admin] RBAC: Adding query filter params (name=member) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:14.025404 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50699f-0351-4abe-b4e3-0ae326c307eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:14.027328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50699f-0351-4abe-b4e3-0ae326c307eb None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:14.037269 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 197/390] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:01:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:14.043011 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50699f-0351-4abe-b4e3-0ae326c307eb None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:14.150671 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3b165-d802-4263-afe6-a600ecbd1bf1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:14.162432 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50699f-0351-4abe-b4e3-0ae326c307eb None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:14.206230 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024e048-70f2-4832-b196-e06a661620f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:14.207416 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024e048-70f2-4832-b196-e06a661620f5 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:14.207842 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024e048-70f2-4832-b196-e06a661620f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:14.208262 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024e048-70f2-4832-b196-e06a661620f5 None admin] PATH_INFO: `/v3/groups/c7ccd8ad94de4afb8df700ca9e94b2d9` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:14.209627 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d024e048-70f2-4832-b196-e06a661620f5 None admin] RBAC: Authorizing `identity:get_group(group_id=c7ccd8ad94de4afb8df700ca9e94b2d9)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:14.211741 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d024e048-70f2-4832-b196-e06a661620f5 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:14.214058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 198/391] 10.222.0.76 () {56 vars in 1180 bytes} [Mon May 16 15:01:14 2022] GET /identity/v3/groups/c7ccd8ad94de4afb8df700ca9e94b2d9 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:14.222351 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024e048-70f2-4832-b196-e06a661620f5 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:14.239167 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2ef92-816a-4745-9105-4452ed0c2bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:14.239992 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2ef92-816a-4745-9105-4452ed0c2bb2 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:14.240275 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2ef92-816a-4745-9105-4452ed0c2bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:14.240553 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2ef92-816a-4745-9105-4452ed0c2bb2 None admin] PATH_INFO: `/v3/projects/21716abeaba940d1bdae0c660acc6bc5/groups/c7ccd8ad94de4afb8df700ca9e94b2d9/roles/00ecc8471dbb4296b40c8b8c0b29aedd` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:14.245587 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2ef92-816a-4745-9105-4452ed0c2bb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=21716abeaba940d1bdae0c660acc6bc5, group_id=c7ccd8ad94de4afb8df700ca9e94b2d9, role_id=00ecc8471dbb4296b40c8b8c0b29aedd)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:14.247626 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2ef92-816a-4745-9105-4452ed0c2bb2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:14.345986 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 194/392] 10.222.0.76 () {58 vars in 1442 bytes} [Mon May 16 15:01:13 2022] PUT /identity/v3/projects/21716abeaba940d1bdae0c660acc6bc5/groups/c7ccd8ad94de4afb8df700ca9e94b2d9/roles/00ecc8471dbb4296b40c8b8c0b29aedd => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:01:14.350511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024e048-70f2-4832-b196-e06a661620f5 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:14.387050 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831bf9f7-d147-48a1-85ac-eef37e5e2949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:14.388459 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bf9f7-d147-48a1-85ac-eef37e5e2949 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:14.388795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bf9f7-d147-48a1-85ac-eef37e5e2949 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:14.389077 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bf9f7-d147-48a1-85ac-eef37e5e2949 None admin] PATH_INFO: `/v3/projects/21716abeaba940d1bdae0c660acc6bc5` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:14.393449 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831bf9f7-d147-48a1-85ac-eef37e5e2949 None admin] RBAC: Authorizing `identity:get_project(project_id=21716abeaba940d1bdae0c660acc6bc5)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:14.394969 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831bf9f7-d147-48a1-85ac-eef37e5e2949 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:14.397080 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 199/393] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:01:14 2022] GET /identity/v3/projects/21716abeaba940d1bdae0c660acc6bc5 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:14.403602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2ef92-816a-4745-9105-4452ed0c2bb2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:14.525698 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2ef92-816a-4745-9105-4452ed0c2bb2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:14.567743 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a6061-d45d-4b92-beba-0b8d6fa9e588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:14.570076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a6061-d45d-4b92-beba-0b8d6fa9e588 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:14.570076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a6061-d45d-4b92-beba-0b8d6fa9e588 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:14.570076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a6061-d45d-4b92-beba-0b8d6fa9e588 None admin] PATH_INFO: `/v3/projects/21716abeaba940d1bdae0c660acc6bc5/groups/c7ccd8ad94de4afb8df700ca9e94b2d9/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:14.571290 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a6061-d45d-4b92-beba-0b8d6fa9e588 None admin] RBAC: Authorizing `identity:create_grant(project_id=21716abeaba940d1bdae0c660acc6bc5, group_id=c7ccd8ad94de4afb8df700ca9e94b2d9, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:14.572745 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a6061-d45d-4b92-beba-0b8d6fa9e588 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:14.652657 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 195/394] 10.222.0.76 () {58 vars in 1442 bytes} [Mon May 16 15:01:14 2022] PUT /identity/v3/projects/21716abeaba940d1bdae0c660acc6bc5/groups/c7ccd8ad94de4afb8df700ca9e94b2d9/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:01:14.746174 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080af8ad-2a2e-48b1-bca7-edea37010cbd None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:14.746721 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080af8ad-2a2e-48b1-bca7-edea37010cbd None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:14.747171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080af8ad-2a2e-48b1-bca7-edea37010cbd None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:14.749107 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 200/395] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:14.754731 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437289a-2f56-403d-9000-a17c9f394f83 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:14.755034 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437289a-2f56-403d-9000-a17c9f394f83 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:14.755290 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437289a-2f56-403d-9000-a17c9f394f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:14.780407 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-0437289a-2f56-403d-9000-a17c9f394f83 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:14.781533 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0437289a-2f56-403d-9000-a17c9f394f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:14.866714 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 196/396] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:14.888750 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080af8ad-2a2e-48b1-bca7-edea37010cbd None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:14.899644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0f3b0-5281-438f-8ae4-71e8894a0b17 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:14.899951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0f3b0-5281-438f-8ae4-71e8894a0b17 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:14.900196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0f3b0-5281-438f-8ae4-71e8894a0b17 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:14.903492 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 197/397] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:14.907732 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f95f6-42aa-4b1c-a507-3daa5ccb5f64 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:14.908017 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f95f6-42aa-4b1c-a507-3daa5ccb5f64 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:14.908299 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f95f6-42aa-4b1c-a507-3daa5ccb5f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:14.931733 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-515f95f6-42aa-4b1c-a507-3daa5ccb5f64 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:14.933526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-515f95f6-42aa-4b1c-a507-3daa5ccb5f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:15.011512 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080af8ad-2a2e-48b1-bca7-edea37010cbd None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:15.024658 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 198/398] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:01:15.050294 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe848bda-d854-4ad2-aaec-8e4dff9009e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:15.051506 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f95f6-42aa-4b1c-a507-3daa5ccb5f64 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:15.060126 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe848bda-d854-4ad2-aaec-8e4dff9009e5 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:15.060614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe848bda-d854-4ad2-aaec-8e4dff9009e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:15.060899 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe848bda-d854-4ad2-aaec-8e4dff9009e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:15.078820 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe848bda-d854-4ad2-aaec-8e4dff9009e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:15.088407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-fe848bda-d854-4ad2-aaec-8e4dff9009e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 15:01:15.088407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:15.088407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:15.088407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:15.088407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:15.088407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:15.088407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:15.088407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:15.088407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:15.088407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:15.088407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:15.088407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:15.088407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:15.088407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:15.088407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:15.088407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:15.089348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:15.089348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:15.089348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:15.089348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:15.089348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:15.089348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:15.089348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:15.089348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:15.089348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:15.089348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:15.089348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:15.089348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:15.089348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:15.089348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:15.089348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:15.089348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:15.090274 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:15.090274 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:15.090274 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:15.090274 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:15.090274 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:15.090274 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:15.090274 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:15.090274 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:15.090274 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:15.090274 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:15.090274 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 15:01:15.090274 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:15.093435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 201/399] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:01:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:15.111609 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe848bda-d854-4ad2-aaec-8e4dff9009e5 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:15.194216 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f95f6-42aa-4b1c-a507-3daa5ccb5f64 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:15.237365 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8e869-96f0-474b-8e65-6e71d02e4c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:15.239739 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8e869-96f0-474b-8e65-6e71d02e4c5d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:15.240048 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8e869-96f0-474b-8e65-6e71d02e4c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:15.240325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8e869-96f0-474b-8e65-6e71d02e4c5d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:15.264699 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8e869-96f0-474b-8e65-6e71d02e4c5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:15.272882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-4fd8e869-96f0-474b-8e65-6e71d02e4c5d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 15:01:15.272882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:15.272882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:15.272882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:15.272882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:15.272882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:15.272882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:15.272882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:15.272882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:15.272882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:15.272882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:15.272882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:15.272882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:15.272882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:15.272882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:15.272882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:15.273785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:15.273785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:15.273785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:15.273785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:15.273785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:15.273785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:15.273785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:15.273785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:15.273785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:15.273785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:15.273785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:15.273785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:15.273785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:15.273785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:15.273785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:15.273785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:15.274657 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:15.274657 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:15.274657 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:15.274657 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:15.274657 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:15.274657 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:15.274657 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:15.274657 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:15.274657 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:15.274657 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:15.274657 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 15:01:15.274657 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:15.274657 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 199/400] 10.222.0.76 () {56 vars in 1114 bytes} [Mon May 16 15:01:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:15.281542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8e869-96f0-474b-8e65-6e71d02e4c5d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:15.332536 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe848bda-d854-4ad2-aaec-8e4dff9009e5 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:15.408246 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74188e4-966f-48eb-a8a1-6362d51521e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:15.408917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74188e4-966f-48eb-a8a1-6362d51521e5 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:15.409203 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74188e4-966f-48eb-a8a1-6362d51521e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:15.409474 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74188e4-966f-48eb-a8a1-6362d51521e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:15.410252 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74188e4-966f-48eb-a8a1-6362d51521e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:15.410556 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74188e4-966f-48eb-a8a1-6362d51521e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:15.420971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74188e4-966f-48eb-a8a1-6362d51521e5 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:15.420971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 202/401] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:01:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:15.427924 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74188e4-966f-48eb-a8a1-6362d51521e5 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:15.471705 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8e869-96f0-474b-8e65-6e71d02e4c5d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:15.522090 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a03edb-98a2-41ab-910f-2f7363195c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:15.522818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a03edb-98a2-41ab-910f-2f7363195c88 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:15.523098 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a03edb-98a2-41ab-910f-2f7363195c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:15.523374 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a03edb-98a2-41ab-910f-2f7363195c88 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:15.524136 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a03edb-98a2-41ab-910f-2f7363195c88 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:15.524445 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a03edb-98a2-41ab-910f-2f7363195c88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:15.525883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a03edb-98a2-41ab-910f-2f7363195c88 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:15.541321 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 200/402] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:15.542786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0cfc0-3e2c-4f4a-9e25-e156e3fd1f62 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:15.543083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0cfc0-3e2c-4f4a-9e25-e156e3fd1f62 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:15.543396 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0cfc0-3e2c-4f4a-9e25-e156e3fd1f62 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:15.547646 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 201/403] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:15.548577 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0cfc0-3e2c-4f4a-9e25-e156e3fd1f62 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:15.595967 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74188e4-966f-48eb-a8a1-6362d51521e5 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:15.638108 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5858cdd-2ea2-46de-a89e-f1cc7a2f7f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:15.639102 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5858cdd-2ea2-46de-a89e-f1cc7a2f7f08 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:15.639465 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5858cdd-2ea2-46de-a89e-f1cc7a2f7f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:15.639745 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5858cdd-2ea2-46de-a89e-f1cc7a2f7f08 None admin] PATH_INFO: `/v3/groups/c7ccd8ad94de4afb8df700ca9e94b2d9` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:15.640942 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5858cdd-2ea2-46de-a89e-f1cc7a2f7f08 None admin] RBAC: Authorizing `identity:get_group(group_id=c7ccd8ad94de4afb8df700ca9e94b2d9)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:15.642436 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5858cdd-2ea2-46de-a89e-f1cc7a2f7f08 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:15.644383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 203/404] 10.222.0.76 () {56 vars in 1180 bytes} [Mon May 16 15:01:15 2022] GET /identity/v3/groups/c7ccd8ad94de4afb8df700ca9e94b2d9 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:15.645553 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1e79e-3a88-41dc-b469-923878de45fb None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:15.645840 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1e79e-3a88-41dc-b469-923878de45fb None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:15.646117 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1e79e-3a88-41dc-b469-923878de45fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:15.663340 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-24b1e79e-3a88-41dc-b469-923878de45fb None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:15.664532 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-24b1e79e-3a88-41dc-b469-923878de45fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:15.692711 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0cfc0-3e2c-4f4a-9e25-e156e3fd1f62 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:15.728743 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91965388-f4f5-4052-8c3b-79a401feb89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:15.729698 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91965388-f4f5-4052-8c3b-79a401feb89d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:15.729972 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91965388-f4f5-4052-8c3b-79a401feb89d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:15.730281 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91965388-f4f5-4052-8c3b-79a401feb89d None admin] PATH_INFO: `/v3/groups/c7ccd8ad94de4afb8df700ca9e94b2d9` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:15.732650 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91965388-f4f5-4052-8c3b-79a401feb89d None admin] RBAC: Authorizing `identity:get_group(group_id=c7ccd8ad94de4afb8df700ca9e94b2d9)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:15.733862 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 204/405] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:15.734228 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91965388-f4f5-4052-8c3b-79a401feb89d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:15.734759 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1e79e-3a88-41dc-b469-923878de45fb None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:15.736132 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 202/406] 10.222.0.76 () {56 vars in 1180 bytes} [Mon May 16 15:01:15 2022] GET /identity/v3/groups/c7ccd8ad94de4afb8df700ca9e94b2d9 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:15.741342 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91965388-f4f5-4052-8c3b-79a401feb89d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:15.880078 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1e79e-3a88-41dc-b469-923878de45fb None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:15.880277 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91965388-f4f5-4052-8c3b-79a401feb89d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:15.925691 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019441b5-2e3f-42db-8d35-6f92a95139b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:15.925691 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019441b5-2e3f-42db-8d35-6f92a95139b5 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:15.925989 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019441b5-2e3f-42db-8d35-6f92a95139b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:15.926633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019441b5-2e3f-42db-8d35-6f92a95139b5 None admin] PATH_INFO: `/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:15.934506 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019441b5-2e3f-42db-8d35-6f92a95139b5 None admin] RBAC: Authorizing `identity:get_project(project_id=6ff53efad5ea4244a2a900acf4ee3f21)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:15.934506 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019441b5-2e3f-42db-8d35-6f92a95139b5 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:15.935963 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 205/407] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:01:15 2022] GET /identity/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:15.938036 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019441b5-2e3f-42db-8d35-6f92a95139b5 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:15.942149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52f81c-22bf-49ee-bbba-e1375a2afa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:15.942149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52f81c-22bf-49ee-bbba-e1375a2afa47 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:15.942149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52f81c-22bf-49ee-bbba-e1375a2afa47 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:15.942149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52f81c-22bf-49ee-bbba-e1375a2afa47 None admin] PATH_INFO: `/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:15.942784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52f81c-22bf-49ee-bbba-e1375a2afa47 None admin] RBAC: Authorizing `identity:get_project(project_id=6ff53efad5ea4244a2a900acf4ee3f21)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:15.944008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52f81c-22bf-49ee-bbba-e1375a2afa47 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:15.947280 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 203/408] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:01:15 2022] GET /identity/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:15.948057 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52f81c-22bf-49ee-bbba-e1375a2afa47 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:16.056491 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019441b5-2e3f-42db-8d35-6f92a95139b5 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:16.072432 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52f81c-22bf-49ee-bbba-e1375a2afa47 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:16.092211 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b117f-fea9-4ad1-a1b3-1b6bd6881d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:16.093004 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b117f-fea9-4ad1-a1b3-1b6bd6881d63 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:16.093270 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b117f-fea9-4ad1-a1b3-1b6bd6881d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:16.093538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b117f-fea9-4ad1-a1b3-1b6bd6881d63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:16.103991 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b117f-fea9-4ad1-a1b3-1b6bd6881d63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:16.112315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6dad0a-2a8f-4d6c-b773-0704ebf2abd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:16.112588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-177b117f-fea9-4ad1-a1b3-1b6bd6881d63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:01:16.112588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:16.112588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:16.112588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:16.112588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:16.112588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:16.112588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:16.112588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:16.112588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:16.112588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:16.112588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:16.112588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:16.112588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:16.112588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:16.112588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:16.112588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:16.114669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:16.114669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:16.114669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:16.114669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:16.114669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:16.114669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:16.114669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:16.114669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:16.114669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:16.114669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:16.114669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:16.114669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:16.114669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:16.114669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:16.114669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:16.114669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:16.115976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:16.115976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:16.115976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:16.115976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:16.115976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:16.115976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:16.115976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:16.115976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:16.115976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:16.115976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:16.115976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:01:16.115976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:16.116777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dad0a-2a8f-4d6c-b773-0704ebf2abd1 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:16.116777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dad0a-2a8f-4d6c-b773-0704ebf2abd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:16.116777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dad0a-2a8f-4d6c-b773-0704ebf2abd1 None admin] PATH_INFO: `/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21/groups/c7ccd8ad94de4afb8df700ca9e94b2d9/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:16.116985 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 206/409] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:01:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:16.116985 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b117f-fea9-4ad1-a1b3-1b6bd6881d63 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:16.126150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6dad0a-2a8f-4d6c-b773-0704ebf2abd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ff53efad5ea4244a2a900acf4ee3f21, group_id=c7ccd8ad94de4afb8df700ca9e94b2d9, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:16.126150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6dad0a-2a8f-4d6c-b773-0704ebf2abd1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:16.223234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b117f-fea9-4ad1-a1b3-1b6bd6881d63 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:16.245414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 204/410] 10.222.0.76 () {58 vars in 1442 bytes} [Mon May 16 15:01:15 2022] PUT /identity/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21/groups/c7ccd8ad94de4afb8df700ca9e94b2d9/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:01:16.246870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6dad0a-2a8f-4d6c-b773-0704ebf2abd1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:16.285151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4ce96-a4f0-4101-a92f-db7ca8c5343c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:16.286109 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4ce96-a4f0-4101-a92f-db7ca8c5343c None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:16.286420 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4ce96-a4f0-4101-a92f-db7ca8c5343c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:16.286694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4ce96-a4f0-4101-a92f-db7ca8c5343c None admin] PATH_INFO: `/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21/groups/c7ccd8ad94de4afb8df700ca9e94b2d9/roles/00ecc8471dbb4296b40c8b8c0b29aedd` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:16.294858 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4ce96-a4f0-4101-a92f-db7ca8c5343c None admin] RBAC: Authorizing `identity:create_grant(project_id=6ff53efad5ea4244a2a900acf4ee3f21, group_id=c7ccd8ad94de4afb8df700ca9e94b2d9, role_id=00ecc8471dbb4296b40c8b8c0b29aedd)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:16.296497 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4ce96-a4f0-4101-a92f-db7ca8c5343c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:16.378360 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 207/411] 10.222.0.76 () {58 vars in 1442 bytes} [Mon May 16 15:01:16 2022] PUT /identity/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21/groups/c7ccd8ad94de4afb8df700ca9e94b2d9/roles/00ecc8471dbb4296b40c8b8c0b29aedd => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:01:16.397392 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6dad0a-2a8f-4d6c-b773-0704ebf2abd1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:16.451105 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3964bb-042a-408d-a3cb-97df7878c1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:16.451806 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3964bb-042a-408d-a3cb-97df7878c1fe None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:16.452089 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3964bb-042a-408d-a3cb-97df7878c1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:16.452367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3964bb-042a-408d-a3cb-97df7878c1fe None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:16.453292 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3964bb-042a-408d-a3cb-97df7878c1fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:16.453599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3964bb-042a-408d-a3cb-97df7878c1fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:16.456432 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3964bb-042a-408d-a3cb-97df7878c1fe None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:16.469928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 205/412] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:01:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:16.476099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4ce96-a4f0-4101-a92f-db7ca8c5343c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:16.593863 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4ce96-a4f0-4101-a92f-db7ca8c5343c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:16.632272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae778f-e23e-4f55-bc9a-b75098f36330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:16.633483 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae778f-e23e-4f55-bc9a-b75098f36330 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:16.633962 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae778f-e23e-4f55-bc9a-b75098f36330 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:16.634468 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae778f-e23e-4f55-bc9a-b75098f36330 None admin] PATH_INFO: `/v3/groups/09977c3cbdf34a659c022034691f53ff` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:16.635887 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae778f-e23e-4f55-bc9a-b75098f36330 None admin] RBAC: Authorizing `identity:get_group(group_id=09977c3cbdf34a659c022034691f53ff)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:16.638143 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae778f-e23e-4f55-bc9a-b75098f36330 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:16.640429 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 208/413] 10.222.0.76 () {56 vars in 1180 bytes} [Mon May 16 15:01:16 2022] GET /identity/v3/groups/09977c3cbdf34a659c022034691f53ff => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:16.645513 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3964bb-042a-408d-a3cb-97df7878c1fe None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:16.772423 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3964bb-042a-408d-a3cb-97df7878c1fe None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:16.815803 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a306abf-1c7d-46db-b221-11b26ce2d4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:16.817034 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a306abf-1c7d-46db-b221-11b26ce2d4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:16.817513 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a306abf-1c7d-46db-b221-11b26ce2d4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:16.818020 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a306abf-1c7d-46db-b221-11b26ce2d4f8 None admin] PATH_INFO: `/v3/projects/1c01b64ed2e84249921cacc6ee5ef7ac` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:16.822855 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a306abf-1c7d-46db-b221-11b26ce2d4f8 None admin] RBAC: Authorizing `identity:get_project(project_id=1c01b64ed2e84249921cacc6ee5ef7ac)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:16.824645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a306abf-1c7d-46db-b221-11b26ce2d4f8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:16.826902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 206/414] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:01:16 2022] GET /identity/v3/projects/1c01b64ed2e84249921cacc6ee5ef7ac => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:16.832282 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae778f-e23e-4f55-bc9a-b75098f36330 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:16.943649 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae778f-e23e-4f55-bc9a-b75098f36330 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:16.988138 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9694dd-fe8f-430c-a62f-18ee3a237972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:16.989407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9694dd-fe8f-430c-a62f-18ee3a237972 None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:16.989888 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9694dd-fe8f-430c-a62f-18ee3a237972 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:16.990395 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9694dd-fe8f-430c-a62f-18ee3a237972 None admin] PATH_INFO: `/v3/projects/1c01b64ed2e84249921cacc6ee5ef7ac/groups/09977c3cbdf34a659c022034691f53ff/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:16.992570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9694dd-fe8f-430c-a62f-18ee3a237972 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c01b64ed2e84249921cacc6ee5ef7ac, group_id=09977c3cbdf34a659c022034691f53ff, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:16.994249 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9694dd-fe8f-430c-a62f-18ee3a237972 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:17.097352 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 209/415] 10.222.0.76 () {58 vars in 1442 bytes} [Mon May 16 15:01:16 2022] PUT /identity/v3/projects/1c01b64ed2e84249921cacc6ee5ef7ac/groups/09977c3cbdf34a659c022034691f53ff/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:01:17.312288 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc587da7-e65c-4934-b429-0418daa5c871 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:17.313276 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc587da7-e65c-4934-b429-0418daa5c871 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:17.313766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc587da7-e65c-4934-b429-0418daa5c871 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:17.315387 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 207/416] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:17.320940 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26b79d-f14a-42ad-abac-8ae0e324f085 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:17.321226 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26b79d-f14a-42ad-abac-8ae0e324f085 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:17.321503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26b79d-f14a-42ad-abac-8ae0e324f085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:17.340138 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-4e26b79d-f14a-42ad-abac-8ae0e324f085 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:17.341328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4e26b79d-f14a-42ad-abac-8ae0e324f085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:17.423474 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 210/417] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:01:17.472971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc587da7-e65c-4934-b429-0418daa5c871 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:17.602088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc587da7-e65c-4934-b429-0418daa5c871 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:17.650844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9649ac-771c-489e-b59b-326e799aa876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:17.652135 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9649ac-771c-489e-b59b-326e799aa876 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:17.652649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9649ac-771c-489e-b59b-326e799aa876 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:17.653137 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9649ac-771c-489e-b59b-326e799aa876 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:17.666940 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9649ac-771c-489e-b59b-326e799aa876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:17.675442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-4e9649ac-771c-489e-b59b-326e799aa876 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 15:01:17.675442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:17.675442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:17.675442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:17.675442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:17.675442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:17.675442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:17.675442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:17.675442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:17.675442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:17.675442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:17.675442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:17.675442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:17.675442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:17.675442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:17.675442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:17.676369 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:17.676369 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:17.676369 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:17.676369 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:17.676369 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:17.676369 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:17.676369 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:17.676369 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:17.676369 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:17.676369 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:17.676369 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:17.676369 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:17.676369 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:17.676369 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:17.676369 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:17.676369 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:17.677156 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:17.677156 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:17.677156 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:17.677156 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:17.677156 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:17.677156 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:17.677156 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:17.677156 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:17.677156 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:17.677156 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:17.677156 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 15:01:17.677156 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:17.679866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 208/418] 10.222.0.76 () {56 vars in 1114 bytes} [Mon May 16 15:01:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:17.686689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26b79d-f14a-42ad-abac-8ae0e324f085 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:17.778346 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89d7cb-3030-430d-9d28-ad163c6b2ba8 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:17.778992 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89d7cb-3030-430d-9d28-ad163c6b2ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:17.779471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89d7cb-3030-430d-9d28-ad163c6b2ba8 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:17.781337 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 209/419] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:01:17.786792 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27d12f-9306-426d-88db-ad5c002e4ee9 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:17.787358 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27d12f-9306-426d-88db-ad5c002e4ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:17.787854 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27d12f-9306-426d-88db-ad5c002e4ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:17.822738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-fe27d12f-9306-426d-88db-ad5c002e4ee9 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:17.823948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fe27d12f-9306-426d-88db-ad5c002e4ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:17.840807 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26b79d-f14a-42ad-abac-8ae0e324f085 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:17.906087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22a3c5-c280-45db-bfd9-d95198a979d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:17.906807 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22a3c5-c280-45db-bfd9-d95198a979d7 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:17.907094 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22a3c5-c280-45db-bfd9-d95198a979d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:17.907369 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22a3c5-c280-45db-bfd9-d95198a979d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:17.908125 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22a3c5-c280-45db-bfd9-d95198a979d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:17.908436 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22a3c5-c280-45db-bfd9-d95198a979d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:17.909820 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22a3c5-c280-45db-bfd9-d95198a979d7 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:17.919736 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 211/420] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:17.931591 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22a3c5-c280-45db-bfd9-d95198a979d7 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:17.967425 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 210/421] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:17.998802 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27d12f-9306-426d-88db-ad5c002e4ee9 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:18.090910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22a3c5-c280-45db-bfd9-d95198a979d7 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:18.120659 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27d12f-9306-426d-88db-ad5c002e4ee9 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:18.134941 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150668c-4525-479a-aef9-9e96c008443b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:18.135934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150668c-4525-479a-aef9-9e96c008443b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:18.136419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150668c-4525-479a-aef9-9e96c008443b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:18.136923 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150668c-4525-479a-aef9-9e96c008443b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:18.158499 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808276a-b90f-445b-8f9e-9556018905ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:18.158499 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808276a-b90f-445b-8f9e-9556018905ec None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:18.158499 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808276a-b90f-445b-8f9e-9556018905ec None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:18.158499 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808276a-b90f-445b-8f9e-9556018905ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:18.174111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808276a-b90f-445b-8f9e-9556018905ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:18.175936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-6808276a-b90f-445b-8f9e-9556018905ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 15:01:18.175936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:18.175936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:18.175936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:18.175936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:18.175936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:18.175936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:18.175936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:18.175936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:18.175936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:18.175936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:18.175936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:18.175936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:18.175936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:18.175936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:18.175936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:18.176863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:18.176863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:18.176863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:18.176863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:18.176863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:18.176863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:18.176863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:18.176863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:18.176863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:18.176863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:18.176863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:18.176863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:18.176863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:18.176863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:18.176863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:18.176863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:18.177659 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:18.177659 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:18.177659 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:18.177659 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:18.177659 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:18.177659 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:18.177659 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:18.177659 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:18.177659 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:18.177659 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:18.177659 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 15:01:18.177659 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:18.177659 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 211/422] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:01:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:01:18.182976 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808276a-b90f-445b-8f9e-9556018905ec None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:18.251941 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150668c-4525-479a-aef9-9e96c008443b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:18.253046 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150668c-4525-479a-aef9-9e96c008443b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:18.306519 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808276a-b90f-445b-8f9e-9556018905ec None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:18.344017 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141dd28c-c2c0-42e1-ba2c-a2598df77b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:18.344773 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141dd28c-c2c0-42e1-ba2c-a2598df77b9c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:18.344969 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141dd28c-c2c0-42e1-ba2c-a2598df77b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:18.345250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141dd28c-c2c0-42e1-ba2c-a2598df77b9c None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:18.346007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141dd28c-c2c0-42e1-ba2c-a2598df77b9c None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:18.346342 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141dd28c-c2c0-42e1-ba2c-a2598df77b9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:18.347899 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141dd28c-c2c0-42e1-ba2c-a2598df77b9c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:18.356603 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 212/423] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:01:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:18.361988 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141dd28c-c2c0-42e1-ba2c-a2598df77b9c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:18.465424 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141dd28c-c2c0-42e1-ba2c-a2598df77b9c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:18.493388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 212/424] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:01:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:01:18.499367 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150668c-4525-479a-aef9-9e96c008443b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:18.499685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24370ad-7a50-4b31-b8c9-40ef2164e87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:18.500349 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24370ad-7a50-4b31-b8c9-40ef2164e87b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:18.500633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24370ad-7a50-4b31-b8c9-40ef2164e87b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:18.500922 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24370ad-7a50-4b31-b8c9-40ef2164e87b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:18.598534 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24370ad-7a50-4b31-b8c9-40ef2164e87b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:18.600374 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24370ad-7a50-4b31-b8c9-40ef2164e87b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:18.712860 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 213/425] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:01:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 15:01:18.719193 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24370ad-7a50-4b31-b8c9-40ef2164e87b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:18.752307 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150668c-4525-479a-aef9-9e96c008443b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:18.823669 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24370ad-7a50-4b31-b8c9-40ef2164e87b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:18.823863 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f14c6-a8aa-4a2f-9967-122fad4081db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:18.825435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f14c6-a8aa-4a2f-9967-122fad4081db None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:18.825719 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f14c6-a8aa-4a2f-9967-122fad4081db None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:18.825998 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f14c6-a8aa-4a2f-9967-122fad4081db None admin] PATH_INFO: `/v3/projects/21716abeaba940d1bdae0c660acc6bc5` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:18.827268 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f14c6-a8aa-4a2f-9967-122fad4081db None admin] RBAC: Authorizing `identity:get_project(project_id=21716abeaba940d1bdae0c660acc6bc5)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:18.828730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f14c6-a8aa-4a2f-9967-122fad4081db None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:18.830645 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 213/426] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:01:18 2022] GET /identity/v3/projects/21716abeaba940d1bdae0c660acc6bc5 => generated 298 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:18.836147 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f14c6-a8aa-4a2f-9967-122fad4081db None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:18.884376 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73adaa8c-5343-4275-a15b-b8f6e982db51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:18.885610 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adaa8c-5343-4275-a15b-b8f6e982db51 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:18.885896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adaa8c-5343-4275-a15b-b8f6e982db51 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:18.886485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adaa8c-5343-4275-a15b-b8f6e982db51 None admin] PATH_INFO: `/v3/projects/21716abeaba940d1bdae0c660acc6bc5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:18.891398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73adaa8c-5343-4275-a15b-b8f6e982db51 None admin] RBAC: Authorizing `identity:get_project(project_id=21716abeaba940d1bdae0c660acc6bc5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:18.893144 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73adaa8c-5343-4275-a15b-b8f6e982db51 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:18.898456 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 214/427] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:01:18 2022] GET /identity/v3/projects/21716abeaba940d1bdae0c660acc6bc5 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:18.903092 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73adaa8c-5343-4275-a15b-b8f6e982db51 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:19.004690 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f14c6-a8aa-4a2f-9967-122fad4081db None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:19.048466 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73adaa8c-5343-4275-a15b-b8f6e982db51 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:19.069777 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b7055-1140-4ed5-a847-aa378722f3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:19.071677 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b7055-1140-4ed5-a847-aa378722f3dd None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:19.072481 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b7055-1140-4ed5-a847-aa378722f3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:19.072939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b7055-1140-4ed5-a847-aa378722f3dd None admin] PATH_INFO: `/v3/groups/c7ccd8ad94de4afb8df700ca9e94b2d9` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:19.074683 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b7055-1140-4ed5-a847-aa378722f3dd None admin] RBAC: Authorizing `identity:get_group(group_id=c7ccd8ad94de4afb8df700ca9e94b2d9)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:19.076660 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b7055-1140-4ed5-a847-aa378722f3dd None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:19.081076 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 214/428] 10.222.0.76 () {56 vars in 1180 bytes} [Mon May 16 15:01:18 2022] GET /identity/v3/groups/c7ccd8ad94de4afb8df700ca9e94b2d9 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:19.083136 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c5912-e0b5-48e4-a6ec-db574695a145 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:19.083584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c5912-e0b5-48e4-a6ec-db574695a145 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:19.084021 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c5912-e0b5-48e4-a6ec-db574695a145 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:19.086082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 215/429] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:19.086881 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c5912-e0b5-48e4-a6ec-db574695a145 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:19.090162 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e73bd-49e1-4913-8299-662c604ccaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:19.091155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e73bd-49e1-4913-8299-662c604ccaa5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:19.091539 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e73bd-49e1-4913-8299-662c604ccaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:19.091937 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e73bd-49e1-4913-8299-662c604ccaa5 None admin] PATH_INFO: `/v3/groups/c7ccd8ad94de4afb8df700ca9e94b2d9` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:19.093244 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e73bd-49e1-4913-8299-662c604ccaa5 None admin] RBAC: Authorizing `identity:get_group(group_id=c7ccd8ad94de4afb8df700ca9e94b2d9)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:19.094837 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e73bd-49e1-4913-8299-662c604ccaa5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:19.096592 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 215/430] 10.222.0.76 () {56 vars in 1180 bytes} [Mon May 16 15:01:18 2022] GET /identity/v3/groups/c7ccd8ad94de4afb8df700ca9e94b2d9 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:19.097831 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a7f52-207a-4314-89ab-86e05c3e397c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:19.102814 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a7f52-207a-4314-89ab-86e05c3e397c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:19.103208 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a7f52-207a-4314-89ab-86e05c3e397c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:19.120326 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e88a7f52-207a-4314-89ab-86e05c3e397c None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:19.122258 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e88a7f52-207a-4314-89ab-86e05c3e397c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:19.191014 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 216/431] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:19.192131 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a7f52-207a-4314-89ab-86e05c3e397c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:19.204856 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c5912-e0b5-48e4-a6ec-db574695a145 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:19.241370 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc40ab3-dc4a-4553-8f56-dd1ad4d41fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:19.242408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc40ab3-dc4a-4553-8f56-dd1ad4d41fab None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:19.242708 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc40ab3-dc4a-4553-8f56-dd1ad4d41fab None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:19.242989 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc40ab3-dc4a-4553-8f56-dd1ad4d41fab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:19.243841 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc40ab3-dc4a-4553-8f56-dd1ad4d41fab None admin] RBAC: Adding query filter params (group.id=c7ccd8ad94de4afb8df700ca9e94b2d9, role.id=00ecc8471dbb4296b40c8b8c0b29aedd, scope.project.id=21716abeaba940d1bdae0c660acc6bc5) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:19.244159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc40ab3-dc4a-4553-8f56-dd1ad4d41fab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:19.245606 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc40ab3-dc4a-4553-8f56-dd1ad4d41fab None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:19.256706 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 216/432] 10.222.0.76 () {56 vars in 1376 bytes} [Mon May 16 15:01:19 2022] GET /identity/v3/role_assignments?group.id=c7ccd8ad94de4afb8df700ca9e94b2d9&scope.project.id=21716abeaba940d1bdae0c660acc6bc5&role.id=00ecc8471dbb4296b40c8b8c0b29aedd => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:19.256706 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761e48d-646f-4bd0-9b99-ddf7e1c52931 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:19.256706 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761e48d-646f-4bd0-9b99-ddf7e1c52931 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:19.256706 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761e48d-646f-4bd0-9b99-ddf7e1c52931 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:19.256706 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 217/433] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:19.256706 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761e48d-646f-4bd0-9b99-ddf7e1c52931 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:19.312270 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a7f52-207a-4314-89ab-86e05c3e397c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:19.357306 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981600b-c046-414c-a942-e5fb750115eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:19.358162 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981600b-c046-414c-a942-e5fb750115eb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:19.358310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981600b-c046-414c-a942-e5fb750115eb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:19.358633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981600b-c046-414c-a942-e5fb750115eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:19.359896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981600b-c046-414c-a942-e5fb750115eb None admin] RBAC: Adding query filter params (group.id=c7ccd8ad94de4afb8df700ca9e94b2d9, role.id=0e00f6ebfc2843a0992b3d01f50e262d, scope.project.id=21716abeaba940d1bdae0c660acc6bc5) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:19.360504 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981600b-c046-414c-a942-e5fb750115eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:19.362197 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981600b-c046-414c-a942-e5fb750115eb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:19.371972 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 217/434] 10.222.0.76 () {56 vars in 1376 bytes} [Mon May 16 15:01:19 2022] GET /identity/v3/role_assignments?group.id=c7ccd8ad94de4afb8df700ca9e94b2d9&scope.project.id=21716abeaba940d1bdae0c660acc6bc5&role.id=0e00f6ebfc2843a0992b3d01f50e262d => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:19.373416 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaa820-0bc2-4a51-baec-2b9bc94cafaa None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:19.373706 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaa820-0bc2-4a51-baec-2b9bc94cafaa None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:19.373987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaa820-0bc2-4a51-baec-2b9bc94cafaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:19.380117 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761e48d-646f-4bd0-9b99-ddf7e1c52931 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:19.414366 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-3abaa820-0bc2-4a51-baec-2b9bc94cafaa None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:19.415582 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3abaa820-0bc2-4a51-baec-2b9bc94cafaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:19.439576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf96b30-985b-4ce8-8a86-bc64079e72c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:19.442178 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf96b30-985b-4ce8-8a86-bc64079e72c1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:19.442178 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf96b30-985b-4ce8-8a86-bc64079e72c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:19.442178 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf96b30-985b-4ce8-8a86-bc64079e72c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:19.469607 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf96b30-985b-4ce8-8a86-bc64079e72c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:19.478460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-ecf96b30-985b-4ce8-8a86-bc64079e72c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 15:01:19.478460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:19.478460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:19.478460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:19.478460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:19.478460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:19.478460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:19.478460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:19.478460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:19.478460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:19.478460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:19.478460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:19.478460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:19.478460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:19.478460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:19.478460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:19.479959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:19.479959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:19.479959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:19.479959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:19.479959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:19.479959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:19.479959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:19.479959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:19.479959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:19.479959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:19.479959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:19.479959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:19.479959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:19.479959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:19.479959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:19.479959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:19.481955 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:19.481955 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:19.481955 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:19.481955 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:19.481955 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:19.481955 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:19.481955 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:19.481955 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:19.481955 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:19.481955 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:19.481955 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 15:01:19.481955 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:19.481955 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 218/435] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:01:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:19.487970 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf96b30-985b-4ce8-8a86-bc64079e72c1 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:19.577511 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 218/436] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:19.602154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abaa820-0bc2-4a51-baec-2b9bc94cafaa None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:19.623437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf96b30-985b-4ce8-8a86-bc64079e72c1 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:19.671933 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efbb4d-52c9-40ea-afa8-7c88ba2b252b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:19.673168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efbb4d-52c9-40ea-afa8-7c88ba2b252b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:19.673607 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efbb4d-52c9-40ea-afa8-7c88ba2b252b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:19.674018 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efbb4d-52c9-40ea-afa8-7c88ba2b252b None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:19.675047 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efbb4d-52c9-40ea-afa8-7c88ba2b252b None admin] RBAC: Adding query filter params (name=member) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:19.675332 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efbb4d-52c9-40ea-afa8-7c88ba2b252b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:19.677340 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efbb4d-52c9-40ea-afa8-7c88ba2b252b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:19.687518 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 219/437] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:01:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:19.688653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710877e9-fdd8-4750-95ff-3398415d9386 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:19.688930 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710877e9-fdd8-4750-95ff-3398415d9386 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:19.689209 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710877e9-fdd8-4750-95ff-3398415d9386 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:19.690767 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 220/438] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:19.693085 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710877e9-fdd8-4750-95ff-3398415d9386 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:19.725340 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abaa820-0bc2-4a51-baec-2b9bc94cafaa None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:19.766235 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa67c1b-0b47-48fe-bc86-0152d325cfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:19.767319 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa67c1b-0b47-48fe-bc86-0152d325cfb4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:19.767740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa67c1b-0b47-48fe-bc86-0152d325cfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:19.768148 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa67c1b-0b47-48fe-bc86-0152d325cfb4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:19.781394 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa67c1b-0b47-48fe-bc86-0152d325cfb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:19.789622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-caa67c1b-0b47-48fe-bc86-0152d325cfb4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 15:01:19.789622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:19.789622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:19.789622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:19.789622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:19.789622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:19.789622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:19.789622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:19.789622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:19.789622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:19.789622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:19.789622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:19.789622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:19.789622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:19.789622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:19.789622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:19.790601 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:19.790601 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:19.790601 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:19.790601 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:19.790601 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:19.790601 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:19.790601 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:19.790601 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:19.790601 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:19.790601 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:19.790601 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:19.790601 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:19.790601 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:19.790601 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:19.790601 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:19.790601 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:19.791851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:19.791851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:19.791851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:19.791851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:19.791851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:19.791851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:19.791851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:19.791851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:19.791851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:19.791851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:19.791851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 15:01:19.791851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:19.791851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 219/439] 10.222.0.76 () {56 vars in 1114 bytes} [Mon May 16 15:01:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:01:19.792762 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e45b8-c29f-40d6-91e2-a4c95df1bab0 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:19.792762 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e45b8-c29f-40d6-91e2-a4c95df1bab0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:19.792762 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e45b8-c29f-40d6-91e2-a4c95df1bab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:19.811054 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-cb9e45b8-c29f-40d6-91e2-a4c95df1bab0 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:19.812553 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cb9e45b8-c29f-40d6-91e2-a4c95df1bab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:19.816555 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710877e9-fdd8-4750-95ff-3398415d9386 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:19.853869 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ea02a-e205-483a-aa22-4a22effd1507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:19.854482 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ea02a-e205-483a-aa22-4a22effd1507 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:19.854773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ea02a-e205-483a-aa22-4a22effd1507 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:19.855044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ea02a-e205-483a-aa22-4a22effd1507 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:19.893563 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 220/440] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:19.894737 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e45b8-c29f-40d6-91e2-a4c95df1bab0 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:19.938312 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ea02a-e205-483a-aa22-4a22effd1507 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:19.939661 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ea02a-e205-483a-aa22-4a22effd1507 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:20.021700 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e45b8-c29f-40d6-91e2-a4c95df1bab0 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:20.050533 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 221/441] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:01:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 15:01:20.051425 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ea02a-e205-483a-aa22-4a22effd1507 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:20.056257 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d45799-fefd-4b69-9ff3-6091e7d3d462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:20.056934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d45799-fefd-4b69-9ff3-6091e7d3d462 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:20.057217 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d45799-fefd-4b69-9ff3-6091e7d3d462 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:20.057495 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d45799-fefd-4b69-9ff3-6091e7d3d462 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:20.058284 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d45799-fefd-4b69-9ff3-6091e7d3d462 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:20.058623 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d45799-fefd-4b69-9ff3-6091e7d3d462 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:20.060022 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d45799-fefd-4b69-9ff3-6091e7d3d462 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:20.067857 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 221/442] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:20.068638 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d45799-fefd-4b69-9ff3-6091e7d3d462 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:20.144945 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ea02a-e205-483a-aa22-4a22effd1507 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:20.163362 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d45799-fefd-4b69-9ff3-6091e7d3d462 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:20.176448 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde381d3-eb3f-4250-86c2-e673bc8d5204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:20.177227 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde381d3-eb3f-4250-86c2-e673bc8d5204 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:20.177511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde381d3-eb3f-4250-86c2-e673bc8d5204 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:20.177787 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde381d3-eb3f-4250-86c2-e673bc8d5204 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:20.187855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde381d3-eb3f-4250-86c2-e673bc8d5204 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:20.194592 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf2dec-8c52-45d2-b1f4-e7e6baf62025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:20.195388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-bde381d3-eb3f-4250-86c2-e673bc8d5204 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:01:20.195388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:20.195388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:20.195388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:20.195388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:20.195388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:20.195388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:20.195388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:20.195388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:20.195388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:20.195388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:20.195388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:20.195388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:20.195388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:20.195388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:20.195388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:20.196261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:20.196261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:20.196261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:20.196261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:20.196261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:20.196261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:20.196261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:20.196261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:20.196261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:20.196261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:20.196261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:20.196261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:20.196261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:20.196261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:20.196261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:20.196261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:20.197060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:20.197060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:20.197060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:20.197060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:20.197060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:20.197060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:20.197060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:20.197060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:20.197060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:20.197060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:20.197060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:01:20.197060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:20.198178 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf2dec-8c52-45d2-b1f4-e7e6baf62025 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:20.198178 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf2dec-8c52-45d2-b1f4-e7e6baf62025 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:20.198178 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf2dec-8c52-45d2-b1f4-e7e6baf62025 None admin] PATH_INFO: `/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:20.198373 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 222/443] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:01:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:20.198437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf2dec-8c52-45d2-b1f4-e7e6baf62025 None admin] RBAC: Authorizing `identity:get_project(project_id=6ff53efad5ea4244a2a900acf4ee3f21)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:20.198502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde381d3-eb3f-4250-86c2-e673bc8d5204 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:20.198689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf2dec-8c52-45d2-b1f4-e7e6baf62025 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:20.200902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 222/444] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:01:20 2022] GET /identity/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21 => generated 302 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:20.202802 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf2dec-8c52-45d2-b1f4-e7e6baf62025 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:20.295156 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde381d3-eb3f-4250-86c2-e673bc8d5204 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:20.295894 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf2dec-8c52-45d2-b1f4-e7e6baf62025 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:20.326219 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8cdff-4770-42f1-bca0-292e9308b855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:20.326844 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8cdff-4770-42f1-bca0-292e9308b855 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:20.327120 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8cdff-4770-42f1-bca0-292e9308b855 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:20.327388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8cdff-4770-42f1-bca0-292e9308b855 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:20.327572 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0f17e-4f4a-4297-8413-34fde9d37fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:20.328224 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0f17e-4f4a-4297-8413-34fde9d37fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:20.328508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0f17e-4f4a-4297-8413-34fde9d37fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:20.328782 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0f17e-4f4a-4297-8413-34fde9d37fd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:20.329527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0f17e-4f4a-4297-8413-34fde9d37fd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:20.329840 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0f17e-4f4a-4297-8413-34fde9d37fd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:20.331238 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0f17e-4f4a-4297-8413-34fde9d37fd0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:20.339019 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 223/445] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:01:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:20.339827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0f17e-4f4a-4297-8413-34fde9d37fd0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:20.391605 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8cdff-4770-42f1-bca0-292e9308b855 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:20.393054 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8cdff-4770-42f1-bca0-292e9308b855 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:20.434669 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0f17e-4f4a-4297-8413-34fde9d37fd0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:20.465904 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12550aa1-763b-418e-8ac7-3cf3ae6bee8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:20.466801 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12550aa1-763b-418e-8ac7-3cf3ae6bee8d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:20.469650 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12550aa1-763b-418e-8ac7-3cf3ae6bee8d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:20.469650 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12550aa1-763b-418e-8ac7-3cf3ae6bee8d None admin] PATH_INFO: `/v3/groups/c7ccd8ad94de4afb8df700ca9e94b2d9` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:20.469650 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12550aa1-763b-418e-8ac7-3cf3ae6bee8d None admin] RBAC: Authorizing `identity:get_group(group_id=c7ccd8ad94de4afb8df700ca9e94b2d9)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:20.469940 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12550aa1-763b-418e-8ac7-3cf3ae6bee8d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:20.471595 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 224/446] 10.222.0.76 () {56 vars in 1180 bytes} [Mon May 16 15:01:20 2022] GET /identity/v3/groups/c7ccd8ad94de4afb8df700ca9e94b2d9 => generated 226 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:20.472351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12550aa1-763b-418e-8ac7-3cf3ae6bee8d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:20.496934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 223/447] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:01:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:01:20.496934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8cdff-4770-42f1-bca0-292e9308b855 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:20.568207 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12550aa1-763b-418e-8ac7-3cf3ae6bee8d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:20.587850 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8cdff-4770-42f1-bca0-292e9308b855 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:20.601449 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf86118-1fd2-4703-bb2e-89182d366fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:20.602094 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf86118-1fd2-4703-bb2e-89182d366fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:20.602402 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf86118-1fd2-4703-bb2e-89182d366fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:20.602678 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf86118-1fd2-4703-bb2e-89182d366fd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:20.620153 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35b388-4f21-4887-8612-4d933310507b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:20.620790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35b388-4f21-4887-8612-4d933310507b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:20.621586 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35b388-4f21-4887-8612-4d933310507b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:20.621855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35b388-4f21-4887-8612-4d933310507b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:20.622701 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35b388-4f21-4887-8612-4d933310507b None admin] RBAC: Adding query filter params (group.id=c7ccd8ad94de4afb8df700ca9e94b2d9, role.id=0e00f6ebfc2843a0992b3d01f50e262d, scope.project.id=6ff53efad5ea4244a2a900acf4ee3f21) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:20.623003 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35b388-4f21-4887-8612-4d933310507b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:20.624427 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35b388-4f21-4887-8612-4d933310507b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:20.630004 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 224/448] 10.222.0.76 () {56 vars in 1376 bytes} [Mon May 16 15:01:20 2022] GET /identity/v3/role_assignments?group.id=c7ccd8ad94de4afb8df700ca9e94b2d9&scope.project.id=6ff53efad5ea4244a2a900acf4ee3f21&role.id=0e00f6ebfc2843a0992b3d01f50e262d => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:20.631071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35b388-4f21-4887-8612-4d933310507b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:20.677830 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf86118-1fd2-4703-bb2e-89182d366fd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:20.680231 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf86118-1fd2-4703-bb2e-89182d366fd2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:20.740767 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35b388-4f21-4887-8612-4d933310507b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:20.776662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ea91b-0457-4fde-b9ff-ea304eefc80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:20.777558 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ea91b-0457-4fde-b9ff-ea304eefc80f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:20.777841 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ea91b-0457-4fde-b9ff-ea304eefc80f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:20.778118 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ea91b-0457-4fde-b9ff-ea304eefc80f None admin] PATH_INFO: `/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:20.779617 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ea91b-0457-4fde-b9ff-ea304eefc80f None admin] RBAC: Authorizing `identity:get_project(project_id=6ff53efad5ea4244a2a900acf4ee3f21)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:20.780860 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ea91b-0457-4fde-b9ff-ea304eefc80f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:20.782784 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 225/449] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:01:20 2022] GET /identity/v3/projects/6ff53efad5ea4244a2a900acf4ee3f21 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:20.788232 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ea91b-0457-4fde-b9ff-ea304eefc80f None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:20.804215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 225/450] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:01:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:01:20.810067 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf86118-1fd2-4703-bb2e-89182d366fd2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:20.897252 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ea91b-0457-4fde-b9ff-ea304eefc80f None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:20.923971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf86118-1fd2-4703-bb2e-89182d366fd2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:20.935013 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5541253-51e7-4836-a01f-5465502f5091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:20.935877 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5541253-51e7-4836-a01f-5465502f5091 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:20.936966 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5541253-51e7-4836-a01f-5465502f5091 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:20.936966 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5541253-51e7-4836-a01f-5465502f5091 None admin] PATH_INFO: `/v3/groups/c7ccd8ad94de4afb8df700ca9e94b2d9` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:20.938191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5541253-51e7-4836-a01f-5465502f5091 None admin] RBAC: Authorizing `identity:get_group(group_id=c7ccd8ad94de4afb8df700ca9e94b2d9)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:20.939178 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5541253-51e7-4836-a01f-5465502f5091 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:20.940818 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 226/451] 10.222.0.76 () {56 vars in 1180 bytes} [Mon May 16 15:01:20 2022] GET /identity/v3/groups/c7ccd8ad94de4afb8df700ca9e94b2d9 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:20.946678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5541253-51e7-4836-a01f-5465502f5091 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:20.966968 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc705d-77b8-4225-8ffd-6a49a868d9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:20.967825 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc705d-77b8-4225-8ffd-6a49a868d9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:20.968101 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc705d-77b8-4225-8ffd-6a49a868d9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:20.968371 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc705d-77b8-4225-8ffd-6a49a868d9f1 None admin] PATH_INFO: `/v3/projects/1c01b64ed2e84249921cacc6ee5ef7ac` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:20.970442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc705d-77b8-4225-8ffd-6a49a868d9f1 None admin] RBAC: Authorizing `identity:get_project(project_id=1c01b64ed2e84249921cacc6ee5ef7ac)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:20.971034 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc705d-77b8-4225-8ffd-6a49a868d9f1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:20.973048 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 226/452] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:01:20 2022] GET /identity/v3/projects/1c01b64ed2e84249921cacc6ee5ef7ac => generated 344 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:20.978223 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc705d-77b8-4225-8ffd-6a49a868d9f1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:21.049373 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5541253-51e7-4836-a01f-5465502f5091 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:21.076903 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc705d-77b8-4225-8ffd-6a49a868d9f1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:21.081214 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f0529-7799-47c3-83e0-8805fbc0b867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:21.081853 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f0529-7799-47c3-83e0-8805fbc0b867 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:21.082158 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f0529-7799-47c3-83e0-8805fbc0b867 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:21.082414 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f0529-7799-47c3-83e0-8805fbc0b867 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:21.083232 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f0529-7799-47c3-83e0-8805fbc0b867 None admin] RBAC: Adding query filter params (group.id=c7ccd8ad94de4afb8df700ca9e94b2d9, role.id=00ecc8471dbb4296b40c8b8c0b29aedd, scope.project.id=6ff53efad5ea4244a2a900acf4ee3f21) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:21.083538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f0529-7799-47c3-83e0-8805fbc0b867 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:21.084963 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f0529-7799-47c3-83e0-8805fbc0b867 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:21.090552 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 227/453] 10.222.0.76 () {56 vars in 1376 bytes} [Mon May 16 15:01:20 2022] GET /identity/v3/role_assignments?group.id=c7ccd8ad94de4afb8df700ca9e94b2d9&scope.project.id=6ff53efad5ea4244a2a900acf4ee3f21&role.id=00ecc8471dbb4296b40c8b8c0b29aedd => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:21.109946 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202aeb34-5a2e-4489-805b-cc17bdb23a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:21.110853 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202aeb34-5a2e-4489-805b-cc17bdb23a6a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:21.111137 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202aeb34-5a2e-4489-805b-cc17bdb23a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:21.111414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202aeb34-5a2e-4489-805b-cc17bdb23a6a None admin] PATH_INFO: `/v3/groups/09977c3cbdf34a659c022034691f53ff` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:21.112677 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202aeb34-5a2e-4489-805b-cc17bdb23a6a None admin] RBAC: Authorizing `identity:get_group(group_id=09977c3cbdf34a659c022034691f53ff)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:21.114195 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202aeb34-5a2e-4489-805b-cc17bdb23a6a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:21.115968 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 227/454] 10.222.0.76 () {56 vars in 1180 bytes} [Mon May 16 15:01:20 2022] GET /identity/v3/groups/09977c3cbdf34a659c022034691f53ff => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:21.122620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f0529-7799-47c3-83e0-8805fbc0b867 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:21.222640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f0529-7799-47c3-83e0-8805fbc0b867 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:21.257102 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3a58c-33ce-41af-bd54-799d7a527b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:21.257760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3a58c-33ce-41af-bd54-799d7a527b85 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:21.258046 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3a58c-33ce-41af-bd54-799d7a527b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:21.258352 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3a58c-33ce-41af-bd54-799d7a527b85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:21.259195 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3a58c-33ce-41af-bd54-799d7a527b85 None admin] RBAC: Adding query filter params (group.id=09977c3cbdf34a659c022034691f53ff, role.id=f6c8fc0dc0f24de3907b0960a1201901, scope.project.id=1c01b64ed2e84249921cacc6ee5ef7ac) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:21.259506 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3a58c-33ce-41af-bd54-799d7a527b85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:21.260959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3a58c-33ce-41af-bd54-799d7a527b85 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:21.266957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 228/455] 10.222.0.76 () {56 vars in 1376 bytes} [Mon May 16 15:01:21 2022] GET /identity/v3/role_assignments?group.id=09977c3cbdf34a659c022034691f53ff&scope.project.id=1c01b64ed2e84249921cacc6ee5ef7ac&role.id=f6c8fc0dc0f24de3907b0960a1201901 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:24.151577 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425a8a3-fdbe-47b5-a939-21800e77b005 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:24.152657 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425a8a3-fdbe-47b5-a939-21800e77b005 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:24.152975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425a8a3-fdbe-47b5-a939-21800e77b005 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:24.155499 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 228/456] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:24.160749 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c567ffc-aa27-4682-a9b9-b10df9f1e12f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:24.161193 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c567ffc-aa27-4682-a9b9-b10df9f1e12f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:24.161369 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c567ffc-aa27-4682-a9b9-b10df9f1e12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:24.184310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5c567ffc-aa27-4682-a9b9-b10df9f1e12f None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:24.185508 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5c567ffc-aa27-4682-a9b9-b10df9f1e12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:24.208308 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38702cc-eadd-43ed-91b8-2927a57ceb97 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:24.208587 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38702cc-eadd-43ed-91b8-2927a57ceb97 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:24.209058 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38702cc-eadd-43ed-91b8-2927a57ceb97 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:24.211248 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 229/457] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:01:24.216687 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5126b-9596-4771-a7c6-4585420b1c7b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:24.217138 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5126b-9596-4771-a7c6-4585420b1c7b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:24.217559 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5126b-9596-4771-a7c6-4585420b1c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:24.245231 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f5a5126b-9596-4771-a7c6-4585420b1c7b None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:24.246748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f5a5126b-9596-4771-a7c6-4585420b1c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:24.278156 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 229/458] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:24.300161 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c567ffc-aa27-4682-a9b9-b10df9f1e12f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:24.345998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 230/459] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:01:24.347404 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbfbb1-5a9a-4013-8a9f-be025986a24a None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:24.347693 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbfbb1-5a9a-4013-8a9f-be025986a24a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:24.347969 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbfbb1-5a9a-4013-8a9f-be025986a24a None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:24.349482 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 231/460] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:24.355541 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3857ec8-6174-465f-85a7-27c085ccdaf4 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:24.355835 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3857ec8-6174-465f-85a7-27c085ccdaf4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:24.356112 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3857ec8-6174-465f-85a7-27c085ccdaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:24.394144 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-d3857ec8-6174-465f-85a7-27c085ccdaf4 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:24.395359 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d3857ec8-6174-465f-85a7-27c085ccdaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:24.408386 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c567ffc-aa27-4682-a9b9-b10df9f1e12f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:24.442635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a0cf5-1320-48ff-8067-b074eee26b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:24.443707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a0cf5-1320-48ff-8067-b074eee26b91 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:24.444137 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a0cf5-1320-48ff-8067-b074eee26b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:24.444551 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a0cf5-1320-48ff-8067-b074eee26b91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:24.455793 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a0cf5-1320-48ff-8067-b074eee26b91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:24.457553 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a0cf5-1320-48ff-8067-b074eee26b91 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:24.478298 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 232/461] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:24.479129 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-222a0cf5-1320-48ff-8067-b074eee26b91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:24.479129 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:24.479129 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:24.479129 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:24.479129 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:24.479129 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:24.479129 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:24.479129 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:24.479129 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:24.479129 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:24.479129 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:24.479129 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:24.479129 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:24.479129 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:24.479129 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:24.480619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:24.480619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:24.480619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:24.480619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:24.480619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:24.480619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:24.480619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:24.480619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:24.480619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:24.480619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:24.480619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:24.480619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:24.480619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:24.480619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:24.480619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:24.480619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:24.480619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:24.481466 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:24.481466 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:24.481466 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:24.481466 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:24.482789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3857ec8-6174-465f-85a7-27c085ccdaf4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:24.494213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 230/462] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:01:24.495233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a0cf5-1320-48ff-8067-b074eee26b91 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:24.593206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3857ec8-6174-465f-85a7-27c085ccdaf4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:24.627346 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575cd47-21b7-4150-88bf-6d5a596ce38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:24.627563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a0cf5-1320-48ff-8067-b074eee26b91 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:24.628614 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575cd47-21b7-4150-88bf-6d5a596ce38e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:24.629104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575cd47-21b7-4150-88bf-6d5a596ce38e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:24.629574 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575cd47-21b7-4150-88bf-6d5a596ce38e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:24.640403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7575cd47-21b7-4150-88bf-6d5a596ce38e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:24.642240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7575cd47-21b7-4150-88bf-6d5a596ce38e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:24.661866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-7575cd47-21b7-4150-88bf-6d5a596ce38e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:24.661866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:24.661866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:24.661866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:24.661866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:24.661866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:24.661866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:24.661866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:24.661866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:24.661866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:24.661866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:24.661866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:24.661866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:24.661866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:24.661866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:24.662751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:24.662751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:24.662751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:24.662751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:24.662751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:24.662751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:24.662751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:24.662751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:24.662751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:24.662751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:24.662751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:24.662751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:24.662751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:24.662751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:24.662751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:24.662751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:24.662751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:24.663587 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:24.663587 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:24.663587 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:24.663587 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:24.663800 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 233/463] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:24.664547 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575cd47-21b7-4150-88bf-6d5a596ce38e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:24.666338 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d95d2-3e6b-45db-a660-2fd7c1a2f284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:24.667079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d95d2-3e6b-45db-a660-2fd7c1a2f284 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:24.667983 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d95d2-3e6b-45db-a660-2fd7c1a2f284 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:24.668343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d95d2-3e6b-45db-a660-2fd7c1a2f284 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:24.669300 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d95d2-3e6b-45db-a660-2fd7c1a2f284 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:24.669669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d95d2-3e6b-45db-a660-2fd7c1a2f284 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:24.671158 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d95d2-3e6b-45db-a660-2fd7c1a2f284 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:24.682357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 231/464] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:24.684351 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715c346-225f-4327-b69e-9aac59a1eb88 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:24.684706 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715c346-225f-4327-b69e-9aac59a1eb88 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:24.685064 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715c346-225f-4327-b69e-9aac59a1eb88 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:24.686379 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 232/465] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:24.687278 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715c346-225f-4327-b69e-9aac59a1eb88 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:24.781297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575cd47-21b7-4150-88bf-6d5a596ce38e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:24.790987 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715c346-225f-4327-b69e-9aac59a1eb88 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:24.818720 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9690d31-6e4b-45ea-bb7e-9a434a0ac203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:24.819594 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9690d31-6e4b-45ea-bb7e-9a434a0ac203 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:24.819865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9690d31-6e4b-45ea-bb7e-9a434a0ac203 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:24.820135 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9690d31-6e4b-45ea-bb7e-9a434a0ac203 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:24.824314 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6358141-a7c8-411f-a367-c504a721348a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:24.824979 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6358141-a7c8-411f-a367-c504a721348a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:24.825265 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6358141-a7c8-411f-a367-c504a721348a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:24.825543 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6358141-a7c8-411f-a367-c504a721348a None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:24.826316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6358141-a7c8-411f-a367-c504a721348a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:24.827054 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6358141-a7c8-411f-a367-c504a721348a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:24.828438 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6358141-a7c8-411f-a367-c504a721348a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:24.830636 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9690d31-6e4b-45ea-bb7e-9a434a0ac203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:24.832069 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9690d31-6e4b-45ea-bb7e-9a434a0ac203 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:24.842023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 233/466] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:24.842861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6358141-a7c8-411f-a367-c504a721348a None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:24.850113 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d9690d31-6e4b-45ea-bb7e-9a434a0ac203 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:24.850113 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:24.850113 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:24.850113 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:24.850113 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:24.850113 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:24.850113 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:24.850113 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:24.850113 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:24.850113 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:24.850113 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:24.850113 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:24.850113 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:24.850113 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:24.850113 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:24.850998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:24.850998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:24.850998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:24.850998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:24.850998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:24.850998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:24.850998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:24.850998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:24.850998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:24.850998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:24.850998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:24.850998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:24.850998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:24.850998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:24.850998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:24.850998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:24.850998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:24.852248 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:24.852248 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:24.852248 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:24.852248 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:24.852248 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 234/467] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:24.854496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741cfbb-3eaf-4e7e-962d-42da36211b6a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:24.855853 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741cfbb-3eaf-4e7e-962d-42da36211b6a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:24.856284 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741cfbb-3eaf-4e7e-962d-42da36211b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:24.873162 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c741cfbb-3eaf-4e7e-962d-42da36211b6a None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:24.874588 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c741cfbb-3eaf-4e7e-962d-42da36211b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:24.939992 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 235/468] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:24.941055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741cfbb-3eaf-4e7e-962d-42da36211b6a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:24.952317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6358141-a7c8-411f-a367-c504a721348a None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:24.986446 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16318a63-704e-4840-a391-6f7019f3b136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:24.987122 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16318a63-704e-4840-a391-6f7019f3b136 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:24.987403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16318a63-704e-4840-a391-6f7019f3b136 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:24.987678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16318a63-704e-4840-a391-6f7019f3b136 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:24.988384 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16318a63-704e-4840-a391-6f7019f3b136 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:24.989867 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16318a63-704e-4840-a391-6f7019f3b136 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:25.046438 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741cfbb-3eaf-4e7e-962d-42da36211b6a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:25.079027 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d333b31-a257-416a-8e3b-da2d9ef62b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:25.079646 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d333b31-a257-416a-8e3b-da2d9ef62b36 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:25.079929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d333b31-a257-416a-8e3b-da2d9ef62b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:25.080209 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d333b31-a257-416a-8e3b-da2d9ef62b36 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:25.080907 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d333b31-a257-416a-8e3b-da2d9ef62b36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:25.082407 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d333b31-a257-416a-8e3b-da2d9ef62b36 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:25.136812 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 234/469] 10.222.0.76 () {60 vars in 1132 bytes} [Mon May 16 15:01:24 2022] POST /identity/v3/users => generated 246 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:01:25.137981 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16318a63-704e-4840-a391-6f7019f3b136 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:25.236509 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 236/470] 10.222.0.76 () {60 vars in 1132 bytes} [Mon May 16 15:01:24 2022] POST /identity/v3/users => generated 248 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:01:25.237158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d333b31-a257-416a-8e3b-da2d9ef62b36 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:25.253404 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16318a63-704e-4840-a391-6f7019f3b136 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:25.295397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe83de-f16f-4a73-9c27-6c5838aed25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:25.296467 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe83de-f16f-4a73-9c27-6c5838aed25b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:25.296959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe83de-f16f-4a73-9c27-6c5838aed25b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:25.297465 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe83de-f16f-4a73-9c27-6c5838aed25b None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:25.298567 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe83de-f16f-4a73-9c27-6c5838aed25b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:25.299106 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe83de-f16f-4a73-9c27-6c5838aed25b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:25.300773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe83de-f16f-4a73-9c27-6c5838aed25b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:25.316197 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 235/471] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:25.326193 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe83de-f16f-4a73-9c27-6c5838aed25b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:25.427661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d333b31-a257-416a-8e3b-da2d9ef62b36 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:25.461451 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe83de-f16f-4a73-9c27-6c5838aed25b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:25.475173 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e1ce1-5c56-4da1-b3b7-eb4d52962a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:25.475991 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e1ce1-5c56-4da1-b3b7-eb4d52962a70 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:25.476271 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e1ce1-5c56-4da1-b3b7-eb4d52962a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:25.476545 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e1ce1-5c56-4da1-b3b7-eb4d52962a70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:25.492886 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e1ce1-5c56-4da1-b3b7-eb4d52962a70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:25.496195 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e1ce1-5c56-4da1-b3b7-eb4d52962a70 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:25.507506 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c15b0-2b22-468c-ba66-86b0e1978747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:25.508173 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c15b0-2b22-468c-ba66-86b0e1978747 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:25.508450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c15b0-2b22-468c-ba66-86b0e1978747 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:25.508722 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c15b0-2b22-468c-ba66-86b0e1978747 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:25.509426 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c15b0-2b22-468c-ba66-86b0e1978747 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:25.510945 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c15b0-2b22-468c-ba66-86b0e1978747 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:25.515325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-4c0e1ce1-5c56-4da1-b3b7-eb4d52962a70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:25.515325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:25.515325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:25.515325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:25.515325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:25.515325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:25.515325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:25.515325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:25.515325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:25.515325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:25.515325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:25.515325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:25.515325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:25.515325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:25.515325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:25.516147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:25.516147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:25.516147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:25.516147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:25.516147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:25.516147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:25.516147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:25.516147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:25.516147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:25.516147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:25.516147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:25.516147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:25.516147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:25.516147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:25.516147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:25.516147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:25.516147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:25.516989 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:25.516989 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:25.516989 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:25.516989 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:25.516989 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 237/472] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:25.517919 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492fbf4-2042-4653-af2f-479c30b936f1 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:25.518021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492fbf4-2042-4653-af2f-479c30b936f1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:25.518325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492fbf4-2042-4653-af2f-479c30b936f1 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:25.520102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 238/473] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:25.524482 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492fbf4-2042-4653-af2f-479c30b936f1 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:25.619531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 236/474] 10.222.0.76 () {60 vars in 1132 bytes} [Mon May 16 15:01:25 2022] POST /identity/v3/users => generated 248 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:01:25.621336 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed2c62-a131-43d8-80b0-ac6c26f604a5 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:25.621836 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed2c62-a131-43d8-80b0-ac6c26f604a5 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:25.622359 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed2c62-a131-43d8-80b0-ac6c26f604a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:25.641566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492fbf4-2042-4653-af2f-479c30b936f1 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:25.642168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-2eed2c62-a131-43d8-80b0-ac6c26f604a5 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:25.643857 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2eed2c62-a131-43d8-80b0-ac6c26f604a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:25.688231 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dda136-1a22-4e27-92bb-9b71c1dd0ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:25.689000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dda136-1a22-4e27-92bb-9b71c1dd0ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:25.689332 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dda136-1a22-4e27-92bb-9b71c1dd0ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:25.689621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dda136-1a22-4e27-92bb-9b71c1dd0ca5 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:25.691120 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dda136-1a22-4e27-92bb-9b71c1dd0ca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:25.691423 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dda136-1a22-4e27-92bb-9b71c1dd0ca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:25.692972 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dda136-1a22-4e27-92bb-9b71c1dd0ca5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:25.709969 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 239/475] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:25.715885 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dda136-1a22-4e27-92bb-9b71c1dd0ca5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:25.726285 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 237/476] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:25.746071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed2c62-a131-43d8-80b0-ac6c26f604a5 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:25.848420 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dda136-1a22-4e27-92bb-9b71c1dd0ca5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:25.854275 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed2c62-a131-43d8-80b0-ac6c26f604a5 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:25.890675 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba26a5-f8be-4809-946a-77d1fa37a6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:25.891771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b67ae-b823-43dc-9855-5eaa030a621f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:25.892087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba26a5-f8be-4809-946a-77d1fa37a6b6 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:25.892435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b67ae-b823-43dc-9855-5eaa030a621f None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:25.892715 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b67ae-b823-43dc-9855-5eaa030a621f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:25.892988 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b67ae-b823-43dc-9855-5eaa030a621f None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:25.893188 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba26a5-f8be-4809-946a-77d1fa37a6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:25.893649 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba26a5-f8be-4809-946a-77d1fa37a6b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:25.893748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b67ae-b823-43dc-9855-5eaa030a621f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:25.894712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba26a5-f8be-4809-946a-77d1fa37a6b6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:25.895145 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b67ae-b823-43dc-9855-5eaa030a621f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:25.896938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba26a5-f8be-4809-946a-77d1fa37a6b6 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:25.936168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.sql.core [None req-e9ba26a5-f8be-4809-946a-77d1fa37a6b6 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 15:01:25.936168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 16 15:01:25.936168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [parameters: {'id': '49a7142eb665485c90c16ee75d8e884b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 16 15:01:25.936168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80320) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 15:01:25.953934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-e9ba26a5-f8be-4809-946a-77d1fa37a6b6 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 16 15:01:25.953934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:25.953934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 15:01:25.953934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 15:01:25.953934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 15:01:25.953934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 15:01:25.953934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 15:01:25.953934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application result = self._query(query) May 16 15:01:25.953934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 15:01:25.953934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application conn.query(q) May 16 15:01:25.953934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 15:01:25.953934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 15:01:25.953934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 15:01:25.953934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application result.read() May 16 15:01:25.953934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 15:01:25.954913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 15:01:25.954913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 15:01:25.954913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 15:01:25.954913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 15:01:25.954913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 15:01:25.954913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 15:01:25.954913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 15:01:25.954913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 15:01:25.954913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:25.954913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 15:01:25.954913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:25.954913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:25.954913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 15:01:25.954913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 15:01:25.954913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 16 15:01:25.954913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return ref.to_dict() May 16 15:01:25.954913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 15:01:25.954913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application next(self.gen) May 16 15:01:25.955797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 15:01:25.955797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application yield resource May 16 15:01:25.955797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 15:01:25.955797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application next(self.gen) May 16 15:01:25.955797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 15:01:25.955797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self.session.rollback() May 16 15:01:25.955797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 15:01:25.955797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self.force_reraise() May 16 15:01:25.955797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 15:01:25.955797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise self.value May 16 15:01:25.955797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 15:01:25.955797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 15:01:25.955797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 15:01:25.955797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application session.commit() May 16 15:01:25.955797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 15:01:25.955797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 15:01:25.955797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 15:01:25.956640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._prepare_impl() May 16 15:01:25.956640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 15:01:25.956640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self.session.flush() May 16 15:01:25.956640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 15:01:25.956640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._flush(objects) May 16 15:01:25.956640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 15:01:25.956640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 15:01:25.956640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 15:01:25.956640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application compat.raise_( May 16 15:01:25.956640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 15:01:25.956640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception May 16 15:01:25.956640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 15:01:25.956640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application flush_context.execute() May 16 15:01:25.956640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 15:01:25.956640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rec.execute(self) May 16 15:01:25.956640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 15:01:25.956640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 15:01:25.957531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 15:01:25.957531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 15:01:25.957531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 16 15:01:25.957531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application c = connection._execute_20( May 16 15:01:25.957531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 15:01:25.957531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 15:01:25.957531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 15:01:25.957531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 15:01:25.957531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 15:01:25.957531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 15:01:25.957531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 15:01:25.957531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 15:01:25.957531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 15:01:25.957531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 15:01:25.957531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 15:01:25.957531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception May 16 15:01:25.958397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 15:01:25.958397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 15:01:25.958397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 15:01:25.958397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 15:01:25.958397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 15:01:25.958397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application result = self._query(query) May 16 15:01:25.958397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 15:01:25.958397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application conn.query(q) May 16 15:01:25.958397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 15:01:25.958397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 15:01:25.958397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 15:01:25.958397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application result.read() May 16 15:01:25.958397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 15:01:25.958397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 15:01:25.958397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 15:01:25.958397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 15:01:25.959256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 15:01:25.959256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 15:01:25.959256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 15:01:25.959256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 15:01:25.959256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 15:01:25.959256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 16 15:01:25.959256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [parameters: {'id': '49a7142eb665485c90c16ee75d8e884b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 16 15:01:25.959256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 15:01:25.959256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:25.959256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:01:25.959256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:25.959256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:25.959256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:25.959256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:25.959256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:25.959256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:25.960059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:25.960059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:25.960059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:25.960059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:25.960059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:25.960059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:25.960059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 16 15:01:25.960059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 16 15:01:25.960059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:25.960059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:25.960059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 16 15:01:25.960059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 16 15:01:25.960059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 15:01:25.960059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 15:01:25.960059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 16 15:01:25.960059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:25.960897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 238/477] 10.222.0.76 () {60 vars in 1131 bytes} [Mon May 16 15:01:25 2022] POST /identity/v3/roles => generated 144 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:25.962288 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba26a5-f8be-4809-946a-77d1fa37a6b6 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:26.006892 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 240/478] 10.222.0.76 () {60 vars in 1132 bytes} [Mon May 16 15:01:25 2022] POST /identity/v3/users => generated 249 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:01:26.078641 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba26a5-f8be-4809-946a-77d1fa37a6b6 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:26.115858 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed640fc4-d3b6-4f62-860b-dc5d62e03af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:26.116689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed640fc4-d3b6-4f62-860b-dc5d62e03af2 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:26.117034 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed640fc4-d3b6-4f62-860b-dc5d62e03af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:26.117321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed640fc4-d3b6-4f62-860b-dc5d62e03af2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:26.129586 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed640fc4-d3b6-4f62-860b-dc5d62e03af2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:26.139074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-ed640fc4-d3b6-4f62-860b-dc5d62e03af2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 15:01:26.139074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:26.139074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:26.139074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:26.139074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:26.139074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:26.139074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:26.139074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:26.139074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:26.139074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:26.139074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:26.139074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:26.139074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:26.139074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:26.139074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:26.139074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:26.140040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:26.140040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:26.140040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:26.140040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:26.140040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:26.140040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:26.140040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:26.140040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:26.140040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:26.140040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:26.140040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:26.140040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:26.140040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:26.140040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:26.140040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:26.140040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:26.141100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:26.141100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:26.141100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:26.141100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:26.141100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:26.141100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:26.141100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:26.141100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:26.141100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:26.141100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:26.141100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 15:01:26.141100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:26.141100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 239/479] 10.222.0.76 () {56 vars in 1114 bytes} [Mon May 16 15:01:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:01:26.147870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b67ae-b823-43dc-9855-5eaa030a621f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:26.271722 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b67ae-b823-43dc-9855-5eaa030a621f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:26.307123 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14baec14-2362-4c65-9d9d-71d707623711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:26.308119 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14baec14-2362-4c65-9d9d-71d707623711 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:26.308580 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14baec14-2362-4c65-9d9d-71d707623711 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:26.309031 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14baec14-2362-4c65-9d9d-71d707623711 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:26.309982 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14baec14-2362-4c65-9d9d-71d707623711 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:26.310502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14baec14-2362-4c65-9d9d-71d707623711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:26.312087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14baec14-2362-4c65-9d9d-71d707623711 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:26.326212 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 241/480] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:27.983258 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2aae3-a1de-45da-87b7-cb466f267aec None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:27.983871 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2aae3-a1de-45da-87b7-cb466f267aec None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:27.983871 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2aae3-a1de-45da-87b7-cb466f267aec None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:27.985452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 240/481] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:27.990343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182fc2e-99a8-404f-9d00-c71115e150f3 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:27.990764 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182fc2e-99a8-404f-9d00-c71115e150f3 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:27.990929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182fc2e-99a8-404f-9d00-c71115e150f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:28.001753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2738ae-b7fc-4a9c-a963-1c00839c4d28 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:28.002031 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2738ae-b7fc-4a9c-a963-1c00839c4d28 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:28.002326 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2738ae-b7fc-4a9c-a963-1c00839c4d28 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:28.003889 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 241/482] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:28.009155 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf43cb-875f-4310-a70d-7d2e1fd1419a None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:28.009439 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf43cb-875f-4310-a70d-7d2e1fd1419a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:28.009713 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf43cb-875f-4310-a70d-7d2e1fd1419a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:28.010777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-5182fc2e-99a8-404f-9d00-c71115e150f3 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:28.012091 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5182fc2e-99a8-404f-9d00-c71115e150f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:28.026556 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d6cf43cb-875f-4310-a70d-7d2e1fd1419a None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:28.027720 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d6cf43cb-875f-4310-a70d-7d2e1fd1419a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:28.106683 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 242/483] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:01:28.112584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 242/484] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:28.130518 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf43cb-875f-4310-a70d-7d2e1fd1419a None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:28.159817 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182fc2e-99a8-404f-9d00-c71115e150f3 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:28.228455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf43cb-875f-4310-a70d-7d2e1fd1419a None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:28.264145 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992c3fe-e6b5-4515-8a8f-2a297f9b6359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:28.264859 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992c3fe-e6b5-4515-8a8f-2a297f9b6359 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:28.265135 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992c3fe-e6b5-4515-8a8f-2a297f9b6359 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:28.265401 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992c3fe-e6b5-4515-8a8f-2a297f9b6359 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:28.283463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992c3fe-e6b5-4515-8a8f-2a297f9b6359 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:28.291086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-8992c3fe-e6b5-4515-8a8f-2a297f9b6359 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:28.291086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:28.291086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:28.291086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:28.291086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:28.291086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:28.291086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:28.291086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:28.291086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:28.291086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:28.291086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:28.291086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:28.291086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:28.291086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:28.291086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:28.291086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:28.293229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:28.293229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:28.293229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:28.293229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:28.293229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:28.293229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:28.293229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:28.293229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:28.293229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:28.293229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:28.293229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:28.293229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:28.293229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:28.293229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:28.293229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:28.293229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:28.295421 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:28.295421 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:28.295421 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:28.295421 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:28.295421 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:28.295421 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:28.295421 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:28.295421 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:28.295421 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:28.295421 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:28.295421 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:28.295421 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:28.310782 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 243/485] 10.222.0.76 () {56 vars in 1102 bytes} [Mon May 16 15:01:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:28.311715 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992c3fe-e6b5-4515-8a8f-2a297f9b6359 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:28.347108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182fc2e-99a8-404f-9d00-c71115e150f3 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:28.399762 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550b116-efea-4c63-91b0-c89677698e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:28.400572 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550b116-efea-4c63-91b0-c89677698e7f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:28.400857 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550b116-efea-4c63-91b0-c89677698e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:28.401137 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550b116-efea-4c63-91b0-c89677698e7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:28.419014 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550b116-efea-4c63-91b0-c89677698e7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:28.426738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-f550b116-efea-4c63-91b0-c89677698e7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:28.426738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:28.426738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:28.426738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:28.426738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:28.426738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:28.426738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:28.426738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:28.426738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:28.426738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:28.426738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:28.426738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:28.426738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:28.426738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:28.426738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:28.426738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:28.428963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:28.428963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:28.428963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:28.428963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:28.428963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:28.428963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:28.428963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:28.428963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:28.428963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:28.428963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:28.428963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:28.428963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:28.428963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:28.428963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:28.428963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:28.428963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:28.430921 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:28.430921 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:28.430921 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:28.430921 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:28.430921 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:28.430921 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:28.430921 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:28.430921 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:28.430921 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:28.430921 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:28.430921 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:28.430921 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:28.430921 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 243/486] 10.222.0.76 () {56 vars in 1102 bytes} [Mon May 16 15:01:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:01:28.436461 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550b116-efea-4c63-91b0-c89677698e7f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:28.436680 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992c3fe-e6b5-4515-8a8f-2a297f9b6359 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:28.468456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f07222-69b8-43f5-a68e-f992a96ce42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:28.469125 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f07222-69b8-43f5-a68e-f992a96ce42e None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:28.469402 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f07222-69b8-43f5-a68e-f992a96ce42e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:28.469677 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f07222-69b8-43f5-a68e-f992a96ce42e None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:28.470475 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f07222-69b8-43f5-a68e-f992a96ce42e None admin] RBAC: Adding query filter params (name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:28.470776 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f07222-69b8-43f5-a68e-f992a96ce42e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:28.472164 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f07222-69b8-43f5-a68e-f992a96ce42e None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:28.500215 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 244/487] 10.222.0.76 () {56 vars in 1103 bytes} [Mon May 16 15:01:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:28.505848 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f07222-69b8-43f5-a68e-f992a96ce42e None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:28.616616 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550b116-efea-4c63-91b0-c89677698e7f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:28.684847 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f279b-6b9c-4755-bd8a-0c164a5b9b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:28.685530 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f279b-6b9c-4755-bd8a-0c164a5b9b00 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:28.685793 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f279b-6b9c-4755-bd8a-0c164a5b9b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:28.686076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f279b-6b9c-4755-bd8a-0c164a5b9b00 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:28.686859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f279b-6b9c-4755-bd8a-0c164a5b9b00 None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:28.687166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f279b-6b9c-4755-bd8a-0c164a5b9b00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:28.688576 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f279b-6b9c-4755-bd8a-0c164a5b9b00 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:28.703306 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f07222-69b8-43f5-a68e-f992a96ce42e None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:28.707005 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 244/488] 10.222.0.76 () {56 vars in 1103 bytes} [Mon May 16 15:01:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:28.715705 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f279b-6b9c-4755-bd8a-0c164a5b9b00 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:28.746419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c666054-dbf2-4652-8dbe-40e478899f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:28.747214 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c666054-dbf2-4652-8dbe-40e478899f81 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:28.747497 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c666054-dbf2-4652-8dbe-40e478899f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:28.747772 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c666054-dbf2-4652-8dbe-40e478899f81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:28.762860 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c666054-dbf2-4652-8dbe-40e478899f81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:28.765011 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c666054-dbf2-4652-8dbe-40e478899f81 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:28.788136 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-3c666054-dbf2-4652-8dbe-40e478899f81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:28.788136 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:28.788136 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:28.788136 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:28.788136 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:28.788136 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:28.788136 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:28.788136 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:28.788136 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:28.788136 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:28.788136 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:28.788136 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:28.788136 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:28.788136 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:28.788136 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:28.790321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:28.790321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:28.790321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:28.790321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:28.790321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:28.790321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:28.790321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:28.790321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:28.790321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:28.790321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:28.790321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:28.790321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:28.790321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:28.790321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:28.790321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:28.790321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:28.790321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:28.792990 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:28.792990 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:28.792990 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:28.792990 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:28.792990 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 245/489] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:01:28.792990 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aee749-b55f-490d-b322-c043a0eb4d95 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:28.792990 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aee749-b55f-490d-b322-c043a0eb4d95 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:28.792990 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aee749-b55f-490d-b322-c043a0eb4d95 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:28.798014 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 246/490] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:28.798014 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aee749-b55f-490d-b322-c043a0eb4d95 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:28.863886 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f279b-6b9c-4755-bd8a-0c164a5b9b00 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:28.910079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898de44-f7da-463d-b6c8-7d25e7a82cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:28.911158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898de44-f7da-463d-b6c8-7d25e7a82cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:28.911439 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898de44-f7da-463d-b6c8-7d25e7a82cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:28.911717 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898de44-f7da-463d-b6c8-7d25e7a82cb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:28.919372 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aee749-b55f-490d-b322-c043a0eb4d95 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:28.924856 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898de44-f7da-463d-b6c8-7d25e7a82cb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:28.926350 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898de44-f7da-463d-b6c8-7d25e7a82cb7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:28.949414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e898de44-f7da-463d-b6c8-7d25e7a82cb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:28.949414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:28.949414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:28.949414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:28.949414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:28.949414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:28.949414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:28.949414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:28.949414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:28.949414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:28.949414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:28.949414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:28.949414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:28.949414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:28.949414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:28.951211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:28.951211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:28.951211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:28.951211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:28.951211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:28.951211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:28.951211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:28.951211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:28.951211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:28.951211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:28.951211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:28.951211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:28.951211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:28.951211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:28.951211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:28.951211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:28.951211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:28.952397 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:28.952397 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:28.952397 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:28.952397 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:28.955172 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 245/491] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:28.955468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cc230-de70-478c-9919-8db0a1d3c9ea None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:28.955753 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cc230-de70-478c-9919-8db0a1d3c9ea None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:28.956027 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cc230-de70-478c-9919-8db0a1d3c9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:28.965259 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c42d7-59a2-4e45-bd97-540876bdddde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:28.966262 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c42d7-59a2-4e45-bd97-540876bdddde None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:28.966754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c42d7-59a2-4e45-bd97-540876bdddde None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:28.967265 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c42d7-59a2-4e45-bd97-540876bdddde None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:28.968256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c42d7-59a2-4e45-bd97-540876bdddde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:28.968764 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c42d7-59a2-4e45-bd97-540876bdddde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:28.971064 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c42d7-59a2-4e45-bd97-540876bdddde None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:28.975227 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c25cc230-de70-478c-9919-8db0a1d3c9ea None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:28.976529 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c25cc230-de70-478c-9919-8db0a1d3c9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:28.987269 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 247/492] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:28.988820 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c42d7-59a2-4e45-bd97-540876bdddde None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:29.051381 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 246/493] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:29.053487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889d3d8-4575-4a61-8091-21bac3129330 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:29.053990 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889d3d8-4575-4a61-8091-21bac3129330 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:29.054498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889d3d8-4575-4a61-8091-21bac3129330 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:29.060828 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 247/494] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:29.061809 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889d3d8-4575-4a61-8091-21bac3129330 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:29.089356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c42d7-59a2-4e45-bd97-540876bdddde None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:29.123560 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50365a55-64de-4ad0-92ca-15af98498795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:29.124252 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50365a55-64de-4ad0-92ca-15af98498795 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:29.124446 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50365a55-64de-4ad0-92ca-15af98498795 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:29.124669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50365a55-64de-4ad0-92ca-15af98498795 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:29.125476 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50365a55-64de-4ad0-92ca-15af98498795 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:29.125675 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50365a55-64de-4ad0-92ca-15af98498795 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:29.127083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50365a55-64de-4ad0-92ca-15af98498795 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:29.138934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 248/495] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:29.140150 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36820302-2543-4741-9c53-416bec7906d1 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:29.140433 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36820302-2543-4741-9c53-416bec7906d1 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:29.140707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36820302-2543-4741-9c53-416bec7906d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:29.157754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-36820302-2543-4741-9c53-416bec7906d1 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:29.158961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-36820302-2543-4741-9c53-416bec7906d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:29.165145 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889d3d8-4575-4a61-8091-21bac3129330 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:29.197600 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85123d1f-da11-4cef-bf04-8a0084abc4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:29.199020 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85123d1f-da11-4cef-bf04-8a0084abc4ad None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:29.199300 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85123d1f-da11-4cef-bf04-8a0084abc4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:29.199570 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85123d1f-da11-4cef-bf04-8a0084abc4ad None admin] PATH_INFO: `/v3/users/glance` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:29.206417 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85123d1f-da11-4cef-bf04-8a0084abc4ad None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:29.207866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85123d1f-da11-4cef-bf04-8a0084abc4ad None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:29.221575 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 249/496] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:29.222444 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36820302-2543-4741-9c53-416bec7906d1 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:29.222960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-85123d1f-da11-4cef-bf04-8a0084abc4ad None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 15:01:29.222960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:29.222960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:29.222960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:29.222960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:29.222960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:29.222960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:29.222960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:29.222960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:29.222960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:29.222960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:29.222960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:29.222960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:01:29.222960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:01:29.222960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:01:29.222960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:01:29.223858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:29.223858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:29.223858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:01:29.223858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:29.223858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:01:29.223858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:29.223858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:29.223858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:29.223858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:29.223858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:29.223858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:29.223858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:29.223858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:29.223858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:29.223858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:29.223858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:29.223858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:29.223858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:29.224756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:29.224756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:29.224756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:01:29.224756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:01:29.224756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:01:29.224756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:01:29.224756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:01:29.224756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:01:29.224756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 15:01:29.224756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:29.228532 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 248/497] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:01:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:29.229224 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85123d1f-da11-4cef-bf04-8a0084abc4ad None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:29.323974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85123d1f-da11-4cef-bf04-8a0084abc4ad None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:29.327683 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36820302-2543-4741-9c53-416bec7906d1 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:29.355432 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b129b-446b-4d10-bf56-bdbc1b579320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:29.356204 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b129b-446b-4d10-bf56-bdbc1b579320 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:29.356487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b129b-446b-4d10-bf56-bdbc1b579320 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:29.356757 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b129b-446b-4d10-bf56-bdbc1b579320 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:29.359623 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d001a68-3511-4df2-bbbf-15da5ef62bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:29.360398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d001a68-3511-4df2-bbbf-15da5ef62bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:29.360675 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d001a68-3511-4df2-bbbf-15da5ef62bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:29.360947 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d001a68-3511-4df2-bbbf-15da5ef62bd1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:29.363647 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b129b-446b-4d10-bf56-bdbc1b579320 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:29.365112 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b129b-446b-4d10-bf56-bdbc1b579320 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:29.371134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d001a68-3511-4df2-bbbf-15da5ef62bd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:29.378779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-1d001a68-3511-4df2-bbbf-15da5ef62bd1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:29.378779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:29.378779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:29.378779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:29.378779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:29.378779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:29.378779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:29.378779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:29.378779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:29.378779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:29.378779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:29.378779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:29.378779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:29.378779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:29.378779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:29.378779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:29.379795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:29.379795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:29.379795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:29.379795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:29.379795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:29.379795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:29.379795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:29.379795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:29.379795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:29.379795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:29.379795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:29.379795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:29.379795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:29.379795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:29.379795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:29.379795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:29.380933 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:29.380933 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:29.380933 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:29.380933 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:29.380933 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:29.380933 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:29.380933 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:29.380933 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:29.380933 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:29.380933 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:29.380933 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:29.380933 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:29.380933 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 250/498] 10.222.0.76 () {56 vars in 1102 bytes} [Mon May 16 15:01:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:29.381978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-758b129b-446b-4d10-bf56-bdbc1b579320 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 15:01:29.381978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:29.381978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:29.381978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:29.381978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:29.381978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:29.381978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:29.381978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:29.381978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:29.381978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:29.381978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:29.381978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:29.381978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:01:29.381978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:01:29.381978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:01:29.381978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:01:29.383303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:29.383303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:29.383303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:01:29.383303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:29.383303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:01:29.383303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:29.383303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:29.383303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:29.383303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:29.383303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:29.383303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:29.383303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:29.383303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:29.383303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:29.383303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:29.383303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:29.383303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:29.383303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:29.385006 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:29.385006 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:29.385006 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:01:29.385006 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:01:29.385006 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:01:29.385006 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:01:29.385006 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:01:29.385006 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:01:29.385006 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 15:01:29.385006 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:29.386666 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd62c1-a9cd-48d3-9829-66eb43adccf5 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:29.386752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 249/499] 10.222.0.76 () {56 vars in 1093 bytes} [Mon May 16 15:01:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:29.386752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b129b-446b-4d10-bf56-bdbc1b579320 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:29.386902 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd62c1-a9cd-48d3-9829-66eb43adccf5 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:29.386902 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd62c1-a9cd-48d3-9829-66eb43adccf5 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:29.388051 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 251/500] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:29.388764 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd62c1-a9cd-48d3-9829-66eb43adccf5 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:29.476926 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b129b-446b-4d10-bf56-bdbc1b579320 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:29.483432 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd62c1-a9cd-48d3-9829-66eb43adccf5 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:29.508777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77506cc-8423-4b0b-9ce9-398789a49313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:29.509436 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77506cc-8423-4b0b-9ce9-398789a49313 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:29.509717 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77506cc-8423-4b0b-9ce9-398789a49313 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:29.510001 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77506cc-8423-4b0b-9ce9-398789a49313 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:29.511377 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77506cc-8423-4b0b-9ce9-398789a49313 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:29.511690 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77506cc-8423-4b0b-9ce9-398789a49313 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:29.513120 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77506cc-8423-4b0b-9ce9-398789a49313 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:29.515166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce3e6c-e58f-441a-a981-1c6bc25562de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:29.515970 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce3e6c-e58f-441a-a981-1c6bc25562de None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:29.516254 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce3e6c-e58f-441a-a981-1c6bc25562de None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:29.516529 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce3e6c-e58f-441a-a981-1c6bc25562de None admin] PATH_INFO: `/v3/roles/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:29.527011 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce3e6c-e58f-441a-a981-1c6bc25562de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:29.534761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-1cce3e6c-e58f-441a-a981-1c6bc25562de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:29.534761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:29.534761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:29.534761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:29.534761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:29.534761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:29.534761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:29.534761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:29.534761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:29.534761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:29.534761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:29.534761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:29.534761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:29.534761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:29.534761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:29.534761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:29.536964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:29.536964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:29.536964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:29.536964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:29.536964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:29.536964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:29.536964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:29.536964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:29.536964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:29.536964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:29.536964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:29.536964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:29.536964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:29.536964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:29.536964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:29.536964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:29.537765 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:29.537765 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:29.537765 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:29.537765 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:29.537765 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:29.537765 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:29.537765 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:29.537765 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:29.537765 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:29.537765 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:29.537765 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:29.537765 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:29.537765 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 252/501] 10.222.0.76 () {56 vars in 1102 bytes} [Mon May 16 15:01:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:29.537765 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce3e6c-e58f-441a-a981-1c6bc25562de None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:29.550869 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 250/502] 10.222.0.76 () {56 vars in 1137 bytes} [Mon May 16 15:01:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:29.551707 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77506cc-8423-4b0b-9ce9-398789a49313 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:29.636713 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce3e6c-e58f-441a-a981-1c6bc25562de None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:29.646336 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77506cc-8423-4b0b-9ce9-398789a49313 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:29.667301 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db122aa2-622b-4e84-a48e-da109c072ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:29.667996 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db122aa2-622b-4e84-a48e-da109c072ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:29.668280 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db122aa2-622b-4e84-a48e-da109c072ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:29.668557 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db122aa2-622b-4e84-a48e-da109c072ea9 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:29.669309 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db122aa2-622b-4e84-a48e-da109c072ea9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:29.669622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db122aa2-622b-4e84-a48e-da109c072ea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:29.671042 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db122aa2-622b-4e84-a48e-da109c072ea9 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:29.678450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039433c-03a3-4549-b6ee-467b557836e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:29.678732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 253/503] 10.222.0.76 () {56 vars in 1103 bytes} [Mon May 16 15:01:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:29.679104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039433c-03a3-4549-b6ee-467b557836e9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:29.679382 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039433c-03a3-4549-b6ee-467b557836e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:29.679655 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039433c-03a3-4549-b6ee-467b557836e9 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:29.679911 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca31df1-41c2-494e-9276-67905d22d540 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:29.680199 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca31df1-41c2-494e-9276-67905d22d540 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:29.680477 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039433c-03a3-4549-b6ee-467b557836e9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:29.680573 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca31df1-41c2-494e-9276-67905d22d540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:29.680781 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039433c-03a3-4549-b6ee-467b557836e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:29.682228 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039433c-03a3-4549-b6ee-467b557836e9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:29.696492 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-aca31df1-41c2-494e-9276-67905d22d540 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:29.697662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-aca31df1-41c2-494e-9276-67905d22d540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:29.699850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 251/504] 10.222.0.76 () {56 vars in 1133 bytes} [Mon May 16 15:01:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:29.700653 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039433c-03a3-4549-b6ee-467b557836e9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:29.765678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 254/505] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:29.766540 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca31df1-41c2-494e-9276-67905d22d540 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:29.794259 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039433c-03a3-4549-b6ee-467b557836e9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:29.825521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f78653-d846-4b77-b6ac-e8a642d8c991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:29.826205 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f78653-d846-4b77-b6ac-e8a642d8c991 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:29.826486 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f78653-d846-4b77-b6ac-e8a642d8c991 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:29.826757 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f78653-d846-4b77-b6ac-e8a642d8c991 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:29.827490 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f78653-d846-4b77-b6ac-e8a642d8c991 None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:29.827787 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f78653-d846-4b77-b6ac-e8a642d8c991 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:29.829155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f78653-d846-4b77-b6ac-e8a642d8c991 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:29.836612 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 252/506] 10.222.0.76 () {56 vars in 1103 bytes} [Mon May 16 15:01:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:29.837418 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f78653-d846-4b77-b6ac-e8a642d8c991 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:29.861259 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca31df1-41c2-494e-9276-67905d22d540 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:29.894811 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624e2d4-763e-4dd6-85e0-647d1875a9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:29.895387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624e2d4-763e-4dd6-85e0-647d1875a9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:29.895670 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624e2d4-763e-4dd6-85e0-647d1875a9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:29.895947 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624e2d4-763e-4dd6-85e0-647d1875a9c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:29.931535 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f78653-d846-4b77-b6ac-e8a642d8c991 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:29.963925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2ec94-daf1-4bc8-8ccf-332045706fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:29.964700 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2ec94-daf1-4bc8-8ccf-332045706fed None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:29.964918 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624e2d4-763e-4dd6-85e0-647d1875a9c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:29.965015 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2ec94-daf1-4bc8-8ccf-332045706fed None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:29.965230 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2ec94-daf1-4bc8-8ccf-332045706fed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:29.966451 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624e2d4-763e-4dd6-85e0-647d1875a9c4 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:29.975263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2ec94-daf1-4bc8-8ccf-332045706fed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:29.976690 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2ec94-daf1-4bc8-8ccf-332045706fed None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:29.992752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e1c2ec94-daf1-4bc8-8ccf-332045706fed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:29.992752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:29.992752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:29.992752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:29.992752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:29.992752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:29.992752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:29.992752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:29.992752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:29.992752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:29.992752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:29.992752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:29.992752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:29.992752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:29.992752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:29.993602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:29.993602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:29.993602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:29.993602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:29.993602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:29.993602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:29.993602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:29.993602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:29.993602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:29.993602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:29.993602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:29.993602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:29.993602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:29.993602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:29.993602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:29.993602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:29.993602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:29.994718 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:29.994718 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:29.994718 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:29.994718 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:29.994718 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 253/507] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:29.994718 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2ec94-daf1-4bc8-8ccf-332045706fed None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:30.060352 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 255/508] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:01:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:01:30.061900 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624e2d4-763e-4dd6-85e0-647d1875a9c4 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:30.093417 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2ec94-daf1-4bc8-8ccf-332045706fed None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:30.129420 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbdf2d-2fe7-4eeb-85b1-1f1c240e4ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:30.130814 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbdf2d-2fe7-4eeb-85b1-1f1c240e4ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:30.131320 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbdf2d-2fe7-4eeb-85b1-1f1c240e4ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:30.131808 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbdf2d-2fe7-4eeb-85b1-1f1c240e4ab8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:30.157335 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624e2d4-763e-4dd6-85e0-647d1875a9c4 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:30.189786 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a88891-97a1-47ad-9fca-9feecc8ea1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:30.190710 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a88891-97a1-47ad-9fca-9feecc8ea1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:30.191063 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a88891-97a1-47ad-9fca-9feecc8ea1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:30.191406 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a88891-97a1-47ad-9fca-9feecc8ea1b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:30.196241 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbdf2d-2fe7-4eeb-85b1-1f1c240e4ab8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:30.197713 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbdf2d-2fe7-4eeb-85b1-1f1c240e4ab8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:30.201735 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a88891-97a1-47ad-9fca-9feecc8ea1b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:30.203197 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a88891-97a1-47ad-9fca-9feecc8ea1b0 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:30.221930 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-32a88891-97a1-47ad-9fca-9feecc8ea1b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:30.221930 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:30.221930 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:30.221930 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:30.221930 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:30.221930 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:30.221930 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:30.221930 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:30.221930 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:30.221930 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:30.221930 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:30.221930 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:30.221930 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:30.221930 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:30.221930 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:30.222928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:30.222928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:30.222928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:30.222928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:30.222928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:30.222928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:30.222928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:30.222928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:30.222928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:30.222928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:30.222928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:30.222928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:30.222928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:30.222928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:30.222928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:30.222928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:30.222928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:30.223801 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:30.223801 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:30.223801 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:30.223801 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:30.223801 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 256/509] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:30.224076 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a88891-97a1-47ad-9fca-9feecc8ea1b0 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:30.316560 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a88891-97a1-47ad-9fca-9feecc8ea1b0 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:30.330578 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 254/510] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:01:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:01:30.331425 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbdf2d-2fe7-4eeb-85b1-1f1c240e4ab8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:30.353096 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5149af0-235b-465f-ba91-0b4551485635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:30.353884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5149af0-235b-465f-ba91-0b4551485635 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:30.354190 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5149af0-235b-465f-ba91-0b4551485635 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:30.354477 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5149af0-235b-465f-ba91-0b4551485635 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:30.364769 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5149af0-235b-465f-ba91-0b4551485635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:30.366262 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5149af0-235b-465f-ba91-0b4551485635 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:30.383913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-e5149af0-235b-465f-ba91-0b4551485635 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:30.383913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:30.383913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:30.383913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:30.383913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:30.383913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:30.383913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:30.383913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:30.383913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:30.383913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:30.383913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:30.383913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:30.383913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:30.383913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:30.383913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:30.384785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:30.384785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:30.384785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:30.384785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:30.384785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:30.384785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:30.384785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:30.384785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:30.384785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:30.384785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:30.384785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:30.384785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:30.384785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:30.384785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:30.384785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:30.384785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:30.384785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:30.386220 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:30.386220 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:30.386220 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:30.386220 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:30.386220 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 257/511] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:30.386889 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5149af0-235b-465f-ba91-0b4551485635 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:30.425364 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbdf2d-2fe7-4eeb-85b1-1f1c240e4ab8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:30.457353 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf8d65-0137-497e-9e7a-a84dab19a266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:30.458000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf8d65-0137-497e-9e7a-a84dab19a266 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:30.458306 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf8d65-0137-497e-9e7a-a84dab19a266 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:30.458580 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf8d65-0137-497e-9e7a-a84dab19a266 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:30.459285 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf8d65-0137-497e-9e7a-a84dab19a266 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:30.459584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf8d65-0137-497e-9e7a-a84dab19a266 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:30.460958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf8d65-0137-497e-9e7a-a84dab19a266 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:30.471530 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 255/512] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:30.472305 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf8d65-0137-497e-9e7a-a84dab19a266 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:30.479454 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5149af0-235b-465f-ba91-0b4551485635 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:30.512612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f797424-9282-4fad-8e11-8ddf453ff261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:30.513391 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f797424-9282-4fad-8e11-8ddf453ff261 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:30.513671 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f797424-9282-4fad-8e11-8ddf453ff261 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:30.513946 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f797424-9282-4fad-8e11-8ddf453ff261 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:30.523618 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f797424-9282-4fad-8e11-8ddf453ff261 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:30.525090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f797424-9282-4fad-8e11-8ddf453ff261 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:30.542785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-2f797424-9282-4fad-8e11-8ddf453ff261 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:30.542785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:30.542785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:30.542785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:30.542785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:30.542785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:30.542785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:30.542785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:30.542785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:30.542785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:30.542785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:30.542785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:30.542785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:30.542785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:30.542785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:30.543624 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:30.543624 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:30.543624 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:30.543624 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:30.543624 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:30.543624 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:30.543624 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:30.543624 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:30.543624 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:30.543624 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:30.543624 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:30.543624 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:30.543624 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:30.543624 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:30.543624 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:30.543624 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:30.543624 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:30.544485 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:30.544485 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:30.544485 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:30.544485 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:30.544485 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 258/513] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:30.544741 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f797424-9282-4fad-8e11-8ddf453ff261 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:30.565746 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf8d65-0137-497e-9e7a-a84dab19a266 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:30.599431 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88981c22-724d-4ca3-9d23-21e1c5dac74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:30.600086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88981c22-724d-4ca3-9d23-21e1c5dac74a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:30.600365 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88981c22-724d-4ca3-9d23-21e1c5dac74a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:30.600633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88981c22-724d-4ca3-9d23-21e1c5dac74a None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:30.601341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88981c22-724d-4ca3-9d23-21e1c5dac74a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:30.601642 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88981c22-724d-4ca3-9d23-21e1c5dac74a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:30.603055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88981c22-724d-4ca3-9d23-21e1c5dac74a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:30.615496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 256/514] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:30.616299 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88981c22-724d-4ca3-9d23-21e1c5dac74a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:30.644605 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f797424-9282-4fad-8e11-8ddf453ff261 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:30.677659 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462b76f-ae75-4338-9a4e-4977640933dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:30.678396 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462b76f-ae75-4338-9a4e-4977640933dd None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:30.678676 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462b76f-ae75-4338-9a4e-4977640933dd None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:30.678952 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462b76f-ae75-4338-9a4e-4977640933dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:30.688482 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462b76f-ae75-4338-9a4e-4977640933dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:30.689937 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462b76f-ae75-4338-9a4e-4977640933dd None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:30.706494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-d462b76f-ae75-4338-9a4e-4977640933dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:30.706494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:30.706494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:30.706494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:30.706494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:30.706494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:30.706494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:30.706494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:30.706494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:30.706494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:30.706494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:30.706494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:30.706494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:30.706494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:30.706494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:30.707501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:30.707501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:30.707501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:30.707501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:30.707501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:30.707501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:30.707501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:30.707501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:30.707501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:30.707501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:30.707501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:30.707501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:30.707501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:30.707501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:30.707501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:30.707501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:30.707501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:30.708533 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:30.708533 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:30.708533 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:30.708533 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:30.708533 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 259/515] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:30.708533 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462b76f-ae75-4338-9a4e-4977640933dd None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:30.711208 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88981c22-724d-4ca3-9d23-21e1c5dac74a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:30.743911 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f7ef1-ce94-402d-a8b4-a194e5af97a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:30.744562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f7ef1-ce94-402d-a8b4-a194e5af97a5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:30.744844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f7ef1-ce94-402d-a8b4-a194e5af97a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:30.745143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f7ef1-ce94-402d-a8b4-a194e5af97a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:30.745854 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f7ef1-ce94-402d-a8b4-a194e5af97a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:30.746185 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f7ef1-ce94-402d-a8b4-a194e5af97a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:30.747542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f7ef1-ce94-402d-a8b4-a194e5af97a5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:30.758506 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 257/516] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:30.759280 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f7ef1-ce94-402d-a8b4-a194e5af97a5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:30.808455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462b76f-ae75-4338-9a4e-4977640933dd None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:30.841264 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87242c94-cb9c-4e73-98de-9a924d9a344c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:30.842077 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87242c94-cb9c-4e73-98de-9a924d9a344c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:30.842394 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87242c94-cb9c-4e73-98de-9a924d9a344c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:30.842672 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87242c94-cb9c-4e73-98de-9a924d9a344c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:30.849497 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87242c94-cb9c-4e73-98de-9a924d9a344c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:30.850970 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87242c94-cb9c-4e73-98de-9a924d9a344c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:30.862573 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f7ef1-ce94-402d-a8b4-a194e5af97a5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:30.866598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-87242c94-cb9c-4e73-98de-9a924d9a344c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 15:01:30.866598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:30.866598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:30.866598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:30.866598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:30.866598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:30.866598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:30.866598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:30.866598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:30.866598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:30.866598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:30.866598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:30.866598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:01:30.866598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:01:30.866598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:01:30.866598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:01:30.867456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:30.867456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:30.867456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:01:30.867456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:30.867456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:01:30.867456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:30.867456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:30.867456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:30.867456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:30.867456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:30.867456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:30.867456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:30.867456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:30.867456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:30.867456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:30.867456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:30.867456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:30.867456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:30.868376 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:30.868376 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:30.868376 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:01:30.868376 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:01:30.868376 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:01:30.868376 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:01:30.868376 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:01:30.868376 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:01:30.868376 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 15:01:30.868376 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:30.868376 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 260/517] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:01:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:30.868929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87242c94-cb9c-4e73-98de-9a924d9a344c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:30.894839 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cc606-f376-447f-9e07-1d78c41bbe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:30.895490 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cc606-f376-447f-9e07-1d78c41bbe92 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:30.895769 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cc606-f376-447f-9e07-1d78c41bbe92 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:30.896041 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cc606-f376-447f-9e07-1d78c41bbe92 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:30.896756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cc606-f376-447f-9e07-1d78c41bbe92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:30.897060 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cc606-f376-447f-9e07-1d78c41bbe92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:30.898457 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cc606-f376-447f-9e07-1d78c41bbe92 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:30.910091 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 258/518] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:30.910968 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cc606-f376-447f-9e07-1d78c41bbe92 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:30.966476 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87242c94-cb9c-4e73-98de-9a924d9a344c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:30.998719 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70faecc-8a18-48ae-8c47-18a299923fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:30.999374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70faecc-8a18-48ae-8c47-18a299923fed None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:30.999655 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70faecc-8a18-48ae-8c47-18a299923fed None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:30.999934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70faecc-8a18-48ae-8c47-18a299923fed None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:31.000631 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70faecc-8a18-48ae-8c47-18a299923fed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:31.002064 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70faecc-8a18-48ae-8c47-18a299923fed None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:31.006403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cc606-f376-447f-9e07-1d78c41bbe92 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:31.037892 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9a1c2-daca-455e-b3ab-8fdf82c3c26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:31.038573 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9a1c2-daca-455e-b3ab-8fdf82c3c26a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:31.038855 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9a1c2-daca-455e-b3ab-8fdf82c3c26a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:31.039130 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9a1c2-daca-455e-b3ab-8fdf82c3c26a None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:31.039846 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9a1c2-daca-455e-b3ab-8fdf82c3c26a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:31.040152 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9a1c2-daca-455e-b3ab-8fdf82c3c26a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:31.041554 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9a1c2-daca-455e-b3ab-8fdf82c3c26a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:31.052801 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 259/519] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:31.053579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9a1c2-daca-455e-b3ab-8fdf82c3c26a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:31.095256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 261/520] 10.222.0.76 () {60 vars in 1132 bytes} [Mon May 16 15:01:30 2022] POST /identity/v3/users => generated 247 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:01:31.096073 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70faecc-8a18-48ae-8c47-18a299923fed None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:31.154913 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9a1c2-daca-455e-b3ab-8fdf82c3c26a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:31.191103 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42721a89-416a-446a-adac-cca492c87a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:31.191916 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42721a89-416a-446a-adac-cca492c87a84 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:31.192200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42721a89-416a-446a-adac-cca492c87a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:31.192477 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42721a89-416a-446a-adac-cca492c87a84 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:31.200872 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42721a89-416a-446a-adac-cca492c87a84 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:31.201434 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70faecc-8a18-48ae-8c47-18a299923fed None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:31.202408 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42721a89-416a-446a-adac-cca492c87a84 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:31.218103 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-42721a89-416a-446a-adac-cca492c87a84 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 15:01:31.218103 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:31.218103 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:31.218103 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:31.218103 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:31.218103 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:31.218103 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:31.218103 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:31.218103 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:31.218103 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:31.218103 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:31.218103 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:31.218103 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:01:31.218103 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:01:31.218103 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:01:31.218103 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:01:31.219053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:31.219053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:31.219053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:01:31.219053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:31.219053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:01:31.219053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:31.219053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:31.219053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:31.219053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:31.219053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:31.219053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:31.219053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:31.219053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:31.219053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:31.219053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:31.219053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:31.219053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:31.219053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:31.225044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:31.225044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:31.225044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:01:31.225044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:01:31.225044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:01:31.225044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:01:31.225044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:01:31.225044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:01:31.225044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 15:01:31.225044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:31.225044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 260/521] 10.222.0.76 () {56 vars in 1102 bytes} [Mon May 16 15:01:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:31.225044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42721a89-416a-446a-adac-cca492c87a84 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:31.237044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfcfcd-7c56-4119-ae6d-d6f54be6f6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:31.237726 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfcfcd-7c56-4119-ae6d-d6f54be6f6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:31.238010 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfcfcd-7c56-4119-ae6d-d6f54be6f6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:31.238320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfcfcd-7c56-4119-ae6d-d6f54be6f6c2 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:31.239183 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfcfcd-7c56-4119-ae6d-d6f54be6f6c2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:31.239496 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfcfcd-7c56-4119-ae6d-d6f54be6f6c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:31.240979 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfcfcd-7c56-4119-ae6d-d6f54be6f6c2 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:31.281214 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 262/522] 10.222.0.76 () {56 vars in 1137 bytes} [Mon May 16 15:01:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:31.282435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfcfcd-7c56-4119-ae6d-d6f54be6f6c2 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:31.328768 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42721a89-416a-446a-adac-cca492c87a84 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:31.361602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6b5bc-1214-409e-8e68-c4cdd3938b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:31.362441 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6b5bc-1214-409e-8e68-c4cdd3938b14 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:31.362730 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6b5bc-1214-409e-8e68-c4cdd3938b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:31.363005 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6b5bc-1214-409e-8e68-c4cdd3938b14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:31.370549 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6b5bc-1214-409e-8e68-c4cdd3938b14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:31.372018 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6b5bc-1214-409e-8e68-c4cdd3938b14 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:31.387523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e3b6b5bc-1214-409e-8e68-c4cdd3938b14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:31.387523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:31.387523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:31.387523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:31.387523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:31.387523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:31.387523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:31.387523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:31.387523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:31.387523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:31.387523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:31.387523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:31.387523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:01:31.387523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:01:31.387523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:01:31.388370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:01:31.388370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:31.388370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:31.388370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:31.388370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:31.388370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:31.388370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:31.388370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:31.388370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:31.388370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:31.388370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:31.388370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:31.388370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:31.388370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:31.388370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:31.388370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:31.388370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:31.389215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:01:31.389215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:01:31.389215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:01:31.389215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:01:31.389215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:01:31.389215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:01:31.389215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:31.389215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:31.389215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 261/523] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:31.390155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6b5bc-1214-409e-8e68-c4cdd3938b14 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:31.397673 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfcfcd-7c56-4119-ae6d-d6f54be6f6c2 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:31.430164 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ddf17-ab0b-4eae-941b-62ac2871717d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:31.430957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ddf17-ab0b-4eae-941b-62ac2871717d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:31.431234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ddf17-ab0b-4eae-941b-62ac2871717d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:31.431500 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ddf17-ab0b-4eae-941b-62ac2871717d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:31.438826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ddf17-ab0b-4eae-941b-62ac2871717d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:31.440231 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ddf17-ab0b-4eae-941b-62ac2871717d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:31.454910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-d20ddf17-ab0b-4eae-941b-62ac2871717d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:31.454910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:31.454910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:31.454910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:31.454910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:31.454910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:31.454910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:31.454910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:31.454910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:31.454910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:31.454910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:31.454910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:31.454910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:01:31.454910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:01:31.454910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:01:31.455773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:01:31.455773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:31.455773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:31.455773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:31.455773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:31.455773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:31.455773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:31.455773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:31.455773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:31.455773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:31.455773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:31.455773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:31.455773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:31.455773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:31.455773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:31.455773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:31.455773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:31.456593 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:01:31.456593 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:01:31.456593 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:01:31.456593 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:01:31.456593 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:01:31.456593 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:01:31.456593 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:31.456593 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:31.460748 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 263/524] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:31.467055 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ddf17-ab0b-4eae-941b-62ac2871717d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:31.489611 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6b5bc-1214-409e-8e68-c4cdd3938b14 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:31.524101 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9b1c9-8d93-4f54-8c51-a3d5719d46ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:31.524761 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9b1c9-8d93-4f54-8c51-a3d5719d46ff None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:31.525038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9b1c9-8d93-4f54-8c51-a3d5719d46ff None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:31.525315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9b1c9-8d93-4f54-8c51-a3d5719d46ff None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:31.526234 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9b1c9-8d93-4f54-8c51-a3d5719d46ff None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:31.527053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9b1c9-8d93-4f54-8c51-a3d5719d46ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:31.528484 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9b1c9-8d93-4f54-8c51-a3d5719d46ff None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:31.545891 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 262/525] 10.222.0.76 () {56 vars in 1139 bytes} [Mon May 16 15:01:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:31.551196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9b1c9-8d93-4f54-8c51-a3d5719d46ff None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:31.568685 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ddf17-ab0b-4eae-941b-62ac2871717d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:31.604381 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e4c83-97b4-4eec-b972-c41896e52f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:31.605262 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e4c83-97b4-4eec-b972-c41896e52f6e None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:31.605685 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e4c83-97b4-4eec-b972-c41896e52f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:31.606101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e4c83-97b4-4eec-b972-c41896e52f6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:31.649730 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9b1c9-8d93-4f54-8c51-a3d5719d46ff None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:31.673257 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e4c83-97b4-4eec-b972-c41896e52f6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:31.674834 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e4c83-97b4-4eec-b972-c41896e52f6e None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:31.683104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e09632-47a1-4dd1-96e8-b70f9ac51967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:31.683769 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e09632-47a1-4dd1-96e8-b70f9ac51967 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:31.684051 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e09632-47a1-4dd1-96e8-b70f9ac51967 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:31.684325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e09632-47a1-4dd1-96e8-b70f9ac51967 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:31.685106 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e09632-47a1-4dd1-96e8-b70f9ac51967 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:31.685632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e09632-47a1-4dd1-96e8-b70f9ac51967 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:31.686846 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e09632-47a1-4dd1-96e8-b70f9ac51967 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:31.705221 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 263/526] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:01:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:31.706073 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e09632-47a1-4dd1-96e8-b70f9ac51967 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:31.773299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 264/527] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:01:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:01:31.774482 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e4c83-97b4-4eec-b972-c41896e52f6e None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:31.805748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e09632-47a1-4dd1-96e8-b70f9ac51967 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:31.838012 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139b7cf-7b10-4505-af48-cf9e5de1664d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:31.838745 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139b7cf-7b10-4505-af48-cf9e5de1664d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:31.839022 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139b7cf-7b10-4505-af48-cf9e5de1664d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:31.839290 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139b7cf-7b10-4505-af48-cf9e5de1664d None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:31.840068 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139b7cf-7b10-4505-af48-cf9e5de1664d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:31.840372 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139b7cf-7b10-4505-af48-cf9e5de1664d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:31.841808 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139b7cf-7b10-4505-af48-cf9e5de1664d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:31.858162 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 264/528] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:01:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:31.858162 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139b7cf-7b10-4505-af48-cf9e5de1664d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:31.872670 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e4c83-97b4-4eec-b972-c41896e52f6e None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:31.907925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04721fbc-0625-45c7-86be-0e90ce6bd504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:31.908575 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04721fbc-0625-45c7-86be-0e90ce6bd504 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:31.908853 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04721fbc-0625-45c7-86be-0e90ce6bd504 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:31.909125 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04721fbc-0625-45c7-86be-0e90ce6bd504 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:31.955867 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139b7cf-7b10-4505-af48-cf9e5de1664d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:31.975169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04721fbc-0625-45c7-86be-0e90ce6bd504 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:31.976716 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04721fbc-0625-45c7-86be-0e90ce6bd504 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:31.989716 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd514f2-f222-4ba1-bd2d-aaee6ad92036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:31.990393 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd514f2-f222-4ba1-bd2d-aaee6ad92036 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:31.990675 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd514f2-f222-4ba1-bd2d-aaee6ad92036 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:31.990947 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd514f2-f222-4ba1-bd2d-aaee6ad92036 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:31.991775 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd514f2-f222-4ba1-bd2d-aaee6ad92036 None admin] RBAC: Adding query filter params (role.id=f63aad4ab4a04108b87e1bf4ea8dfa53, scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9, user.id=2d1e67aa4370453fafb5b6525ba13cd3) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:31.992081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd514f2-f222-4ba1-bd2d-aaee6ad92036 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:31.993502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd514f2-f222-4ba1-bd2d-aaee6ad92036 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:31.999769 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 265/529] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:01:31 2022] GET /identity/v3/role_assignments?user.id=2d1e67aa4370453fafb5b6525ba13cd3&scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9&role.id=f63aad4ab4a04108b87e1bf4ea8dfa53 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:32.000631 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd514f2-f222-4ba1-bd2d-aaee6ad92036 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:32.090720 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 265/530] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:01:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:01:32.092225 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04721fbc-0625-45c7-86be-0e90ce6bd504 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:32.109711 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd514f2-f222-4ba1-bd2d-aaee6ad92036 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:32.152060 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41056edd-2ae7-4280-9e59-fcb6c1134139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:32.153173 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41056edd-2ae7-4280-9e59-fcb6c1134139 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:32.153173 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41056edd-2ae7-4280-9e59-fcb6c1134139 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:32.153453 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41056edd-2ae7-4280-9e59-fcb6c1134139 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:32.164587 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41056edd-2ae7-4280-9e59-fcb6c1134139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:32.166076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41056edd-2ae7-4280-9e59-fcb6c1134139 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:32.185293 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-41056edd-2ae7-4280-9e59-fcb6c1134139 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:32.185293 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:32.185293 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:32.185293 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:32.185293 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:32.185293 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:32.185293 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:32.185293 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:32.185293 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:32.185293 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:32.185293 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:32.185293 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:32.185293 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:32.185293 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:32.185293 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:32.186245 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:32.186245 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:32.186245 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:32.186245 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:32.186245 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:32.186245 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:32.186245 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:32.186245 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:32.186245 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:32.186245 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:32.186245 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:32.186245 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:32.186245 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:32.186245 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:32.186245 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:32.186245 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:32.186245 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:32.187086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:32.187086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:32.187086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:32.187086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:32.187086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 266/531] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:32.187771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41056edd-2ae7-4280-9e59-fcb6c1134139 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:32.212208 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04721fbc-0625-45c7-86be-0e90ce6bd504 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:32.247134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67fd81-c85e-48c8-b49c-9cda3cdf45e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:32.247804 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67fd81-c85e-48c8-b49c-9cda3cdf45e7 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:32.248086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67fd81-c85e-48c8-b49c-9cda3cdf45e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:32.248357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67fd81-c85e-48c8-b49c-9cda3cdf45e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:32.249218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67fd81-c85e-48c8-b49c-9cda3cdf45e7 None admin] RBAC: Adding query filter params (role.id=f63aad4ab4a04108b87e1bf4ea8dfa53, scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9, user.id=9d85024f010c40129d79543b3ec4cfae) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:32.249530 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67fd81-c85e-48c8-b49c-9cda3cdf45e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:32.251060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67fd81-c85e-48c8-b49c-9cda3cdf45e7 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:32.257966 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 266/532] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:01:32 2022] GET /identity/v3/role_assignments?user.id=9d85024f010c40129d79543b3ec4cfae&scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9&role.id=f63aad4ab4a04108b87e1bf4ea8dfa53 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:32.258944 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67fd81-c85e-48c8-b49c-9cda3cdf45e7 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:32.294345 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41056edd-2ae7-4280-9e59-fcb6c1134139 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:32.329359 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b0152-d2ee-4060-8098-6d4927934c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:32.330556 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b0152-d2ee-4060-8098-6d4927934c39 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:32.331031 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b0152-d2ee-4060-8098-6d4927934c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:32.331527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b0152-d2ee-4060-8098-6d4927934c39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:32.343164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b0152-d2ee-4060-8098-6d4927934c39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:32.344973 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b0152-d2ee-4060-8098-6d4927934c39 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:32.363920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67fd81-c85e-48c8-b49c-9cda3cdf45e7 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:32.382161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-b25b0152-d2ee-4060-8098-6d4927934c39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:32.382161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:32.382161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:32.382161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:32.382161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:32.382161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:32.382161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:32.382161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:32.382161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:32.382161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:32.382161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:32.382161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:32.382161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:32.382161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:32.382161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:32.383093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:32.383093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:32.383093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:32.383093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:32.383093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:32.383093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:32.383093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:32.383093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:32.383093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:32.383093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:32.383093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:32.383093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:32.383093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:32.383093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:32.383093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:32.383093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:32.383093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:32.383906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:32.383906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:32.383906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:32.383906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:32.386569 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 267/533] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:32.392160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b0152-d2ee-4060-8098-6d4927934c39 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:32.414869 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3421a65-5e65-4207-8ccf-d32a78fe3353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:32.422633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3421a65-5e65-4207-8ccf-d32a78fe3353 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:32.422633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3421a65-5e65-4207-8ccf-d32a78fe3353 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:32.422633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3421a65-5e65-4207-8ccf-d32a78fe3353 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:32.422633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3421a65-5e65-4207-8ccf-d32a78fe3353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:32.422633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3421a65-5e65-4207-8ccf-d32a78fe3353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:32.422633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3421a65-5e65-4207-8ccf-d32a78fe3353 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:32.442118 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 267/534] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:32.451342 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3421a65-5e65-4207-8ccf-d32a78fe3353 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:32.555347 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b0152-d2ee-4060-8098-6d4927934c39 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:32.626619 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2a0c4-8601-4c46-afd3-b9d78cfa4b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:32.627289 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2a0c4-8601-4c46-afd3-b9d78cfa4b75 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:32.627567 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2a0c4-8601-4c46-afd3-b9d78cfa4b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:32.627840 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2a0c4-8601-4c46-afd3-b9d78cfa4b75 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:32.628613 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2a0c4-8601-4c46-afd3-b9d78cfa4b75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:32.628920 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2a0c4-8601-4c46-afd3-b9d78cfa4b75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:32.630595 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2a0c4-8601-4c46-afd3-b9d78cfa4b75 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:32.632217 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3421a65-5e65-4207-8ccf-d32a78fe3353 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:32.656327 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 268/535] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:32.667162 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2a0c4-8601-4c46-afd3-b9d78cfa4b75 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:32.680141 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073b9a7-64dc-4b42-a3eb-d2af6b918110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:32.680950 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073b9a7-64dc-4b42-a3eb-d2af6b918110 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:32.681230 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073b9a7-64dc-4b42-a3eb-d2af6b918110 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:32.681507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073b9a7-64dc-4b42-a3eb-d2af6b918110 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:32.692688 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4073b9a7-64dc-4b42-a3eb-d2af6b918110 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:32.694167 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4073b9a7-64dc-4b42-a3eb-d2af6b918110 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:32.726169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-4073b9a7-64dc-4b42-a3eb-d2af6b918110 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:32.726169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:32.726169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:32.726169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:32.726169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:32.726169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:32.726169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:32.726169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:32.726169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:32.726169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:32.726169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:32.726169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:32.726169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:01:32.726169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:01:32.726169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:01:32.727071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:01:32.727071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:32.727071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:32.727071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:32.727071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:32.727071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:32.727071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:32.727071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:32.727071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:32.727071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:32.727071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:32.727071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:32.727071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:32.727071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:32.727071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:32.727071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:32.727071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:32.727903 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:01:32.727903 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:01:32.727903 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:01:32.727903 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:01:32.727903 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:01:32.727903 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:01:32.727903 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:32.727903 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:32.730484 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 268/536] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:32.737698 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073b9a7-64dc-4b42-a3eb-d2af6b918110 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:32.833729 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2a0c4-8601-4c46-afd3-b9d78cfa4b75 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:32.892591 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073b9a7-64dc-4b42-a3eb-d2af6b918110 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:32.902682 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03d82f-9889-49f1-bb9d-69dcb151286c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:32.903488 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03d82f-9889-49f1-bb9d-69dcb151286c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:32.903770 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03d82f-9889-49f1-bb9d-69dcb151286c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:32.904046 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03d82f-9889-49f1-bb9d-69dcb151286c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:32.914477 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03d82f-9889-49f1-bb9d-69dcb151286c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:32.915957 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03d82f-9889-49f1-bb9d-69dcb151286c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:32.948599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-cb03d82f-9889-49f1-bb9d-69dcb151286c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:32.948599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:32.948599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:32.948599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:32.948599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:32.948599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:32.948599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:32.948599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:32.948599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:32.948599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:32.948599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:32.948599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:32.948599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:01:32.948599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:01:32.948599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:01:32.949487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:01:32.949487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:32.949487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:32.949487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:32.949487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:32.949487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:32.949487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:32.949487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:32.949487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:32.949487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:32.949487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:32.949487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:32.949487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:32.949487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:32.949487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:32.949487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:32.949487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:32.950352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:01:32.950352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:01:32.950352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:01:32.950352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:01:32.950352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:01:32.950352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:01:32.950352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:32.950352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:32.954117 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 269/537] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:32.962376 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03d82f-9889-49f1-bb9d-69dcb151286c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:32.988260 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a3678-8ec6-4507-ab15-22695550fd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:32.988950 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a3678-8ec6-4507-ab15-22695550fd33 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:32.989237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a3678-8ec6-4507-ab15-22695550fd33 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:32.989515 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a3678-8ec6-4507-ab15-22695550fd33 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:32.990355 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a3678-8ec6-4507-ab15-22695550fd33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:32.990670 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a3678-8ec6-4507-ab15-22695550fd33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:32.997727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a3678-8ec6-4507-ab15-22695550fd33 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:33.025427 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 269/538] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:01:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:33.026649 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a3678-8ec6-4507-ab15-22695550fd33 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:33.165218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a3678-8ec6-4507-ab15-22695550fd33 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:33.250918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03d82f-9889-49f1-bb9d-69dcb151286c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:33.254025 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adff86-05f4-4c66-8ef8-ec36987af413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:33.254973 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adff86-05f4-4c66-8ef8-ec36987af413 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:33.255257 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adff86-05f4-4c66-8ef8-ec36987af413 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:33.255531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adff86-05f4-4c66-8ef8-ec36987af413 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:33.256370 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8adff86-05f4-4c66-8ef8-ec36987af413 None admin] RBAC: Adding query filter params (role.id=f63aad4ab4a04108b87e1bf4ea8dfa53, scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9, user.id=496e1178104d468e9b7ce53ea754ec74) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:33.256678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8adff86-05f4-4c66-8ef8-ec36987af413 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:33.258148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8adff86-05f4-4c66-8ef8-ec36987af413 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:33.266951 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 270/539] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:01:33 2022] GET /identity/v3/role_assignments?user.id=496e1178104d468e9b7ce53ea754ec74&scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9&role.id=f63aad4ab4a04108b87e1bf4ea8dfa53 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:33.328732 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc778a3b-6b85-4710-88fe-f45aa5bce71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:33.329926 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc778a3b-6b85-4710-88fe-f45aa5bce71f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:33.330993 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc778a3b-6b85-4710-88fe-f45aa5bce71f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:33.331748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc778a3b-6b85-4710-88fe-f45aa5bce71f None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:33.333069 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc778a3b-6b85-4710-88fe-f45aa5bce71f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:33.334722 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc778a3b-6b85-4710-88fe-f45aa5bce71f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:33.336681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc778a3b-6b85-4710-88fe-f45aa5bce71f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:33.360384 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 270/540] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:01:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:33.366334 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adff86-05f4-4c66-8ef8-ec36987af413 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:33.555990 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adff86-05f4-4c66-8ef8-ec36987af413 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:33.626960 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27767117-3296-452f-8e0d-2b522a0df4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:33.627645 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27767117-3296-452f-8e0d-2b522a0df4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:33.627928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27767117-3296-452f-8e0d-2b522a0df4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:33.628203 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27767117-3296-452f-8e0d-2b522a0df4a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:33.629052 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27767117-3296-452f-8e0d-2b522a0df4a8 None admin] RBAC: Adding query filter params (role.id=f63aad4ab4a04108b87e1bf4ea8dfa53, scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9, user.id=15ff90527ece4406be62f449bdf71d93) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:33.629365 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27767117-3296-452f-8e0d-2b522a0df4a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:33.631398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27767117-3296-452f-8e0d-2b522a0df4a8 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:33.646998 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 271/541] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:01:33 2022] GET /identity/v3/role_assignments?user.id=15ff90527ece4406be62f449bdf71d93&scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9&role.id=f63aad4ab4a04108b87e1bf4ea8dfa53 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:33.687824 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498ae07-260a-42f2-ae38-d3d292a58285 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:33.688471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498ae07-260a-42f2-ae38-d3d292a58285 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:33.688948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498ae07-260a-42f2-ae38-d3d292a58285 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:33.690666 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 271/542] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:33.700880 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f375a-16b8-4df0-b9d9-03234740a7b0 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:33.701207 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f375a-16b8-4df0-b9d9-03234740a7b0 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:33.701442 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f375a-16b8-4df0-b9d9-03234740a7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:33.734568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-ed4f375a-16b8-4df0-b9d9-03234740a7b0 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:33.741704 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ed4f375a-16b8-4df0-b9d9-03234740a7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:33.876892 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 272/543] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:01:33.901666 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498ae07-260a-42f2-ae38-d3d292a58285 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:34.038238 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498ae07-260a-42f2-ae38-d3d292a58285 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:34.091410 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1721a-c020-4fe0-835f-54a36ede67ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:34.092219 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1721a-c020-4fe0-835f-54a36ede67ae None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:34.092505 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1721a-c020-4fe0-835f-54a36ede67ae None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:34.092782 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1721a-c020-4fe0-835f-54a36ede67ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:34.107003 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1721a-c020-4fe0-835f-54a36ede67ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:34.114673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-22b1721a-c020-4fe0-835f-54a36ede67ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:34.114673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:34.114673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:34.114673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:34.114673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:34.114673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:34.114673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:34.114673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:34.114673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:34.114673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:34.114673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:34.114673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:34.114673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:34.114673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:34.114673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:34.114673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:34.115543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:34.115543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:34.115543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:34.115543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:34.115543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:34.115543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:34.115543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:34.115543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:34.115543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:34.115543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:34.115543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:34.115543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:34.115543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:34.115543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:34.115543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:34.115543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:34.116741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:34.116741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:34.116741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:34.116741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:34.116741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:34.116741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:34.116741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:34.116741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:34.116741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:34.116741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:34.116741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:34.116741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:34.116741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 272/544] 10.222.0.76 () {56 vars in 1102 bytes} [Mon May 16 15:01:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:34.122511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f375a-16b8-4df0-b9d9-03234740a7b0 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:34.237834 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f375a-16b8-4df0-b9d9-03234740a7b0 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:34.278239 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7925c55-481d-4f23-9bfe-5a2f5ef70af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:34.279018 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7925c55-481d-4f23-9bfe-5a2f5ef70af1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:34.279176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7925c55-481d-4f23-9bfe-5a2f5ef70af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:34.279451 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7925c55-481d-4f23-9bfe-5a2f5ef70af1 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:34.280220 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7925c55-481d-4f23-9bfe-5a2f5ef70af1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:34.280529 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7925c55-481d-4f23-9bfe-5a2f5ef70af1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:34.281923 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7925c55-481d-4f23-9bfe-5a2f5ef70af1 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:34.290624 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 273/545] 10.222.0.76 () {56 vars in 1103 bytes} [Mon May 16 15:01:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:34.296798 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1721a-c020-4fe0-835f-54a36ede67ae None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:34.415590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1721a-c020-4fe0-835f-54a36ede67ae None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:34.455091 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b739b6-2e44-4717-953c-ac6e2384de6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:34.455904 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b739b6-2e44-4717-953c-ac6e2384de6b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:34.456187 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b739b6-2e44-4717-953c-ac6e2384de6b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:34.456465 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b739b6-2e44-4717-953c-ac6e2384de6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:34.467656 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b739b6-2e44-4717-953c-ac6e2384de6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:34.469120 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b739b6-2e44-4717-953c-ac6e2384de6b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:34.495859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-c4b739b6-2e44-4717-953c-ac6e2384de6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:34.495859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:34.495859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:34.495859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:34.495859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:34.495859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:34.495859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:34.495859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:34.495859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:34.495859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:34.495859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:34.495859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:34.495859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:34.495859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:34.495859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:34.497999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:34.497999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:34.497999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:34.497999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:34.497999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:34.497999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:34.497999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:34.497999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:34.497999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:34.497999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:34.497999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:34.497999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:34.497999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:34.497999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:34.497999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:34.497999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:34.497999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:34.500136 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:34.500136 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:34.500136 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:34.500136 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:34.500136 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 273/546] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:34.503088 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7925c55-481d-4f23-9bfe-5a2f5ef70af1 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:34.649459 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7925c55-481d-4f23-9bfe-5a2f5ef70af1 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:34.692953 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67f66c-c932-4c0b-827a-4406c63091e6 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:34.693288 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67f66c-c932-4c0b-827a-4406c63091e6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:34.693537 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67f66c-c932-4c0b-827a-4406c63091e6 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:34.695633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 274/547] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:01:34.696433 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21643144-2a90-4924-8483-9c53a6aae453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:34.697388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21643144-2a90-4924-8483-9c53a6aae453 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:34.703564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54637a9-2e68-4f15-a93c-9627bf68e0d0 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:34.703564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54637a9-2e68-4f15-a93c-9627bf68e0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:34.703564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54637a9-2e68-4f15-a93c-9627bf68e0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:34.704660 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21643144-2a90-4924-8483-9c53a6aae453 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:34.705324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21643144-2a90-4924-8483-9c53a6aae453 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:34.706760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21643144-2a90-4924-8483-9c53a6aae453 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:34.707420 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21643144-2a90-4924-8483-9c53a6aae453 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:34.709807 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21643144-2a90-4924-8483-9c53a6aae453 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:34.720811 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c54637a9-2e68-4f15-a93c-9627bf68e0d0 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:34.722230 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c54637a9-2e68-4f15-a93c-9627bf68e0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:34.741010 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 274/548] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:34.746521 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21643144-2a90-4924-8483-9c53a6aae453 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:34.811814 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 275/549] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:01:34.887183 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54637a9-2e68-4f15-a93c-9627bf68e0d0 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:34.942851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21643144-2a90-4924-8483-9c53a6aae453 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:34.985334 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65653ffe-dcd9-4cb6-8be9-fe6d78ba3fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:34.986120 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65653ffe-dcd9-4cb6-8be9-fe6d78ba3fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:34.986444 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65653ffe-dcd9-4cb6-8be9-fe6d78ba3fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:34.986750 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65653ffe-dcd9-4cb6-8be9-fe6d78ba3fc8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:35.000840 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65653ffe-dcd9-4cb6-8be9-fe6d78ba3fc8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:35.002406 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65653ffe-dcd9-4cb6-8be9-fe6d78ba3fc8 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:35.017717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-65653ffe-dcd9-4cb6-8be9-fe6d78ba3fc8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 15:01:35.017717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:35.017717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:35.017717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:35.017717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:35.017717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:35.017717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:35.017717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:35.017717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:35.017717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:35.017717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:35.017717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:35.017717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:01:35.017717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:01:35.017717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:01:35.017717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:01:35.018687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:35.018687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:35.018687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:01:35.018687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:35.018687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:01:35.018687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:35.018687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:35.018687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:35.018687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:35.018687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:35.018687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:35.018687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:35.018687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:35.018687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:35.018687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:35.018687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:35.018687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:35.018687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:35.019995 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:35.019995 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:35.019995 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:01:35.019995 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:01:35.019995 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:01:35.019995 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:01:35.019995 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:01:35.019995 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:01:35.019995 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 15:01:35.019995 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:35.019995 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 275/550] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:01:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:01:35.021252 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54637a9-2e68-4f15-a93c-9627bf68e0d0 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:35.024647 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65653ffe-dcd9-4cb6-8be9-fe6d78ba3fc8 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:35.071158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c35fc-c1ae-42f0-9669-d60ff1c5619e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:35.072883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c35fc-c1ae-42f0-9669-d60ff1c5619e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:35.073723 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c35fc-c1ae-42f0-9669-d60ff1c5619e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:35.074540 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c35fc-c1ae-42f0-9669-d60ff1c5619e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:35.100324 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c35fc-c1ae-42f0-9669-d60ff1c5619e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:35.121069 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-cd2c35fc-c1ae-42f0-9669-d60ff1c5619e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:35.121069 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:35.121069 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:35.121069 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:35.121069 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:35.121069 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:35.121069 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:35.121069 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:35.121069 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:35.121069 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:35.121069 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:35.121069 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:35.121069 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:35.121069 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:35.121069 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:35.121069 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:35.122591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:35.122591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:35.122591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:35.122591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:35.122591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:35.122591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:35.122591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:35.122591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:35.122591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:35.122591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:35.122591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:35.122591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:35.122591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:35.122591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:35.122591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:35.122591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:35.123883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:35.123883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:35.123883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:35.123883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:35.123883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:35.123883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:35.123883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:35.123883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:35.123883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:35.123883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:35.123883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:35.123883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:35.127976 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 276/551] 10.222.0.76 () {56 vars in 1102 bytes} [Mon May 16 15:01:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:01:35.130497 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a5b4a-bd13-4c3a-8a64-876603955d27 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:35.131188 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a5b4a-bd13-4c3a-8a64-876603955d27 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:35.131700 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a5b4a-bd13-4c3a-8a64-876603955d27 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:35.133990 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 277/552] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:35.135400 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a5b4a-bd13-4c3a-8a64-876603955d27 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:35.145906 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65653ffe-dcd9-4cb6-8be9-fe6d78ba3fc8 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:35.181555 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac1cf7-d900-4a56-ab40-f7be3affc626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:35.182884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac1cf7-d900-4a56-ab40-f7be3affc626 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:35.183256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac1cf7-d900-4a56-ab40-f7be3affc626 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:35.183652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac1cf7-d900-4a56-ab40-f7be3affc626 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:35.184743 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac1cf7-d900-4a56-ab40-f7be3affc626 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:35.185114 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac1cf7-d900-4a56-ab40-f7be3affc626 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:35.186770 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac1cf7-d900-4a56-ab40-f7be3affc626 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:35.209381 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 276/553] 10.222.0.76 () {56 vars in 1135 bytes} [Mon May 16 15:01:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:35.210934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa8b91-df36-4829-8cfa-ac5a526e045e None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:35.211308 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa8b91-df36-4829-8cfa-ac5a526e045e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:35.211650 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa8b91-df36-4829-8cfa-ac5a526e045e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:35.228508 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-e7aa8b91-df36-4829-8cfa-ac5a526e045e None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:35.230349 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e7aa8b91-df36-4829-8cfa-ac5a526e045e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:35.258734 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a5b4a-bd13-4c3a-8a64-876603955d27 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:35.294445 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a64b8-9764-47ab-9575-fa109a9d0cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:35.295430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a64b8-9764-47ab-9575-fa109a9d0cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:35.295916 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a64b8-9764-47ab-9575-fa109a9d0cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:35.296408 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a64b8-9764-47ab-9575-fa109a9d0cc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:35.297370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a64b8-9764-47ab-9575-fa109a9d0cc9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:35.298332 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a64b8-9764-47ab-9575-fa109a9d0cc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:35.300040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a64b8-9764-47ab-9575-fa109a9d0cc9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:35.306463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 277/554] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:35.307995 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa8b91-df36-4829-8cfa-ac5a526e045e None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:35.310415 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 278/555] 10.222.0.76 () {56 vars in 1103 bytes} [Mon May 16 15:01:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:35.323735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a64b8-9764-47ab-9575-fa109a9d0cc9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:35.420637 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa8b91-df36-4829-8cfa-ac5a526e045e None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:35.448701 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a64b8-9764-47ab-9575-fa109a9d0cc9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:35.468872 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6eafe3-5399-4986-969d-096165257cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:35.469921 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6eafe3-5399-4986-969d-096165257cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:35.470711 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6eafe3-5399-4986-969d-096165257cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:35.471326 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6eafe3-5399-4986-969d-096165257cb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:35.507489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf62269-bd89-45db-a7fe-670bae1dcc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:35.508603 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf62269-bd89-45db-a7fe-670bae1dcc6b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:35.508939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf62269-bd89-45db-a7fe-670bae1dcc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:35.509212 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf62269-bd89-45db-a7fe-670bae1dcc6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:35.527128 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf62269-bd89-45db-a7fe-670bae1dcc6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:35.528612 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf62269-bd89-45db-a7fe-670bae1dcc6b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:35.545947 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-4cf62269-bd89-45db-a7fe-670bae1dcc6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:35.545947 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:35.545947 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:35.545947 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:35.545947 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:35.545947 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:35.545947 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:35.545947 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:35.545947 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:35.545947 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:35.545947 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:35.545947 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:35.545947 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:35.545947 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:35.545947 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:35.546982 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:35.546982 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:35.546982 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:35.546982 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:35.546982 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:35.546982 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:35.546982 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:35.546982 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:35.546982 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:35.546982 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:35.546982 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:35.546982 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:35.546982 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:35.546982 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:35.546982 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:35.546982 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:35.546982 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:35.547945 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:35.547945 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:35.547945 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:35.547945 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:35.551972 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 279/556] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:35.552816 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf62269-bd89-45db-a7fe-670bae1dcc6b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:35.558758 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6eafe3-5399-4986-969d-096165257cb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:35.560459 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6eafe3-5399-4986-969d-096165257cb1 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:35.660631 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf62269-bd89-45db-a7fe-670bae1dcc6b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:35.676059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 278/557] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:01:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:01:35.677228 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6eafe3-5399-4986-969d-096165257cb1 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:35.704127 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cd818-da66-4274-9d7f-230b9cc90fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:35.704952 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cd818-da66-4274-9d7f-230b9cc90fef None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:35.705292 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cd818-da66-4274-9d7f-230b9cc90fef None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:35.705573 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cd818-da66-4274-9d7f-230b9cc90fef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:35.719142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cd818-da66-4274-9d7f-230b9cc90fef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:35.727185 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-401cd818-da66-4274-9d7f-230b9cc90fef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:35.727185 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:35.727185 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:35.727185 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:35.727185 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:35.727185 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:35.727185 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:35.727185 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:35.727185 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:35.727185 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:35.727185 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:35.727185 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:35.727185 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:35.727185 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:35.727185 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:35.727185 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:35.728142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:35.728142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:35.728142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:35.728142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:35.728142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:35.728142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:35.728142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:35.728142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:35.728142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:35.728142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:35.728142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:35.728142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:35.728142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:35.728142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:35.728142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:35.728142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:35.728968 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:35.728968 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:35.728968 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:35.728968 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:35.728968 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:35.728968 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:35.728968 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:35.728968 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:35.728968 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:35.728968 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:35.728968 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:35.728968 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:35.733309 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 280/558] 10.222.0.76 () {56 vars in 1102 bytes} [Mon May 16 15:01:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:35.734258 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cd818-da66-4274-9d7f-230b9cc90fef None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:35.789959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6eafe3-5399-4986-969d-096165257cb1 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:35.830927 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a851543-83bd-4a01-9fc4-b0be1e90bf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:35.831603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a851543-83bd-4a01-9fc4-b0be1e90bf1b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:35.831944 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a851543-83bd-4a01-9fc4-b0be1e90bf1b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:35.832222 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a851543-83bd-4a01-9fc4-b0be1e90bf1b None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:35.833528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a851543-83bd-4a01-9fc4-b0be1e90bf1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:35.833846 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a851543-83bd-4a01-9fc4-b0be1e90bf1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:35.835849 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a851543-83bd-4a01-9fc4-b0be1e90bf1b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:35.846914 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cd818-da66-4274-9d7f-230b9cc90fef None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:35.856803 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 279/559] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:35.857837 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a851543-83bd-4a01-9fc4-b0be1e90bf1b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:35.888274 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e08752-edcf-4ae1-91c9-88f810c162a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:35.889343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e08752-edcf-4ae1-91c9-88f810c162a0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:35.889623 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e08752-edcf-4ae1-91c9-88f810c162a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:35.889953 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e08752-edcf-4ae1-91c9-88f810c162a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:35.901278 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e08752-edcf-4ae1-91c9-88f810c162a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:35.902918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e08752-edcf-4ae1-91c9-88f810c162a0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:35.920663 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-65e08752-edcf-4ae1-91c9-88f810c162a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:35.920663 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:35.920663 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:35.920663 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:35.920663 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:35.920663 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:35.920663 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:35.920663 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:35.920663 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:35.920663 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:35.920663 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:35.920663 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:35.920663 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:35.920663 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:35.920663 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:35.921692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:35.921692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:35.921692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:35.921692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:35.921692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:35.921692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:35.921692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:35.921692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:35.921692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:35.921692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:35.921692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:35.921692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:35.921692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:35.921692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:35.921692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:35.921692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:35.921692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:35.923170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:35.923170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:35.923170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:35.923170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:35.923170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 281/560] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:35.923170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e08752-edcf-4ae1-91c9-88f810c162a0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:35.968870 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a851543-83bd-4a01-9fc4-b0be1e90bf1b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:36.002210 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d6af8-3b9f-474e-bda7-fa1b2f3faf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:36.002879 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d6af8-3b9f-474e-bda7-fa1b2f3faf67 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:36.003159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d6af8-3b9f-474e-bda7-fa1b2f3faf67 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:36.003431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d6af8-3b9f-474e-bda7-fa1b2f3faf67 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:36.004182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d6af8-3b9f-474e-bda7-fa1b2f3faf67 None admin] RBAC: Adding query filter params (name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:36.004742 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d6af8-3b9f-474e-bda7-fa1b2f3faf67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:36.006215 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d6af8-3b9f-474e-bda7-fa1b2f3faf67 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:36.014678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 280/561] 10.222.0.76 () {56 vars in 1103 bytes} [Mon May 16 15:01:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:36.016018 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d65e74-3c16-4b5a-aab5-1354e0099052 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:36.016306 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d65e74-3c16-4b5a-aab5-1354e0099052 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:36.016580 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d65e74-3c16-4b5a-aab5-1354e0099052 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:36.021753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 281/562] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:36.021753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d65e74-3c16-4b5a-aab5-1354e0099052 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:36.033549 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e08752-edcf-4ae1-91c9-88f810c162a0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:36.065912 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c07bd3-0252-4cbd-9e9b-69348247cdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:36.066961 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c07bd3-0252-4cbd-9e9b-69348247cdc8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:36.067246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c07bd3-0252-4cbd-9e9b-69348247cdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:36.067518 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c07bd3-0252-4cbd-9e9b-69348247cdc8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:36.075579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c07bd3-0252-4cbd-9e9b-69348247cdc8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:36.077060 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c07bd3-0252-4cbd-9e9b-69348247cdc8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:36.091566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d4c07bd3-0252-4cbd-9e9b-69348247cdc8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 15:01:36.091566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:36.091566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:36.091566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:36.091566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:36.091566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:36.091566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:36.091566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:36.091566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:36.091566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:36.091566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:36.091566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:36.091566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:01:36.091566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:01:36.091566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:01:36.091566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:01:36.092531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:36.092531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:36.092531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:01:36.092531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:36.092531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:01:36.092531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:36.092531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:36.092531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:36.092531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:36.092531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:36.092531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:36.092531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:36.092531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:36.092531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:36.092531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:36.092531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:36.092531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:36.092531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:36.093443 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:36.093443 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:36.093443 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:01:36.093443 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:01:36.093443 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:01:36.093443 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:01:36.093443 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:01:36.093443 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:01:36.093443 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 15:01:36.093443 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:36.097250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 282/563] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:01:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:36.098025 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c07bd3-0252-4cbd-9e9b-69348247cdc8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:36.127335 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d65e74-3c16-4b5a-aab5-1354e0099052 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:36.163536 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83e7d5-b051-455e-96eb-ab1179979abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:36.164191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83e7d5-b051-455e-96eb-ab1179979abe None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:36.164471 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83e7d5-b051-455e-96eb-ab1179979abe None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:36.164744 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83e7d5-b051-455e-96eb-ab1179979abe None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:36.165461 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83e7d5-b051-455e-96eb-ab1179979abe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:36.165770 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83e7d5-b051-455e-96eb-ab1179979abe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:36.167732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83e7d5-b051-455e-96eb-ab1179979abe None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:36.185906 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 282/564] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:36.187737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840560c-da58-449b-b8c1-624b1df90d61 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:36.188101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840560c-da58-449b-b8c1-624b1df90d61 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:36.188447 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840560c-da58-449b-b8c1-624b1df90d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:36.206775 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-3840560c-da58-449b-b8c1-624b1df90d61 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:36.208019 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3840560c-da58-449b-b8c1-624b1df90d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:36.208905 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c07bd3-0252-4cbd-9e9b-69348247cdc8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:36.245512 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7b606-5526-4926-b808-8966505839bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:36.246336 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7b606-5526-4926-b808-8966505839bd None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:36.246619 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7b606-5526-4926-b808-8966505839bd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:36.246891 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7b606-5526-4926-b808-8966505839bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:36.259048 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7b606-5526-4926-b808-8966505839bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:36.260776 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7b606-5526-4926-b808-8966505839bd None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:36.274282 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 283/565] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:36.275189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840560c-da58-449b-b8c1-624b1df90d61 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:36.278055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-6db7b606-5526-4926-b808-8966505839bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:36.278055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:36.278055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:36.278055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:36.278055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:36.278055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:36.278055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:36.278055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:36.278055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:36.278055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:36.278055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:36.278055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:36.278055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:36.278055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:36.278055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:36.278959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:36.278959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:36.278959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:36.278959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:36.278959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:36.278959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:36.278959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:36.278959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:36.278959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:36.278959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:36.278959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:36.278959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:36.278959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:36.278959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:36.278959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:36.278959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:36.278959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:36.280064 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:36.280064 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:36.280064 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:36.280064 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:36.280064 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 283/566] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:36.280595 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7b606-5526-4926-b808-8966505839bd None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:36.377101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840560c-da58-449b-b8c1-624b1df90d61 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:36.383236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7b606-5526-4926-b808-8966505839bd None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:36.409571 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96496101-5486-46a7-bf19-9c6fc90eb91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:36.410259 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96496101-5486-46a7-bf19-9c6fc90eb91d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:36.410542 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96496101-5486-46a7-bf19-9c6fc90eb91d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:36.410816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96496101-5486-46a7-bf19-9c6fc90eb91d None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:36.411642 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96496101-5486-46a7-bf19-9c6fc90eb91d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:36.411948 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96496101-5486-46a7-bf19-9c6fc90eb91d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:36.413374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96496101-5486-46a7-bf19-9c6fc90eb91d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:36.415039 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c9b6c-45d7-4e2f-8623-9cf134febc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:36.415821 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c9b6c-45d7-4e2f-8623-9cf134febc74 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:36.416106 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c9b6c-45d7-4e2f-8623-9cf134febc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:36.417009 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c9b6c-45d7-4e2f-8623-9cf134febc74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:36.423645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c9b6c-45d7-4e2f-8623-9cf134febc74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:36.425077 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c9b6c-45d7-4e2f-8623-9cf134febc74 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:36.430460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 284/567] 10.222.0.76 () {56 vars in 1137 bytes} [Mon May 16 15:01:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:36.431251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96496101-5486-46a7-bf19-9c6fc90eb91d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:36.439043 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-354c9b6c-45d7-4e2f-8623-9cf134febc74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:36.439043 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:36.439043 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:36.439043 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:36.439043 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:36.439043 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:36.439043 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:36.439043 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:36.439043 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:36.439043 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:36.439043 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:36.439043 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:36.439043 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:01:36.439043 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:01:36.439043 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:01:36.440062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:01:36.440062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:36.440062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:36.440062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:36.440062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:36.440062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:36.440062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:36.440062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:36.440062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:36.440062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:36.440062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:36.440062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:36.440062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:36.440062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:36.440062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:36.440062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:36.440062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:36.441053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:01:36.441053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:01:36.441053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:01:36.441053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:01:36.441053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:01:36.441053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:01:36.441053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:36.441053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:36.441053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 284/568] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:36.441053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c9b6c-45d7-4e2f-8623-9cf134febc74 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:36.528497 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96496101-5486-46a7-bf19-9c6fc90eb91d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:36.535992 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c9b6c-45d7-4e2f-8623-9cf134febc74 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:36.560901 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954822b-1522-42bd-befd-ff7e65593f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:36.561547 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954822b-1522-42bd-befd-ff7e65593f02 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:36.561827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954822b-1522-42bd-befd-ff7e65593f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:36.562104 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954822b-1522-42bd-befd-ff7e65593f02 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:36.562850 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954822b-1522-42bd-befd-ff7e65593f02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:36.563152 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954822b-1522-42bd-befd-ff7e65593f02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:36.564537 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954822b-1522-42bd-befd-ff7e65593f02 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:36.570780 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b2f72-b046-42ce-b614-40e02c99b5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:36.571568 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b2f72-b046-42ce-b614-40e02c99b5af None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:36.571848 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b2f72-b046-42ce-b614-40e02c99b5af None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:36.572122 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b2f72-b046-42ce-b614-40e02c99b5af None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:36.576038 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 285/569] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:36.577326 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d83ff-c834-4b15-8327-257cd2969910 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:36.577612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d83ff-c834-4b15-8327-257cd2969910 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:36.577885 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d83ff-c834-4b15-8327-257cd2969910 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:36.579325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 286/570] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:36.582748 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d83ff-c834-4b15-8327-257cd2969910 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:36.583987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b2f72-b046-42ce-b614-40e02c99b5af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:36.591915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-0d0b2f72-b046-42ce-b614-40e02c99b5af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:36.591915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:36.591915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:36.591915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:36.591915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:36.591915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:36.591915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:36.591915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:36.591915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:36.591915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:36.591915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:36.591915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:36.591915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:36.591915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:36.591915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:36.591915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:36.593026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:36.593026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:36.593026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:36.593026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:36.593026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:36.593026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:36.593026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:36.593026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:36.593026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:36.593026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:36.593026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:36.593026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:36.593026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:36.593026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:36.593026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:36.593026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:36.594638 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:36.594638 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:36.594638 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:36.594638 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:36.594638 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:36.594638 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:36.594638 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:36.594638 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:36.594638 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:36.594638 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:36.594638 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:36.594638 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:36.597685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 285/571] 10.222.0.76 () {56 vars in 1102 bytes} [Mon May 16 15:01:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:36.598542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b2f72-b046-42ce-b614-40e02c99b5af None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:36.678024 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d83ff-c834-4b15-8327-257cd2969910 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:36.692591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b2f72-b046-42ce-b614-40e02c99b5af None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:36.709756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16094bfd-45bc-46bf-ad45-29924f63d8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:36.710574 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16094bfd-45bc-46bf-ad45-29924f63d8ab None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:36.710860 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16094bfd-45bc-46bf-ad45-29924f63d8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:36.711138 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16094bfd-45bc-46bf-ad45-29924f63d8ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:36.721845 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16094bfd-45bc-46bf-ad45-29924f63d8ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:36.723336 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16094bfd-45bc-46bf-ad45-29924f63d8ab None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:36.724906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3af25c-2359-49b9-8473-9827b891795f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:36.725556 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3af25c-2359-49b9-8473-9827b891795f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:36.725834 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3af25c-2359-49b9-8473-9827b891795f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:36.726105 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3af25c-2359-49b9-8473-9827b891795f None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:36.726913 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3af25c-2359-49b9-8473-9827b891795f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:36.727218 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3af25c-2359-49b9-8473-9827b891795f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:36.728653 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3af25c-2359-49b9-8473-9827b891795f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:36.740325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-16094bfd-45bc-46bf-ad45-29924f63d8ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:36.740325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:36.740325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:36.740325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:36.740325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:36.740325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:36.740325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:36.740325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:36.740325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:36.740325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:36.740325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:36.740325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:36.740325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:36.740325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:36.740325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:36.741343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:36.741343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:36.741343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:36.741343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:36.741343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:36.741343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:36.741343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:36.741343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:36.741343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:36.741343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:36.741343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:36.741343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:36.741343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:36.741343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:36.741343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:36.741343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:36.741343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:36.742314 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:36.742314 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:36.742314 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:36.742314 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:36.742548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 286/572] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:01:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:36.742548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3af25c-2359-49b9-8473-9827b891795f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:36.747401 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 287/573] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:36.747401 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa17aa2-3a60-4e4a-a0a3-1fd638743e15 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:36.747401 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa17aa2-3a60-4e4a-a0a3-1fd638743e15 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:36.747401 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa17aa2-3a60-4e4a-a0a3-1fd638743e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:36.761555 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-8aa17aa2-3a60-4e4a-a0a3-1fd638743e15 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:36.762798 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8aa17aa2-3a60-4e4a-a0a3-1fd638743e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:36.824746 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 288/574] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:36.825546 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa17aa2-3a60-4e4a-a0a3-1fd638743e15 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:36.842766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3af25c-2359-49b9-8473-9827b891795f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:36.875110 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1522f-e83b-4aec-80c2-1fa179e473f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:36.875939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1522f-e83b-4aec-80c2-1fa179e473f2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:36.876224 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1522f-e83b-4aec-80c2-1fa179e473f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:36.876493 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1522f-e83b-4aec-80c2-1fa179e473f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:36.883533 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1522f-e83b-4aec-80c2-1fa179e473f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:36.885499 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1522f-e83b-4aec-80c2-1fa179e473f2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:36.900438 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a3d1522f-e83b-4aec-80c2-1fa179e473f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 15:01:36.900438 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:36.900438 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:36.900438 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:36.900438 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:36.900438 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:36.900438 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:36.900438 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:36.900438 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:36.900438 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:36.900438 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:36.900438 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:36.900438 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:01:36.900438 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:01:36.900438 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:01:36.900438 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:01:36.902008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:36.902008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:36.902008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:01:36.902008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:36.902008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:01:36.902008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:36.902008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:36.902008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:36.902008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:36.902008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:36.902008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:36.902008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:36.902008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:36.902008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:36.902008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:36.902008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:36.902008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:36.902008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:36.903378 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:36.903378 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:36.903378 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:01:36.903378 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:01:36.903378 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:01:36.903378 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:01:36.903378 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:01:36.903378 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:01:36.903378 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 15:01:36.903378 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:36.903378 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 287/575] 10.222.0.76 () {56 vars in 1093 bytes} [Mon May 16 15:01:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:36.903378 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1522f-e83b-4aec-80c2-1fa179e473f2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:36.929494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa17aa2-3a60-4e4a-a0a3-1fd638743e15 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:36.961057 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822da59-b1e7-4b3a-b77b-b33b56d30946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:36.961707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822da59-b1e7-4b3a-b77b-b33b56d30946 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:36.961985 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822da59-b1e7-4b3a-b77b-b33b56d30946 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:36.962299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822da59-b1e7-4b3a-b77b-b33b56d30946 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:36.963058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822da59-b1e7-4b3a-b77b-b33b56d30946 None admin] RBAC: Adding query filter params (name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:36.963885 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822da59-b1e7-4b3a-b77b-b33b56d30946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:36.965250 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822da59-b1e7-4b3a-b77b-b33b56d30946 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:36.972655 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 289/576] 10.222.0.76 () {56 vars in 1103 bytes} [Mon May 16 15:01:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:36.973419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822da59-b1e7-4b3a-b77b-b33b56d30946 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:37.000152 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1522f-e83b-4aec-80c2-1fa179e473f2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:37.033094 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215edfd-00ec-455c-9365-9a41085d21eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:37.033738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215edfd-00ec-455c-9365-9a41085d21eb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:37.034022 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215edfd-00ec-455c-9365-9a41085d21eb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:37.034330 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215edfd-00ec-455c-9365-9a41085d21eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:37.035158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215edfd-00ec-455c-9365-9a41085d21eb None admin] RBAC: Adding query filter params (role.id=f63aad4ab4a04108b87e1bf4ea8dfa53, scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9, user.id=33470e30760842ca9e96bb7f0cf9f07d) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:37.035464 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215edfd-00ec-455c-9365-9a41085d21eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:37.036890 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215edfd-00ec-455c-9365-9a41085d21eb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:37.042181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 288/577] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:01:36 2022] GET /identity/v3/role_assignments?user.id=33470e30760842ca9e96bb7f0cf9f07d&scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9&role.id=f63aad4ab4a04108b87e1bf4ea8dfa53 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:37.042959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215edfd-00ec-455c-9365-9a41085d21eb None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:37.068461 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822da59-b1e7-4b3a-b77b-b33b56d30946 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:37.106209 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c08bd7-be68-47a0-83c4-ec46cb55f367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:37.106886 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c08bd7-be68-47a0-83c4-ec46cb55f367 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:37.107171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c08bd7-be68-47a0-83c4-ec46cb55f367 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:37.107446 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c08bd7-be68-47a0-83c4-ec46cb55f367 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:37.108194 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c08bd7-be68-47a0-83c4-ec46cb55f367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:37.108502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c08bd7-be68-47a0-83c4-ec46cb55f367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:37.109921 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c08bd7-be68-47a0-83c4-ec46cb55f367 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:37.127606 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 290/578] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:37.127606 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c08bd7-be68-47a0-83c4-ec46cb55f367 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:37.152557 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215edfd-00ec-455c-9365-9a41085d21eb None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:37.187616 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8d9b6-1820-4bc1-a677-34c002560a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:37.188339 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8d9b6-1820-4bc1-a677-34c002560a7d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:37.188623 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8d9b6-1820-4bc1-a677-34c002560a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:37.188900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8d9b6-1820-4bc1-a677-34c002560a7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:37.199776 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8d9b6-1820-4bc1-a677-34c002560a7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:37.207661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-60b8d9b6-1820-4bc1-a677-34c002560a7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:37.207661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:37.207661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:37.207661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:37.207661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:37.207661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:37.207661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:37.207661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:37.207661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:37.207661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:37.207661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:37.207661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:37.207661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:37.207661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:37.207661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:37.207661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:37.208681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:37.208681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:37.208681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:37.208681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:37.208681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:37.208681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:37.208681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:37.208681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:37.208681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:37.208681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:37.208681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:37.208681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:37.208681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:37.208681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:37.208681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:37.208681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:37.209526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:37.209526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:37.209526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:37.209526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:37.209526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:37.209526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:37.209526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:37.209526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:37.209526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:37.209526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:37.209526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:37.209526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:37.214474 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 289/579] 10.222.0.76 () {56 vars in 1102 bytes} [Mon May 16 15:01:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:37.215200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8d9b6-1820-4bc1-a677-34c002560a7d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:37.229774 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c08bd7-be68-47a0-83c4-ec46cb55f367 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:37.265072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0350e-953e-41bc-9101-1fdcdc2e7450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:37.265742 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0350e-953e-41bc-9101-1fdcdc2e7450 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:37.266018 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0350e-953e-41bc-9101-1fdcdc2e7450 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:37.266322 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0350e-953e-41bc-9101-1fdcdc2e7450 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:37.267171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0350e-953e-41bc-9101-1fdcdc2e7450 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:37.267475 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0350e-953e-41bc-9101-1fdcdc2e7450 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:37.268927 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0350e-953e-41bc-9101-1fdcdc2e7450 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:37.285963 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 291/580] 10.222.0.76 () {56 vars in 1133 bytes} [Mon May 16 15:01:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:37.287050 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0350e-953e-41bc-9101-1fdcdc2e7450 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:37.324702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8d9b6-1820-4bc1-a677-34c002560a7d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:37.357152 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfa7a6-3a93-41f3-a636-55008f333223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:37.357943 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfa7a6-3a93-41f3-a636-55008f333223 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:37.358257 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfa7a6-3a93-41f3-a636-55008f333223 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:37.358537 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfa7a6-3a93-41f3-a636-55008f333223 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:37.368978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfa7a6-3a93-41f3-a636-55008f333223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:37.371003 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfa7a6-3a93-41f3-a636-55008f333223 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:37.386855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0350e-953e-41bc-9101-1fdcdc2e7450 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:37.388785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-28cfa7a6-3a93-41f3-a636-55008f333223 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:37.388785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:37.388785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:37.388785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:37.388785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:37.388785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:37.388785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:37.388785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:37.388785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:37.388785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:37.388785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:37.388785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:37.388785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:37.388785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:37.388785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:37.389900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:37.389900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:37.389900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:37.389900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:37.389900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:37.389900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:37.389900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:37.389900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:37.389900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:37.389900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:37.389900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:37.389900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:37.389900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:37.389900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:37.389900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:37.389900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:37.389900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:37.391363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:37.391363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:37.391363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:37.391363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:37.394695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 290/581] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:37.395283 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfa7a6-3a93-41f3-a636-55008f333223 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:37.419939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0dd7c1-b531-44a5-b364-5a97a66789e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:37.420734 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dd7c1-b531-44a5-b364-5a97a66789e5 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:37.421016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dd7c1-b531-44a5-b364-5a97a66789e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:37.421287 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dd7c1-b531-44a5-b364-5a97a66789e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:37.428117 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0dd7c1-b531-44a5-b364-5a97a66789e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:37.429571 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0dd7c1-b531-44a5-b364-5a97a66789e5 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:37.443816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-5f0dd7c1-b531-44a5-b364-5a97a66789e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:37.443816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:37.443816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:37.443816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:37.443816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:37.443816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:37.443816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:37.443816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:37.443816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:37.443816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:37.443816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:37.443816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:37.443816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:01:37.443816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:01:37.443816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:01:37.444707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:01:37.444707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:37.444707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:37.444707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:37.444707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:37.444707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:37.444707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:37.444707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:37.444707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:37.444707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:37.444707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:37.444707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:37.444707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:37.444707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:37.444707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:37.444707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:37.444707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:37.446200 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:01:37.446200 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:01:37.446200 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:01:37.446200 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:01:37.446200 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:01:37.446200 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:01:37.446200 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:37.446200 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:37.446200 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 292/582] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:37.446200 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0dd7c1-b531-44a5-b364-5a97a66789e5 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:37.495877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfa7a6-3a93-41f3-a636-55008f333223 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:37.529468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc43f2-b503-4c5e-8f4b-381db8d7da00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:37.531670 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc43f2-b503-4c5e-8f4b-381db8d7da00 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:37.531670 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc43f2-b503-4c5e-8f4b-381db8d7da00 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:37.531670 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc43f2-b503-4c5e-8f4b-381db8d7da00 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:37.531670 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc43f2-b503-4c5e-8f4b-381db8d7da00 None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:37.531974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc43f2-b503-4c5e-8f4b-381db8d7da00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:37.533088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc43f2-b503-4c5e-8f4b-381db8d7da00 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:37.543539 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 291/583] 10.222.0.76 () {56 vars in 1103 bytes} [Mon May 16 15:01:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:37.544248 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc43f2-b503-4c5e-8f4b-381db8d7da00 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:37.555070 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0dd7c1-b531-44a5-b364-5a97a66789e5 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:37.589185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7f463-e304-446a-aca5-0fbef64e13ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:37.589976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7f463-e304-446a-aca5-0fbef64e13ee None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:37.590516 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7f463-e304-446a-aca5-0fbef64e13ee None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:37.590626 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7f463-e304-446a-aca5-0fbef64e13ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:37.601063 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7f463-e304-446a-aca5-0fbef64e13ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:37.604746 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7f463-e304-446a-aca5-0fbef64e13ee None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:37.619843 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-21a7f463-e304-446a-aca5-0fbef64e13ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:37.619843 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:37.619843 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:37.619843 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:37.619843 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:37.619843 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:37.619843 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:37.619843 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:37.619843 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:37.619843 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:37.619843 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:37.619843 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:37.619843 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:37.619843 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:37.619843 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:37.621328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:37.621328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:37.621328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:37.621328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:37.621328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:37.621328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:37.621328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:37.621328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:37.621328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:37.621328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:37.621328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:37.621328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:37.621328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:37.621328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:37.621328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:37.621328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:37.621328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:37.622626 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:37.622626 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:37.622626 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:37.622626 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:37.625857 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 293/584] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:37.626728 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7f463-e304-446a-aca5-0fbef64e13ee None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:37.649415 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc43f2-b503-4c5e-8f4b-381db8d7da00 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:37.683444 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7a5c7-a75b-474b-9bfc-3f440940de19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:37.684095 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7a5c7-a75b-474b-9bfc-3f440940de19 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:37.684376 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7a5c7-a75b-474b-9bfc-3f440940de19 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:37.684645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7a5c7-a75b-474b-9bfc-3f440940de19 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:37.685361 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7a5c7-a75b-474b-9bfc-3f440940de19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:37.685665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7a5c7-a75b-474b-9bfc-3f440940de19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:37.687090 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7a5c7-a75b-474b-9bfc-3f440940de19 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:37.702324 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 292/585] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:37.702324 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7a5c7-a75b-474b-9bfc-3f440940de19 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:37.732797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7f463-e304-446a-aca5-0fbef64e13ee None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:37.766265 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ff48e-12ee-42af-bcfb-da6d04eee806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:37.766927 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ff48e-12ee-42af-bcfb-da6d04eee806 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:37.767206 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ff48e-12ee-42af-bcfb-da6d04eee806 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:37.767481 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ff48e-12ee-42af-bcfb-da6d04eee806 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:37.768263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ff48e-12ee-42af-bcfb-da6d04eee806 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:37.768567 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ff48e-12ee-42af-bcfb-da6d04eee806 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:37.769982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ff48e-12ee-42af-bcfb-da6d04eee806 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:37.787615 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 294/586] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:01:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:37.787615 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ff48e-12ee-42af-bcfb-da6d04eee806 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:37.811519 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7a5c7-a75b-474b-9bfc-3f440940de19 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:37.848730 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb00378-f193-419b-8a17-959453b7afbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:37.850448 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb00378-f193-419b-8a17-959453b7afbc None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:37.850915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb00378-f193-419b-8a17-959453b7afbc None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:37.851521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb00378-f193-419b-8a17-959453b7afbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:37.864682 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb00378-f193-419b-8a17-959453b7afbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:37.866811 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb00378-f193-419b-8a17-959453b7afbc None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:37.888455 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-9cb00378-f193-419b-8a17-959453b7afbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:37.888455 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:37.888455 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:37.888455 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:37.888455 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:37.888455 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:37.888455 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:37.888455 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:37.888455 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:37.888455 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:37.888455 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:37.888455 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:37.888455 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:37.888455 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:37.888455 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:37.889367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:37.889367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:37.889367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:37.889367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:37.889367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:37.889367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:37.889367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:37.889367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:37.889367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:37.889367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:37.889367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:37.889367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:37.889367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:37.889367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:37.889367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:37.889367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:37.889367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:37.890376 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:37.890376 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:37.890376 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:37.890376 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:37.890592 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ff48e-12ee-42af-bcfb-da6d04eee806 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:37.891448 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 293/587] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:37.892242 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb00378-f193-419b-8a17-959453b7afbc None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:37.924384 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aab93b-bcc5-45f6-bac0-2dcf59ae4372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:37.925034 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aab93b-bcc5-45f6-bac0-2dcf59ae4372 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:37.925311 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aab93b-bcc5-45f6-bac0-2dcf59ae4372 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:37.925580 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aab93b-bcc5-45f6-bac0-2dcf59ae4372 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:37.926321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aab93b-bcc5-45f6-bac0-2dcf59ae4372 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:37.926621 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aab93b-bcc5-45f6-bac0-2dcf59ae4372 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:37.927967 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aab93b-bcc5-45f6-bac0-2dcf59ae4372 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:37.939320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 295/588] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:37.942982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aab93b-bcc5-45f6-bac0-2dcf59ae4372 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:37.992795 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb00378-f193-419b-8a17-959453b7afbc None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:38.027179 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9f0f4-6c36-4e92-a298-b1dc7ea76c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:38.027965 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9f0f4-6c36-4e92-a298-b1dc7ea76c67 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:38.028250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9f0f4-6c36-4e92-a298-b1dc7ea76c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:38.028527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9f0f4-6c36-4e92-a298-b1dc7ea76c67 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:38.035421 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9f0f4-6c36-4e92-a298-b1dc7ea76c67 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:38.036869 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9f0f4-6c36-4e92-a298-b1dc7ea76c67 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:38.041798 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aab93b-bcc5-45f6-bac0-2dcf59ae4372 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:38.051767 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-27c9f0f4-6c36-4e92-a298-b1dc7ea76c67 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 15:01:38.051767 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:38.051767 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:38.051767 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:38.051767 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:38.051767 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:38.051767 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:38.051767 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:38.051767 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:38.051767 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:38.051767 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:38.051767 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:38.051767 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:01:38.051767 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:01:38.051767 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:01:38.051767 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:01:38.052909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:38.052909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:38.052909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:01:38.052909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:38.052909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:01:38.052909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:38.052909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:38.052909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:38.052909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:38.052909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:38.052909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:38.052909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:38.052909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:38.052909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:38.052909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:38.052909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:38.052909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:38.052909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:38.053851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:38.053851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:38.053851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:01:38.053851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:01:38.053851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:01:38.053851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:01:38.053851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:01:38.053851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:01:38.053851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 15:01:38.053851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:38.053851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 294/589] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:01:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:38.053851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9f0f4-6c36-4e92-a298-b1dc7ea76c67 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:38.078144 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3e9c8-57e4-4381-a915-debc69a67f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:38.079299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3e9c8-57e4-4381-a915-debc69a67f26 None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:38.079584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3e9c8-57e4-4381-a915-debc69a67f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:38.080026 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3e9c8-57e4-4381-a915-debc69a67f26 None admin] PATH_INFO: `/v3/projects/681a6490f3c04f9fa2830cfde3deb2e9/users/2d1e67aa4370453fafb5b6525ba13cd3/roles/f63aad4ab4a04108b87e1bf4ea8dfa53` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:38.094609 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3e9c8-57e4-4381-a915-debc69a67f26 None admin] RBAC: Authorizing `identity:create_grant(project_id=681a6490f3c04f9fa2830cfde3deb2e9, user_id=2d1e67aa4370453fafb5b6525ba13cd3, role_id=f63aad4ab4a04108b87e1bf4ea8dfa53)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:38.096081 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3e9c8-57e4-4381-a915-debc69a67f26 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:38.159705 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9f0f4-6c36-4e92-a298-b1dc7ea76c67 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:38.180868 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 296/590] 10.222.0.76 () {58 vars in 1439 bytes} [Mon May 16 15:01:37 2022] PUT /identity/v3/projects/681a6490f3c04f9fa2830cfde3deb2e9/users/2d1e67aa4370453fafb5b6525ba13cd3/roles/f63aad4ab4a04108b87e1bf4ea8dfa53 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:01:38.181859 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3e9c8-57e4-4381-a915-debc69a67f26 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:38.204717 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfa10e-d9f1-40da-9317-1762536243e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:38.205806 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfa10e-d9f1-40da-9317-1762536243e8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:38.206296 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfa10e-d9f1-40da-9317-1762536243e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:38.206620 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfa10e-d9f1-40da-9317-1762536243e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:38.207411 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cfa10e-d9f1-40da-9317-1762536243e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:38.207809 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cfa10e-d9f1-40da-9317-1762536243e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:38.209519 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cfa10e-d9f1-40da-9317-1762536243e8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:38.228197 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 295/591] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:38.229871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfa10e-d9f1-40da-9317-1762536243e8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:38.298475 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3e9c8-57e4-4381-a915-debc69a67f26 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:38.335346 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637f5ae-a85c-4350-96bc-c966ebb77b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:38.336595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637f5ae-a85c-4350-96bc-c966ebb77b43 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:38.337099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637f5ae-a85c-4350-96bc-c966ebb77b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:38.337573 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637f5ae-a85c-4350-96bc-c966ebb77b43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:38.343683 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfa10e-d9f1-40da-9317-1762536243e8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:38.345729 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637f5ae-a85c-4350-96bc-c966ebb77b43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:38.347485 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637f5ae-a85c-4350-96bc-c966ebb77b43 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:38.363099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-c637f5ae-a85c-4350-96bc-c966ebb77b43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:38.363099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:38.363099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:38.363099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:38.363099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:38.363099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:38.363099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:38.363099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:38.363099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:38.363099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:38.363099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:38.363099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:38.363099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:01:38.363099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:01:38.363099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:01:38.364087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:01:38.364087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:38.364087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:38.364087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:38.364087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:38.364087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:38.364087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:38.364087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:38.364087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:38.364087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:38.364087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:38.364087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:38.364087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:38.364087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:38.364087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:38.364087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:38.364087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:38.364962 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:01:38.364962 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:01:38.364962 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:01:38.364962 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:01:38.364962 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:01:38.364962 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:01:38.364962 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:38.364962 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:38.367548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 297/592] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:38.368632 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637f5ae-a85c-4350-96bc-c966ebb77b43 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:38.381449 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf6b9b-5813-4aa4-a5d7-a22f11b06957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:38.382171 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf6b9b-5813-4aa4-a5d7-a22f11b06957 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:38.382452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf6b9b-5813-4aa4-a5d7-a22f11b06957 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:38.382725 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf6b9b-5813-4aa4-a5d7-a22f11b06957 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:38.383584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf6b9b-5813-4aa4-a5d7-a22f11b06957 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:38.384128 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf6b9b-5813-4aa4-a5d7-a22f11b06957 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:38.385490 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf6b9b-5813-4aa4-a5d7-a22f11b06957 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:38.405742 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 296/593] 10.222.0.76 () {56 vars in 1137 bytes} [Mon May 16 15:01:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:38.406884 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf6b9b-5813-4aa4-a5d7-a22f11b06957 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:38.484324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637f5ae-a85c-4350-96bc-c966ebb77b43 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:38.510685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf6b9b-5813-4aa4-a5d7-a22f11b06957 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:38.521571 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7184de8-3bac-4a78-9a8a-6fc5c4003963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:38.522678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7184de8-3bac-4a78-9a8a-6fc5c4003963 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:38.523166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7184de8-3bac-4a78-9a8a-6fc5c4003963 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:38.523637 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7184de8-3bac-4a78-9a8a-6fc5c4003963 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:38.531611 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7184de8-3bac-4a78-9a8a-6fc5c4003963 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:38.533340 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7184de8-3bac-4a78-9a8a-6fc5c4003963 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:38.545653 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755a4e5-0c76-40f4-843a-3316a0ed8dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:38.546352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755a4e5-0c76-40f4-843a-3316a0ed8dce None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:38.546634 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755a4e5-0c76-40f4-843a-3316a0ed8dce None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:38.546911 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755a4e5-0c76-40f4-843a-3316a0ed8dce None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:38.547699 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755a4e5-0c76-40f4-843a-3316a0ed8dce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:38.548009 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755a4e5-0c76-40f4-843a-3316a0ed8dce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:38.549492 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755a4e5-0c76-40f4-843a-3316a0ed8dce None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:38.550176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-c7184de8-3bac-4a78-9a8a-6fc5c4003963 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 15:01:38.550176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:38.550176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:38.550176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:38.550176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:38.550176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:38.550176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:38.550176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:38.550176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:38.550176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:38.550176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:38.550176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:38.550176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:01:38.550176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:01:38.550176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:01:38.550176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:01:38.551090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:38.551090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:38.551090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:01:38.551090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:38.551090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:01:38.551090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:38.551090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:38.551090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:38.551090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:38.551090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:38.551090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:38.551090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:38.551090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:38.551090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:38.551090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:38.551090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:38.551090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:38.551090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:38.552041 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:38.552041 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:38.552041 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:01:38.552041 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:01:38.552041 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:01:38.552041 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:01:38.552041 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:01:38.552041 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:01:38.552041 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 15:01:38.552041 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:38.554432 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 298/594] 10.222.0.76 () {56 vars in 1102 bytes} [Mon May 16 15:01:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:38.555431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7184de8-3bac-4a78-9a8a-6fc5c4003963 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:38.570716 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 297/595] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:01:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:38.571926 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755a4e5-0c76-40f4-843a-3316a0ed8dce None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:38.677891 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755a4e5-0c76-40f4-843a-3316a0ed8dce None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:38.688889 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7184de8-3bac-4a78-9a8a-6fc5c4003963 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:38.713368 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c605f0e-62b7-4b3d-8474-b5b60197ce23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:38.714444 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c605f0e-62b7-4b3d-8474-b5b60197ce23 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:38.715337 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c605f0e-62b7-4b3d-8474-b5b60197ce23 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:38.715814 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c605f0e-62b7-4b3d-8474-b5b60197ce23 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:38.717088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c605f0e-62b7-4b3d-8474-b5b60197ce23 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:38.717703 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c605f0e-62b7-4b3d-8474-b5b60197ce23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:38.719922 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c605f0e-62b7-4b3d-8474-b5b60197ce23 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:38.729799 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac0c40-c9e8-4b70-b5ac-118ba4c7c615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:38.730879 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac0c40-c9e8-4b70-b5ac-118ba4c7c615 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:38.731227 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac0c40-c9e8-4b70-b5ac-118ba4c7c615 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:38.731617 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac0c40-c9e8-4b70-b5ac-118ba4c7c615 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:38.741579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 298/596] 10.222.0.76 () {56 vars in 1139 bytes} [Mon May 16 15:01:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:38.742715 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c605f0e-62b7-4b3d-8474-b5b60197ce23 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:38.751310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac0c40-c9e8-4b70-b5ac-118ba4c7c615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:38.752844 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac0c40-c9e8-4b70-b5ac-118ba4c7c615 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:38.770740 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-ebac0c40-c9e8-4b70-b5ac-118ba4c7c615 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:38.770740 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:38.770740 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:38.770740 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:38.770740 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:38.770740 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:38.770740 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:38.770740 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:38.770740 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:38.770740 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:38.770740 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:38.770740 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:38.770740 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:38.770740 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:38.770740 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:38.771678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:38.771678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:38.771678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:38.771678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:38.771678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:38.771678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:38.771678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:38.771678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:38.771678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:38.771678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:38.771678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:38.771678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:38.771678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:38.771678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:38.771678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:38.771678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:38.771678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:38.772571 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:38.772571 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:38.772571 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:38.772571 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:38.776812 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 299/597] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:38.777663 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac0c40-c9e8-4b70-b5ac-118ba4c7c615 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:38.849611 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c605f0e-62b7-4b3d-8474-b5b60197ce23 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:38.884158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcfc3e-0561-4d58-88c6-a0a7e507f579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:38.885629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcfc3e-0561-4d58-88c6-a0a7e507f579 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:38.885911 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcfc3e-0561-4d58-88c6-a0a7e507f579 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:38.886218 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcfc3e-0561-4d58-88c6-a0a7e507f579 None admin] PATH_INFO: `/v3/projects/681a6490f3c04f9fa2830cfde3deb2e9/users/9d85024f010c40129d79543b3ec4cfae/roles/f63aad4ab4a04108b87e1bf4ea8dfa53` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:38.903813 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac0c40-c9e8-4b70-b5ac-118ba4c7c615 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:38.904962 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbcfc3e-0561-4d58-88c6-a0a7e507f579 None admin] RBAC: Authorizing `identity:create_grant(project_id=681a6490f3c04f9fa2830cfde3deb2e9, user_id=9d85024f010c40129d79543b3ec4cfae, role_id=f63aad4ab4a04108b87e1bf4ea8dfa53)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:38.907583 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbcfc3e-0561-4d58-88c6-a0a7e507f579 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:38.945976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b8d98-7844-4137-9e39-2367d1d7b52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:38.946789 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b8d98-7844-4137-9e39-2367d1d7b52e None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:38.947069 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b8d98-7844-4137-9e39-2367d1d7b52e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:38.947369 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b8d98-7844-4137-9e39-2367d1d7b52e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:38.957632 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b8d98-7844-4137-9e39-2367d1d7b52e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:38.959175 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b8d98-7844-4137-9e39-2367d1d7b52e None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:38.976385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-958b8d98-7844-4137-9e39-2367d1d7b52e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:38.976385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:38.976385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:38.976385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:38.976385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:38.976385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:38.976385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:38.976385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:38.976385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:38.976385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:38.976385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:38.976385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:38.976385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:38.976385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:38.976385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:38.977310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:38.977310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:38.977310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:38.977310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:38.977310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:38.977310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:38.977310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:38.977310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:38.977310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:38.977310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:38.977310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:38.977310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:38.977310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:38.977310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:38.977310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:38.977310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:38.977310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:38.979291 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:38.979291 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:38.979291 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:38.979291 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:38.979291 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 300/598] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:38.979601 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b8d98-7844-4137-9e39-2367d1d7b52e None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:39.004059 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 299/599] 10.222.0.76 () {58 vars in 1439 bytes} [Mon May 16 15:01:38 2022] PUT /identity/v3/projects/681a6490f3c04f9fa2830cfde3deb2e9/users/9d85024f010c40129d79543b3ec4cfae/roles/f63aad4ab4a04108b87e1bf4ea8dfa53 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:01:39.005880 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcfc3e-0561-4d58-88c6-a0a7e507f579 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:39.133675 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcfc3e-0561-4d58-88c6-a0a7e507f579 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:39.177264 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b84c9d-da53-4315-ac48-27126892fede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:39.177958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b84c9d-da53-4315-ac48-27126892fede None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:39.178269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b84c9d-da53-4315-ac48-27126892fede None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:39.178548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b84c9d-da53-4315-ac48-27126892fede None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:39.179304 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b84c9d-da53-4315-ac48-27126892fede None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:39.179611 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b84c9d-da53-4315-ac48-27126892fede None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:39.181014 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b84c9d-da53-4315-ac48-27126892fede None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:39.193665 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b8d98-7844-4137-9e39-2367d1d7b52e None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:39.218604 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 300/600] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:39.233212 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b84c9d-da53-4315-ac48-27126892fede None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:39.251564 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1081f-cd15-47ce-b87a-5c5a94c34f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:39.252242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1081f-cd15-47ce-b87a-5c5a94c34f29 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:39.252521 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1081f-cd15-47ce-b87a-5c5a94c34f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:39.252797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1081f-cd15-47ce-b87a-5c5a94c34f29 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:39.253537 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1081f-cd15-47ce-b87a-5c5a94c34f29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:39.253844 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1081f-cd15-47ce-b87a-5c5a94c34f29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:39.255538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1081f-cd15-47ce-b87a-5c5a94c34f29 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:39.268355 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 301/601] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:39.273698 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1081f-cd15-47ce-b87a-5c5a94c34f29 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:39.352318 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b84c9d-da53-4315-ac48-27126892fede None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:39.377868 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1081f-cd15-47ce-b87a-5c5a94c34f29 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:39.390458 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a575be1-f162-4649-ad49-37b331e31f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:39.391534 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a575be1-f162-4649-ad49-37b331e31f2f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:39.392008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a575be1-f162-4649-ad49-37b331e31f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:39.392489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a575be1-f162-4649-ad49-37b331e31f2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:39.399503 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a575be1-f162-4649-ad49-37b331e31f2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:39.401783 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a575be1-f162-4649-ad49-37b331e31f2f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:39.412818 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec539281-1884-412e-a8e5-8249fc3a96a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:39.413624 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec539281-1884-412e-a8e5-8249fc3a96a2 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:39.413909 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec539281-1884-412e-a8e5-8249fc3a96a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:39.414215 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec539281-1884-412e-a8e5-8249fc3a96a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:39.419355 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-6a575be1-f162-4649-ad49-37b331e31f2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:39.419355 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:39.419355 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:39.419355 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:39.419355 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:39.419355 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:39.419355 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:39.419355 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:39.419355 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:39.419355 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:39.419355 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:39.419355 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:39.419355 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:01:39.419355 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:01:39.419355 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:01:39.426021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:01:39.426021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:39.426021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:39.426021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:39.426021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:39.426021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:39.426021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:39.426021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:39.426021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:39.426021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:39.426021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:39.426021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:39.426021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:39.426021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:39.426021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:39.426021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:39.426021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:39.427202 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:01:39.427202 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:01:39.427202 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:01:39.427202 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:01:39.427202 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:01:39.427202 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:01:39.427202 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:39.427202 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:39.427202 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 301/602] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:39.427791 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec539281-1884-412e-a8e5-8249fc3a96a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:39.427877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc198a2-2972-43bf-88e9-8055e2a20627 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:39.427877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc198a2-2972-43bf-88e9-8055e2a20627 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:39.427877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc198a2-2972-43bf-88e9-8055e2a20627 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:39.428105 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec539281-1884-412e-a8e5-8249fc3a96a2 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:39.428186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 302/603] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:39.428186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc198a2-2972-43bf-88e9-8055e2a20627 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:39.442828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-ec539281-1884-412e-a8e5-8249fc3a96a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:39.442828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:39.442828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:39.442828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:39.442828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:39.442828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:39.442828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:39.442828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:39.442828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:39.442828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:39.442828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:39.442828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:39.442828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:01:39.442828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:01:39.442828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:01:39.444085 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:01:39.444085 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:39.444085 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:39.444085 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:39.444085 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:39.444085 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:39.444085 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:39.444085 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:39.444085 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:39.444085 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:39.444085 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:39.444085 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:39.444085 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:39.444085 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:39.444085 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:39.444085 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:39.444085 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:39.446162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:01:39.446162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:01:39.446162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:01:39.446162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:01:39.446162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:01:39.446162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:01:39.446162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:39.446162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:39.446162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 302/604] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:01:39.447526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca38d6-8f63-4265-abfc-a45e85b2d13b None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:39.447526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca38d6-8f63-4265-abfc-a45e85b2d13b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:39.447807 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca38d6-8f63-4265-abfc-a45e85b2d13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:39.474023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9cca38d6-8f63-4265-abfc-a45e85b2d13b None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:39.476432 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9cca38d6-8f63-4265-abfc-a45e85b2d13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:39.551439 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc198a2-2972-43bf-88e9-8055e2a20627 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:39.561258 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 303/605] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:39.563342 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca38d6-8f63-4265-abfc-a45e85b2d13b None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:39.598700 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7390cd-bf6b-4198-8fd7-25fe20e63383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:39.599683 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7390cd-bf6b-4198-8fd7-25fe20e63383 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:39.600169 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7390cd-bf6b-4198-8fd7-25fe20e63383 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:39.600644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7390cd-bf6b-4198-8fd7-25fe20e63383 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:39.601690 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7390cd-bf6b-4198-8fd7-25fe20e63383 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:39.602260 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7390cd-bf6b-4198-8fd7-25fe20e63383 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:39.604535 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7390cd-bf6b-4198-8fd7-25fe20e63383 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:39.616792 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 303/606] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:01:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:39.617893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7390cd-bf6b-4198-8fd7-25fe20e63383 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:39.687261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca38d6-8f63-4265-abfc-a45e85b2d13b None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:39.722361 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74e0ba-c287-40f6-a4e3-ab44152e756b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:39.723465 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74e0ba-c287-40f6-a4e3-ab44152e756b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:39.723951 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74e0ba-c287-40f6-a4e3-ab44152e756b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:39.724461 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74e0ba-c287-40f6-a4e3-ab44152e756b None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:39.725455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74e0ba-c287-40f6-a4e3-ab44152e756b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:39.725990 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74e0ba-c287-40f6-a4e3-ab44152e756b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:39.727634 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74e0ba-c287-40f6-a4e3-ab44152e756b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:39.734637 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7390cd-bf6b-4198-8fd7-25fe20e63383 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:39.740763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 304/607] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:01:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:39.741783 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74e0ba-c287-40f6-a4e3-ab44152e756b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:39.782317 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ad7c1-52d4-44d2-b24e-1b5217271557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:39.783604 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ad7c1-52d4-44d2-b24e-1b5217271557 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:39.784093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ad7c1-52d4-44d2-b24e-1b5217271557 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:39.784566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ad7c1-52d4-44d2-b24e-1b5217271557 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:39.798048 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ad7c1-52d4-44d2-b24e-1b5217271557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:39.808310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-6a5ad7c1-52d4-44d2-b24e-1b5217271557 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:39.808310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:39.808310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:39.808310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:39.808310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:39.808310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:39.808310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:39.808310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:39.808310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:39.808310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:39.808310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:39.808310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:39.808310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:39.808310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:39.808310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:39.808310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:39.809702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:39.809702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:39.809702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:39.809702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:39.809702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:39.809702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:39.809702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:39.809702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:39.809702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:39.809702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:39.809702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:39.809702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:39.809702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:39.809702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:39.809702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:39.809702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:39.810934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:39.810934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:39.810934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:39.810934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:39.810934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:39.810934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:39.810934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:39.810934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:39.810934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:39.810934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:39.810934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:39.810934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:39.814704 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 304/608] 10.222.0.76 () {56 vars in 1102 bytes} [Mon May 16 15:01:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:39.815549 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ad7c1-52d4-44d2-b24e-1b5217271557 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:39.864282 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74e0ba-c287-40f6-a4e3-ab44152e756b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:39.898971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3af20-a787-458c-a845-418e048e9919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:39.900219 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3af20-a787-458c-a845-418e048e9919 None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:39.901254 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3af20-a787-458c-a845-418e048e9919 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:39.901761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3af20-a787-458c-a845-418e048e9919 None admin] PATH_INFO: `/v3/projects/681a6490f3c04f9fa2830cfde3deb2e9/users/15ff90527ece4406be62f449bdf71d93/roles/f63aad4ab4a04108b87e1bf4ea8dfa53` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:39.919583 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3af20-a787-458c-a845-418e048e9919 None admin] RBAC: Authorizing `identity:create_grant(project_id=681a6490f3c04f9fa2830cfde3deb2e9, user_id=15ff90527ece4406be62f449bdf71d93, role_id=f63aad4ab4a04108b87e1bf4ea8dfa53)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:39.921033 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3af20-a787-458c-a845-418e048e9919 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:39.934762 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ad7c1-52d4-44d2-b24e-1b5217271557 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:39.968805 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580050d-d0dc-4fd0-9416-e03a917e8d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:39.969616 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580050d-d0dc-4fd0-9416-e03a917e8d65 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:39.969898 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580050d-d0dc-4fd0-9416-e03a917e8d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:39.970207 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580050d-d0dc-4fd0-9416-e03a917e8d65 None admin] PATH_INFO: `/v3/projects/681a6490f3c04f9fa2830cfde3deb2e9/users/496e1178104d468e9b7ce53ea754ec74/roles/f63aad4ab4a04108b87e1bf4ea8dfa53` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:39.984924 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580050d-d0dc-4fd0-9416-e03a917e8d65 None admin] RBAC: Authorizing `identity:create_grant(project_id=681a6490f3c04f9fa2830cfde3deb2e9, user_id=496e1178104d468e9b7ce53ea754ec74, role_id=f63aad4ab4a04108b87e1bf4ea8dfa53)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:39.986474 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580050d-d0dc-4fd0-9416-e03a917e8d65 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:40.030181 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 305/609] 10.222.0.76 () {58 vars in 1439 bytes} [Mon May 16 15:01:39 2022] PUT /identity/v3/projects/681a6490f3c04f9fa2830cfde3deb2e9/users/15ff90527ece4406be62f449bdf71d93/roles/f63aad4ab4a04108b87e1bf4ea8dfa53 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:01:40.030181 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3af20-a787-458c-a845-418e048e9919 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:40.105099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 305/610] 10.222.0.76 () {58 vars in 1439 bytes} [Mon May 16 15:01:39 2022] PUT /identity/v3/projects/681a6490f3c04f9fa2830cfde3deb2e9/users/496e1178104d468e9b7ce53ea754ec74/roles/f63aad4ab4a04108b87e1bf4ea8dfa53 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:01:40.177837 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3af20-a787-458c-a845-418e048e9919 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:40.219897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a5364-fc3a-4466-b507-c7b5d2bafb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:40.220550 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a5364-fc3a-4466-b507-c7b5d2bafb22 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:40.220835 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a5364-fc3a-4466-b507-c7b5d2bafb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:40.221110 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a5364-fc3a-4466-b507-c7b5d2bafb22 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:40.221872 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a5364-fc3a-4466-b507-c7b5d2bafb22 None admin] RBAC: Adding query filter params (name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:40.222208 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a5364-fc3a-4466-b507-c7b5d2bafb22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:40.223626 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a5364-fc3a-4466-b507-c7b5d2bafb22 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:40.238060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 306/611] 10.222.0.76 () {56 vars in 1103 bytes} [Mon May 16 15:01:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:40.244229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580050d-d0dc-4fd0-9416-e03a917e8d65 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:40.382212 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580050d-d0dc-4fd0-9416-e03a917e8d65 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:40.420649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af84f4-b38d-4b13-974f-803f513f977c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:40.422189 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af84f4-b38d-4b13-974f-803f513f977c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:40.422685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af84f4-b38d-4b13-974f-803f513f977c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:40.423141 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af84f4-b38d-4b13-974f-803f513f977c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:40.433941 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af84f4-b38d-4b13-974f-803f513f977c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:40.435424 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af84f4-b38d-4b13-974f-803f513f977c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:40.454363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-52af84f4-b38d-4b13-974f-803f513f977c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:40.454363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:40.454363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:40.454363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:40.454363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:40.454363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:40.454363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:40.454363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:40.454363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:40.454363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:40.454363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:40.454363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:40.454363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:40.454363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:40.454363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:40.455352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:40.455352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:40.455352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:40.455352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:40.455352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:40.455352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:40.455352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:40.455352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:40.455352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:40.455352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:40.455352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:40.455352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:40.455352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:40.455352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:40.455352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:40.455352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:40.455352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:40.456815 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:40.456815 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:40.456815 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:40.456815 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:40.456815 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 306/612] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:40.463503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a5364-fc3a-4466-b507-c7b5d2bafb22 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:40.579906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb91220-ef0d-4ecd-8f66-24e18a509ceb None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:40.580098 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb91220-ef0d-4ecd-8f66-24e18a509ceb None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:40.580514 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb91220-ef0d-4ecd-8f66-24e18a509ceb None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:40.582172 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 307/613] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:40.601492 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5db6a-3e49-44f9-904b-5278aa12f0c1 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:40.601492 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5db6a-3e49-44f9-904b-5278aa12f0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:40.601492 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5db6a-3e49-44f9-904b-5278aa12f0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:40.617792 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a5364-fc3a-4466-b507-c7b5d2bafb22 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:40.631129 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-d9f5db6a-3e49-44f9-904b-5278aa12f0c1 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:40.632335 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d9f5db6a-3e49-44f9-904b-5278aa12f0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:40.653899 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93587e0-d85f-4540-ae39-1ff5911f3fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:40.654598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93587e0-d85f-4540-ae39-1ff5911f3fcf None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:40.654882 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93587e0-d85f-4540-ae39-1ff5911f3fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:40.655161 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93587e0-d85f-4540-ae39-1ff5911f3fcf None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:40.655883 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93587e0-d85f-4540-ae39-1ff5911f3fcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:40.656190 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93587e0-d85f-4540-ae39-1ff5911f3fcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:40.658451 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93587e0-d85f-4540-ae39-1ff5911f3fcf None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:40.678593 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 307/614] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:40.693690 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93587e0-d85f-4540-ae39-1ff5911f3fcf None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:40.727996 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 308/615] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:40.763226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5db6a-3e49-44f9-904b-5278aa12f0c1 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:40.808529 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93587e0-d85f-4540-ae39-1ff5911f3fcf None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:40.851710 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa9e1f-b133-434c-9473-782a8c4583a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:40.853004 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa9e1f-b133-434c-9473-782a8c4583a7 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:40.854539 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa9e1f-b133-434c-9473-782a8c4583a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:40.855684 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa9e1f-b133-434c-9473-782a8c4583a7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:40.867888 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa9e1f-b133-434c-9473-782a8c4583a7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:40.871088 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa9e1f-b133-434c-9473-782a8c4583a7 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:40.906151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-55fa9e1f-b133-434c-9473-782a8c4583a7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 15:01:40.906151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:40.906151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:40.906151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:40.906151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:40.906151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:40.906151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:40.906151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:40.906151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:40.906151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:40.906151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:40.906151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:40.906151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:01:40.906151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:01:40.906151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:01:40.906151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:01:40.907165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:40.907165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:40.907165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:01:40.907165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:40.907165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:01:40.907165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:40.907165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:40.907165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:40.907165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:40.907165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:40.907165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:40.907165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:40.907165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:40.907165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:40.907165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:40.907165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:40.907165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:40.907165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:40.908100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:40.908100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:40.908100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:01:40.908100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:01:40.908100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:01:40.908100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:01:40.908100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:01:40.908100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:01:40.908100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 15:01:40.908100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:40.908639 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5db6a-3e49-44f9-904b-5278aa12f0c1 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:40.910972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 308/616] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:01:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:01:40.916629 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa9e1f-b133-434c-9473-782a8c4583a7 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:40.948004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604b074-0766-496e-b3f3-aeba97c5bd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:40.948810 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604b074-0766-496e-b3f3-aeba97c5bd52 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:40.949085 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604b074-0766-496e-b3f3-aeba97c5bd52 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:40.949354 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604b074-0766-496e-b3f3-aeba97c5bd52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:40.966471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604b074-0766-496e-b3f3-aeba97c5bd52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:40.976644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-7604b074-0766-496e-b3f3-aeba97c5bd52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:40.976644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:40.976644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:40.976644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:40.976644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:40.976644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:40.976644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:40.976644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:40.976644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:40.976644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:40.976644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:40.976644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:40.976644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:40.976644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:40.976644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:40.976644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:40.977565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:40.977565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:40.977565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:40.977565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:40.977565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:40.977565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:40.977565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:40.977565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:40.977565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:40.977565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:40.977565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:40.977565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:40.977565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:40.977565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:40.977565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:40.977565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:40.979087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:40.979087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:40.979087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:40.979087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:40.979087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:40.979087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:40.979087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:40.979087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:40.979087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:40.979087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:40.979087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:40.979087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:40.979735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 309/617] 10.222.0.76 () {56 vars in 1102 bytes} [Mon May 16 15:01:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:40.989062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604b074-0766-496e-b3f3-aeba97c5bd52 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:41.092035 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa9e1f-b133-434c-9473-782a8c4583a7 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:41.161721 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9daa8c-ca53-44dc-b42f-bbdd297e1b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:41.162423 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9daa8c-ca53-44dc-b42f-bbdd297e1b92 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:41.162708 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9daa8c-ca53-44dc-b42f-bbdd297e1b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:41.162983 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9daa8c-ca53-44dc-b42f-bbdd297e1b92 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:41.163831 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9daa8c-ca53-44dc-b42f-bbdd297e1b92 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:41.164138 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9daa8c-ca53-44dc-b42f-bbdd297e1b92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:41.165577 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9daa8c-ca53-44dc-b42f-bbdd297e1b92 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:41.178412 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604b074-0766-496e-b3f3-aeba97c5bd52 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:41.200764 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 309/618] 10.222.0.76 () {56 vars in 1135 bytes} [Mon May 16 15:01:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:41.206078 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9daa8c-ca53-44dc-b42f-bbdd297e1b92 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:41.223150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222127db-771d-42fa-9e45-c52ecaac99fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:41.223826 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222127db-771d-42fa-9e45-c52ecaac99fa None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:41.224110 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222127db-771d-42fa-9e45-c52ecaac99fa None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:41.224383 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222127db-771d-42fa-9e45-c52ecaac99fa None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:41.225134 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222127db-771d-42fa-9e45-c52ecaac99fa None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:41.225439 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222127db-771d-42fa-9e45-c52ecaac99fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:41.226859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222127db-771d-42fa-9e45-c52ecaac99fa None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:41.241688 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 310/619] 10.222.0.76 () {56 vars in 1103 bytes} [Mon May 16 15:01:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:41.246757 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222127db-771d-42fa-9e45-c52ecaac99fa None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:41.330399 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9daa8c-ca53-44dc-b42f-bbdd297e1b92 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:41.382786 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec22a6-4bce-46c0-9949-a596abcdf945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:41.383933 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec22a6-4bce-46c0-9949-a596abcdf945 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:41.384430 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec22a6-4bce-46c0-9949-a596abcdf945 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:41.384930 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec22a6-4bce-46c0-9949-a596abcdf945 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:41.403670 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222127db-771d-42fa-9e45-c52ecaac99fa None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:41.408525 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec22a6-4bce-46c0-9949-a596abcdf945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:41.410946 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec22a6-4bce-46c0-9949-a596abcdf945 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:41.446870 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-c2ec22a6-4bce-46c0-9949-a596abcdf945 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:41.446870 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:41.446870 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:41.446870 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:41.446870 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:41.446870 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:41.446870 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:41.446870 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:41.446870 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:41.446870 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:41.446870 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:41.446870 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:41.446870 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:41.446870 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:41.446870 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:41.447826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:41.447826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:41.447826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:41.447826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:41.447826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:41.447826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:41.447826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:41.447826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:41.447826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:41.447826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:41.447826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:41.447826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:41.447826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:41.447826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:41.447826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:41.447826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:41.447826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:41.448726 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:41.448726 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:41.448726 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:41.448726 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:41.452253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 310/620] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:01:41.457651 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec22a6-4bce-46c0-9949-a596abcdf945 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:41.463797 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba276b98-8a17-4b74-8c61-96071b9ab0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:41.465180 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba276b98-8a17-4b74-8c61-96071b9ab0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:41.465663 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba276b98-8a17-4b74-8c61-96071b9ab0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:41.466176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba276b98-8a17-4b74-8c61-96071b9ab0e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:41.477823 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba276b98-8a17-4b74-8c61-96071b9ab0e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:41.480263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba276b98-8a17-4b74-8c61-96071b9ab0e9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:41.499676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-ba276b98-8a17-4b74-8c61-96071b9ab0e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:41.499676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:41.499676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:41.499676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:41.499676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:41.499676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:41.499676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:41.499676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:41.499676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:41.499676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:41.499676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:41.499676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:41.499676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:41.499676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:41.499676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:41.500643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:41.500643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:41.500643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:41.500643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:41.500643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:41.500643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:41.500643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:41.500643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:41.500643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:41.500643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:41.500643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:41.500643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:41.500643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:41.500643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:41.500643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:41.500643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:41.500643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:41.501534 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:41.501534 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:41.501534 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:41.501534 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:41.503826 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 311/621] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:01:41.509382 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba276b98-8a17-4b74-8c61-96071b9ab0e9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:41.658141 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba276b98-8a17-4b74-8c61-96071b9ab0e9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:41.676094 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec22a6-4bce-46c0-9949-a596abcdf945 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:41.732003 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424fddcd-2bcb-4b0e-9cdf-38361380a7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:41.732599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fddcd-2bcb-4b0e-9cdf-38361380a7bf None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:41.732884 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fddcd-2bcb-4b0e-9cdf-38361380a7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:41.733162 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fddcd-2bcb-4b0e-9cdf-38361380a7bf None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:41.733891 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424fddcd-2bcb-4b0e-9cdf-38361380a7bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:41.734224 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424fddcd-2bcb-4b0e-9cdf-38361380a7bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:41.735620 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424fddcd-2bcb-4b0e-9cdf-38361380a7bf None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:41.750588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e8402-b761-43dd-b899-69d149072c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:41.751253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e8402-b761-43dd-b899-69d149072c8d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:41.751535 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e8402-b761-43dd-b899-69d149072c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:41.751809 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e8402-b761-43dd-b899-69d149072c8d None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:41.752540 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e8402-b761-43dd-b899-69d149072c8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:41.752844 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e8402-b761-43dd-b899-69d149072c8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:41.754503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e8402-b761-43dd-b899-69d149072c8d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:41.762037 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 312/622] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:41.767145 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424fddcd-2bcb-4b0e-9cdf-38361380a7bf None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:41.771634 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 311/623] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:41.777598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e8402-b761-43dd-b899-69d149072c8d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:41.872363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424fddcd-2bcb-4b0e-9cdf-38361380a7bf None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:41.903220 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e8402-b761-43dd-b899-69d149072c8d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:41.907300 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94f199-dd88-4788-8b75-03fe55624622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:41.908345 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94f199-dd88-4788-8b75-03fe55624622 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:41.908825 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94f199-dd88-4788-8b75-03fe55624622 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:41.909296 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94f199-dd88-4788-8b75-03fe55624622 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:41.916826 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94f199-dd88-4788-8b75-03fe55624622 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:41.918702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94f199-dd88-4788-8b75-03fe55624622 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:41.933870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-2e94f199-dd88-4788-8b75-03fe55624622 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 15:01:41.933870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:41.933870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:41.933870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:41.933870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:41.933870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:41.933870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:41.933870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:41.933870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:41.933870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:41.933870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:41.933870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:41.933870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:01:41.933870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:01:41.933870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:01:41.933870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:01:41.934871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:41.934871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:41.934871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:01:41.934871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:41.934871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:01:41.934871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:41.934871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:41.934871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:41.934871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:41.934871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:41.934871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:41.934871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:41.934871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:41.934871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:41.934871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:41.934871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:41.934871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:41.934871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:41.935807 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:41.935807 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:41.935807 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:01:41.935807 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:01:41.935807 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:01:41.935807 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:01:41.935807 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:01:41.935807 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:01:41.935807 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 15:01:41.935807 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:41.936886 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 313/624] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:01:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:41.938295 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4df7b-c0c9-4b13-bf80-4ccceccc1d1e None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:41.938581 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4df7b-c0c9-4b13-bf80-4ccceccc1d1e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:41.938855 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4df7b-c0c9-4b13-bf80-4ccceccc1d1e None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:41.940111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 314/625] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:41.944268 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4df7b-c0c9-4b13-bf80-4ccceccc1d1e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:41.946228 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bcb39-5583-4c54-87f0-03af4be47011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:41.947856 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bcb39-5583-4c54-87f0-03af4be47011 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:41.948137 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bcb39-5583-4c54-87f0-03af4be47011 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:41.948410 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bcb39-5583-4c54-87f0-03af4be47011 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:41.955514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bcb39-5583-4c54-87f0-03af4be47011 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:41.956959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bcb39-5583-4c54-87f0-03af4be47011 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:41.974441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-577bcb39-5583-4c54-87f0-03af4be47011 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:41.974441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:41.974441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:41.974441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:41.974441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:41.974441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:41.974441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:41.974441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:41.974441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:41.974441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:41.974441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:41.974441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:41.974441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:01:41.974441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:01:41.974441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:01:41.975348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:01:41.975348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:41.975348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:41.975348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:41.975348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:41.975348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:41.975348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:41.975348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:41.975348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:41.975348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:41.975348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:41.975348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:41.975348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:41.975348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:41.975348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:41.975348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:41.975348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:41.976234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:01:41.976234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:01:41.976234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:01:41.976234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:01:41.976234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:01:41.976234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:01:41.976234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:41.976234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:41.976234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 312/626] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:41.977154 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2d9d0-9e32-407e-b536-8677d53dce90 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:41.977399 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2d9d0-9e32-407e-b536-8677d53dce90 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:41.977675 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2d9d0-9e32-407e-b536-8677d53dce90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:41.997238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-28c2d9d0-9e32-407e-b536-8677d53dce90 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:41.998725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-28c2d9d0-9e32-407e-b536-8677d53dce90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:42.058551 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4df7b-c0c9-4b13-bf80-4ccceccc1d1e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:42.066071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 313/627] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:42.066957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2d9d0-9e32-407e-b536-8677d53dce90 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:42.115010 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33684f-438f-4b6f-8103-f375e33be33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:42.115693 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33684f-438f-4b6f-8103-f375e33be33e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:42.115955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33684f-438f-4b6f-8103-f375e33be33e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:42.116239 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33684f-438f-4b6f-8103-f375e33be33e None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:42.117141 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33684f-438f-4b6f-8103-f375e33be33e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:42.117448 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33684f-438f-4b6f-8103-f375e33be33e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:42.119041 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33684f-438f-4b6f-8103-f375e33be33e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:42.141225 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 315/628] 10.222.0.76 () {56 vars in 1137 bytes} [Mon May 16 15:01:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:42.142083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33684f-438f-4b6f-8103-f375e33be33e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:42.166695 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2d9d0-9e32-407e-b536-8677d53dce90 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:42.201821 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610d3f3-1304-4270-9ff3-d82677039576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:42.202534 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610d3f3-1304-4270-9ff3-d82677039576 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:42.202817 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610d3f3-1304-4270-9ff3-d82677039576 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:42.203091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610d3f3-1304-4270-9ff3-d82677039576 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:42.203877 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610d3f3-1304-4270-9ff3-d82677039576 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:42.204185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610d3f3-1304-4270-9ff3-d82677039576 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:42.205636 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610d3f3-1304-4270-9ff3-d82677039576 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:42.217740 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 314/629] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:01:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:42.218695 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610d3f3-1304-4270-9ff3-d82677039576 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:42.247787 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33684f-438f-4b6f-8103-f375e33be33e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:42.286964 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853a981-d336-45e9-806e-e0a87599f7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:42.287810 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853a981-d336-45e9-806e-e0a87599f7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:42.288095 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853a981-d336-45e9-806e-e0a87599f7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:42.288368 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853a981-d336-45e9-806e-e0a87599f7a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:42.299360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853a981-d336-45e9-806e-e0a87599f7a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:42.307742 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-7853a981-d336-45e9-806e-e0a87599f7a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:42.307742 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:42.307742 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:42.307742 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:42.307742 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:42.307742 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:42.307742 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:42.307742 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:42.307742 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:42.307742 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:42.307742 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:42.307742 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:42.307742 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:42.307742 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:42.307742 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:42.307742 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:42.308695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:42.308695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:42.308695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:42.308695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:42.308695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:42.308695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:42.308695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:42.308695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:42.308695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:42.308695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:42.308695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:42.308695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:42.308695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:42.308695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:42.308695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:42.308695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:42.309521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:42.309521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:42.309521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:42.309521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:42.309521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:42.309521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:42.309521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:42.309521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:42.309521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:42.309521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:42.309521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:42.309521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:42.313868 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 316/630] 10.222.0.76 () {56 vars in 1102 bytes} [Mon May 16 15:01:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:42.314755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853a981-d336-45e9-806e-e0a87599f7a7 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:42.319977 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610d3f3-1304-4270-9ff3-d82677039576 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:42.353832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72df56-8e2d-47a7-9642-b401371d7044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:42.354524 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72df56-8e2d-47a7-9642-b401371d7044 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:42.354803 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72df56-8e2d-47a7-9642-b401371d7044 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:42.355072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72df56-8e2d-47a7-9642-b401371d7044 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:42.419976 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853a981-d336-45e9-806e-e0a87599f7a7 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:42.423615 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72df56-8e2d-47a7-9642-b401371d7044 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:42.425092 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72df56-8e2d-47a7-9642-b401371d7044 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:42.454891 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96847c83-95b9-4925-9318-b0fa9e4f15c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:42.455783 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96847c83-95b9-4925-9318-b0fa9e4f15c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:42.456065 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96847c83-95b9-4925-9318-b0fa9e4f15c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:42.456339 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96847c83-95b9-4925-9318-b0fa9e4f15c7 None admin] PATH_INFO: `/v3/projects/681a6490f3c04f9fa2830cfde3deb2e9/users/33470e30760842ca9e96bb7f0cf9f07d/roles/f63aad4ab4a04108b87e1bf4ea8dfa53` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:42.471628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96847c83-95b9-4925-9318-b0fa9e4f15c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=681a6490f3c04f9fa2830cfde3deb2e9, user_id=33470e30760842ca9e96bb7f0cf9f07d, role_id=f63aad4ab4a04108b87e1bf4ea8dfa53)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:42.473108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96847c83-95b9-4925-9318-b0fa9e4f15c7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:42.528555 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 315/631] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:01:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:01:42.529443 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72df56-8e2d-47a7-9642-b401371d7044 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:42.561299 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 317/632] 10.222.0.76 () {58 vars in 1439 bytes} [Mon May 16 15:01:42 2022] PUT /identity/v3/projects/681a6490f3c04f9fa2830cfde3deb2e9/users/33470e30760842ca9e96bb7f0cf9f07d/roles/f63aad4ab4a04108b87e1bf4ea8dfa53 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:01:42.562223 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96847c83-95b9-4925-9318-b0fa9e4f15c7 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:42.646919 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72df56-8e2d-47a7-9642-b401371d7044 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:42.671366 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96847c83-95b9-4925-9318-b0fa9e4f15c7 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:42.683236 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d905a9-a277-42ab-b733-c8bd59af8247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:42.683912 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d905a9-a277-42ab-b733-c8bd59af8247 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:42.684193 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d905a9-a277-42ab-b733-c8bd59af8247 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:42.684468 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d905a9-a277-42ab-b733-c8bd59af8247 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:42.685241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d905a9-a277-42ab-b733-c8bd59af8247 None admin] RBAC: Adding query filter params (name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:42.685546 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d905a9-a277-42ab-b733-c8bd59af8247 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:42.687021 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d905a9-a277-42ab-b733-c8bd59af8247 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:42.696701 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 316/633] 10.222.0.76 () {56 vars in 1103 bytes} [Mon May 16 15:01:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:42.702703 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d905a9-a277-42ab-b733-c8bd59af8247 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:42.722874 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43608b43-a92d-4183-891a-22f60a2cd9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:42.724283 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43608b43-a92d-4183-891a-22f60a2cd9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:42.725397 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43608b43-a92d-4183-891a-22f60a2cd9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:42.726020 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43608b43-a92d-4183-891a-22f60a2cd9a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:42.741459 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43608b43-a92d-4183-891a-22f60a2cd9a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:42.743852 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43608b43-a92d-4183-891a-22f60a2cd9a5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:42.770985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-43608b43-a92d-4183-891a-22f60a2cd9a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:42.770985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:42.770985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:42.770985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:42.770985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:42.770985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:42.770985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:42.770985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:42.770985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:42.770985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:42.770985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:42.770985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:42.770985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:42.770985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:42.770985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:42.772181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:42.772181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:42.772181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:42.772181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:42.772181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:42.772181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:42.772181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:42.772181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:42.772181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:42.772181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:42.772181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:42.772181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:42.772181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:42.772181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:42.772181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:42.772181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:42.772181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:42.773299 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:42.773299 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:42.773299 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:42.773299 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:42.776030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 318/634] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:42.777664 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9a998-3dbd-4954-ae93-b8e02c632cfa None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:42.778084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9a998-3dbd-4954-ae93-b8e02c632cfa None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:42.778528 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9a998-3dbd-4954-ae93-b8e02c632cfa None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:42.784391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 319/635] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:42.784391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9a998-3dbd-4954-ae93-b8e02c632cfa None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:42.835811 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d905a9-a277-42ab-b733-c8bd59af8247 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:42.870487 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c482f-b877-4939-8a2a-e25c04e47a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:42.871527 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c482f-b877-4939-8a2a-e25c04e47a8b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:42.871807 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c482f-b877-4939-8a2a-e25c04e47a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:42.872076 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c482f-b877-4939-8a2a-e25c04e47a8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:42.886336 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c482f-b877-4939-8a2a-e25c04e47a8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:42.887796 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c482f-b877-4939-8a2a-e25c04e47a8b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:42.898673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9a998-3dbd-4954-ae93-b8e02c632cfa None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:42.904420 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-952c482f-b877-4939-8a2a-e25c04e47a8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:42.904420 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:42.904420 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:42.904420 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:42.904420 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:42.904420 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:42.904420 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:42.904420 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:42.904420 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:42.904420 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:42.904420 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:42.904420 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:42.904420 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:42.904420 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:42.904420 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:42.905321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:42.905321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:42.905321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:42.905321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:42.905321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:42.905321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:42.905321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:42.905321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:42.905321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:42.905321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:42.905321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:42.905321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:42.905321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:42.905321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:42.905321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:42.905321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:42.905321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:42.906568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:42.906568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:42.906568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:42.906568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:42.906568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 317/636] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:42.907204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6ae8f-3d4e-46d5-bc06-69ec9cb4f381 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:42.907490 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6ae8f-3d4e-46d5-bc06-69ec9cb4f381 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:42.907766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6ae8f-3d4e-46d5-bc06-69ec9cb4f381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:42.933564 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-8af6ae8f-3d4e-46d5-bc06-69ec9cb4f381 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:42.935471 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8af6ae8f-3d4e-46d5-bc06-69ec9cb4f381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:42.939448 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d73b02-ba78-4c41-bb1f-401011d22f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:42.940386 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d73b02-ba78-4c41-bb1f-401011d22f9c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:42.940863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d73b02-ba78-4c41-bb1f-401011d22f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:42.941353 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d73b02-ba78-4c41-bb1f-401011d22f9c None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:42.942300 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d73b02-ba78-4c41-bb1f-401011d22f9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:42.943209 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d73b02-ba78-4c41-bb1f-401011d22f9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:42.945144 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d73b02-ba78-4c41-bb1f-401011d22f9c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:42.964022 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 320/637] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:42.968149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a8c5e-111e-468e-ad08-20222748f6d9 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:42.969170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a8c5e-111e-468e-ad08-20222748f6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:42.970563 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a8c5e-111e-468e-ad08-20222748f6d9 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:42.973689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 321/638] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:42.975300 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a8c5e-111e-468e-ad08-20222748f6d9 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:43.008144 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 318/639] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:43.009237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6ae8f-3d4e-46d5-bc06-69ec9cb4f381 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:43.090569 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a8c5e-111e-468e-ad08-20222748f6d9 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:43.113254 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6ae8f-3d4e-46d5-bc06-69ec9cb4f381 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:43.123610 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb5bea-a7b8-44ad-90ef-cd2dc755a17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:43.124306 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb5bea-a7b8-44ad-90ef-cd2dc755a17a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:43.124589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb5bea-a7b8-44ad-90ef-cd2dc755a17a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:43.124867 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb5bea-a7b8-44ad-90ef-cd2dc755a17a None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:43.125589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb5bea-a7b8-44ad-90ef-cd2dc755a17a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:43.125896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb5bea-a7b8-44ad-90ef-cd2dc755a17a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:43.127303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb5bea-a7b8-44ad-90ef-cd2dc755a17a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:43.140119 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 322/640] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:43.141380 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04517e-1748-4603-8d63-ab4e62dced3f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:43.141670 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04517e-1748-4603-8d63-ab4e62dced3f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:43.141948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04517e-1748-4603-8d63-ab4e62dced3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:43.154409 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22092b7c-47e9-4d91-970b-11952357c7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:43.155450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22092b7c-47e9-4d91-970b-11952357c7af None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:43.155726 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22092b7c-47e9-4d91-970b-11952357c7af None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:43.155993 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22092b7c-47e9-4d91-970b-11952357c7af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:43.157932 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-0f04517e-1748-4603-8d63-ab4e62dced3f None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:43.159168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0f04517e-1748-4603-8d63-ab4e62dced3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:43.164681 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22092b7c-47e9-4d91-970b-11952357c7af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:43.166212 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22092b7c-47e9-4d91-970b-11952357c7af None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:43.179865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-22092b7c-47e9-4d91-970b-11952357c7af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:43.179865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:43.179865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:43.179865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:43.179865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:43.179865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:43.179865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:43.179865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:43.179865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:43.179865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:43.179865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:43.179865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:43.179865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:01:43.179865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:01:43.179865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:01:43.180790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:01:43.180790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:43.180790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:43.180790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:43.180790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:43.180790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:43.180790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:43.180790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:43.180790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:43.180790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:43.180790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:43.180790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:43.180790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:43.180790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:43.180790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:43.180790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:43.180790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:43.182237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:01:43.182237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:01:43.182237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:01:43.182237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:01:43.182237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:01:43.182237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:01:43.182237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:43.182237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:43.182237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 319/641] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:43.182756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22092b7c-47e9-4d91-970b-11952357c7af None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:43.239890 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 323/642] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:43.240776 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04517e-1748-4603-8d63-ab4e62dced3f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:43.294215 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22092b7c-47e9-4d91-970b-11952357c7af None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:43.331934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329ba7c-0e7b-4ebc-8e5a-530f62cb3ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:43.332725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329ba7c-0e7b-4ebc-8e5a-530f62cb3ece None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:43.333001 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329ba7c-0e7b-4ebc-8e5a-530f62cb3ece None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:43.333270 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329ba7c-0e7b-4ebc-8e5a-530f62cb3ece None admin] PATH_INFO: `/v3/roles/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:43.343623 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329ba7c-0e7b-4ebc-8e5a-530f62cb3ece None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:43.351406 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-3329ba7c-0e7b-4ebc-8e5a-530f62cb3ece None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:43.351406 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:43.351406 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:43.351406 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:43.351406 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:43.351406 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:43.351406 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:43.351406 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:43.351406 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:43.351406 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:43.351406 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:43.351406 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:43.351406 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:43.351406 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:43.351406 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:43.351406 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:43.352398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:43.352398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:43.352398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:43.352398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:43.352398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:43.352398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:43.352398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:43.352398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:43.352398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:43.352398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:43.352398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:43.352398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:43.352398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:43.352398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:43.352398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:43.352398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:43.353382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:43.353382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:43.353382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:43.353382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:43.353382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:43.353382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:43.353382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:43.353382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:43.353382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:43.353382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:43.353382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:43.353382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:43.353382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 320/643] 10.222.0.76 () {56 vars in 1102 bytes} [Mon May 16 15:01:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:43.354086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329ba7c-0e7b-4ebc-8e5a-530f62cb3ece None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:43.359211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04517e-1748-4603-8d63-ab4e62dced3f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:43.393289 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd23e56-db64-4989-8633-cd3a61fa5027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:43.394081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd23e56-db64-4989-8633-cd3a61fa5027 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:43.394395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd23e56-db64-4989-8633-cd3a61fa5027 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:43.394677 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd23e56-db64-4989-8633-cd3a61fa5027 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:43.401843 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd23e56-db64-4989-8633-cd3a61fa5027 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:43.403363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd23e56-db64-4989-8633-cd3a61fa5027 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:43.418206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-7fd23e56-db64-4989-8633-cd3a61fa5027 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 15:01:43.418206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:43.418206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:43.418206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:43.418206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:43.418206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:43.418206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:43.418206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:43.418206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:43.418206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:43.418206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:43.418206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:43.418206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:01:43.418206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:01:43.418206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:01:43.418206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:01:43.421203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:43.421203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:43.421203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:01:43.421203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:43.421203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:01:43.421203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:43.421203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:43.421203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:43.421203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:43.421203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:43.421203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:43.421203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:43.421203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:43.421203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:43.421203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:43.421203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:43.421203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:43.421203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:43.422249 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:43.422249 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:43.422249 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:01:43.422249 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:01:43.422249 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:01:43.422249 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:01:43.422249 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:01:43.422249 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:01:43.422249 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 15:01:43.422249 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:43.424191 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 324/644] 10.222.0.76 () {56 vars in 1093 bytes} [Mon May 16 15:01:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:43.424966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd23e56-db64-4989-8633-cd3a61fa5027 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:43.455305 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329ba7c-0e7b-4ebc-8e5a-530f62cb3ece None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:43.488820 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3d43d-7f9d-4027-9ea5-1731ca395eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:43.489753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3d43d-7f9d-4027-9ea5-1731ca395eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:43.490207 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3d43d-7f9d-4027-9ea5-1731ca395eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:43.490626 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3d43d-7f9d-4027-9ea5-1731ca395eb5 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:43.491696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3d43d-7f9d-4027-9ea5-1731ca395eb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:43.492208 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3d43d-7f9d-4027-9ea5-1731ca395eb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:43.494350 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3d43d-7f9d-4027-9ea5-1731ca395eb5 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:43.512132 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 321/645] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:01:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:43.512132 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3d43d-7f9d-4027-9ea5-1731ca395eb5 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:43.531017 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd23e56-db64-4989-8633-cd3a61fa5027 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:43.564833 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c46a2-39b0-45bb-8040-ff6821bb0f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:43.565758 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c46a2-39b0-45bb-8040-ff6821bb0f96 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:43.566164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c46a2-39b0-45bb-8040-ff6821bb0f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:43.569370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c46a2-39b0-45bb-8040-ff6821bb0f96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:43.579894 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c46a2-39b0-45bb-8040-ff6821bb0f96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:43.592250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a00c46a2-39b0-45bb-8040-ff6821bb0f96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:43.592250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:43.592250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:43.592250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:43.592250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:43.592250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:43.592250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:43.592250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:43.592250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:43.592250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:43.592250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:43.592250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:43.592250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:43.592250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:43.592250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:43.592250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:43.593450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:43.593450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:43.593450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:43.593450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:43.593450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:43.593450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:43.593450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:43.593450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:43.593450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:43.593450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:43.593450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:43.593450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:43.593450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:43.593450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:43.593450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:43.593450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:43.594550 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:43.594550 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:43.594550 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:43.594550 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:43.594550 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:43.594550 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:43.594550 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:43.594550 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:43.594550 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:43.594550 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:43.594550 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:43.594550 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:43.600403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 325/646] 10.222.0.76 () {56 vars in 1102 bytes} [Mon May 16 15:01:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:43.600403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c46a2-39b0-45bb-8040-ff6821bb0f96 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:43.619405 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3d43d-7f9d-4027-9ea5-1731ca395eb5 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:43.654010 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a874735-d14b-4456-ab20-c5bd62a25c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:43.654800 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a874735-d14b-4456-ab20-c5bd62a25c71 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:43.655139 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a874735-d14b-4456-ab20-c5bd62a25c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:43.655489 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a874735-d14b-4456-ab20-c5bd62a25c71 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:43.656309 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a874735-d14b-4456-ab20-c5bd62a25c71 None admin] RBAC: Adding query filter params (name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:43.656687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a874735-d14b-4456-ab20-c5bd62a25c71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:43.658067 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a874735-d14b-4456-ab20-c5bd62a25c71 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:43.670611 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 322/647] 10.222.0.76 () {56 vars in 1103 bytes} [Mon May 16 15:01:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:43.670611 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a874735-d14b-4456-ab20-c5bd62a25c71 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:43.694503 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c46a2-39b0-45bb-8040-ff6821bb0f96 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:43.729684 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447f4d9-52eb-4197-951c-49adac1b0918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:43.730841 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447f4d9-52eb-4197-951c-49adac1b0918 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:43.731290 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447f4d9-52eb-4197-951c-49adac1b0918 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:43.731724 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447f4d9-52eb-4197-951c-49adac1b0918 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:43.732873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447f4d9-52eb-4197-951c-49adac1b0918 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:43.733805 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447f4d9-52eb-4197-951c-49adac1b0918 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:43.735673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447f4d9-52eb-4197-951c-49adac1b0918 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:43.757998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 326/648] 10.222.0.76 () {56 vars in 1133 bytes} [Mon May 16 15:01:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:43.759547 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447f4d9-52eb-4197-951c-49adac1b0918 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:43.766888 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a874735-d14b-4456-ab20-c5bd62a25c71 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:43.801749 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff383d5-9114-4145-a229-9b406cf107ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:43.802695 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff383d5-9114-4145-a229-9b406cf107ec None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:43.802972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff383d5-9114-4145-a229-9b406cf107ec None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:43.803250 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff383d5-9114-4145-a229-9b406cf107ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:43.804079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff383d5-9114-4145-a229-9b406cf107ec None admin] RBAC: Adding query filter params (role.id=f63aad4ab4a04108b87e1bf4ea8dfa53, scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9, user.id=2d1e67aa4370453fafb5b6525ba13cd3) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:43.804390 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff383d5-9114-4145-a229-9b406cf107ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:43.806896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff383d5-9114-4145-a229-9b406cf107ec None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:43.822403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 323/649] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:01:43 2022] GET /identity/v3/role_assignments?user.id=2d1e67aa4370453fafb5b6525ba13cd3&scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9&role.id=f63aad4ab4a04108b87e1bf4ea8dfa53 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:43.822403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff383d5-9114-4145-a229-9b406cf107ec None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:43.866354 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447f4d9-52eb-4197-951c-49adac1b0918 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:43.904923 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21324c0e-dff9-432d-9e93-49405e362cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:43.905714 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21324c0e-dff9-432d-9e93-49405e362cae None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:43.906105 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21324c0e-dff9-432d-9e93-49405e362cae None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:43.906515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21324c0e-dff9-432d-9e93-49405e362cae None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:43.907501 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21324c0e-dff9-432d-9e93-49405e362cae None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:43.907917 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21324c0e-dff9-432d-9e93-49405e362cae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:43.909418 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21324c0e-dff9-432d-9e93-49405e362cae None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:43.923265 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 327/650] 10.222.0.76 () {56 vars in 1103 bytes} [Mon May 16 15:01:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:43.924409 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21324c0e-dff9-432d-9e93-49405e362cae None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:43.958436 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff383d5-9114-4145-a229-9b406cf107ec None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:43.995447 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954fcb1-1ecb-4628-8272-62c83b9f484b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:43.997950 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954fcb1-1ecb-4628-8272-62c83b9f484b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:43.997950 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954fcb1-1ecb-4628-8272-62c83b9f484b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:43.997950 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954fcb1-1ecb-4628-8272-62c83b9f484b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:44.010474 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954fcb1-1ecb-4628-8272-62c83b9f484b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:44.012953 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954fcb1-1ecb-4628-8272-62c83b9f484b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:44.035841 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-c954fcb1-1ecb-4628-8272-62c83b9f484b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:44.035841 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:44.035841 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:44.035841 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:44.035841 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:44.035841 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:44.035841 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:44.035841 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:44.035841 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:44.035841 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:44.035841 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:44.035841 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:44.035841 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:44.035841 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:44.035841 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:44.036938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:44.036938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:44.036938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:44.036938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:44.036938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:44.036938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:44.036938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:44.036938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:44.036938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:44.036938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:44.036938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:44.036938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:44.036938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:44.036938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:44.036938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:44.036938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:44.036938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:44.037861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:44.037861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:44.037861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:44.037861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:44.037861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 324/651] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:44.040095 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954fcb1-1ecb-4628-8272-62c83b9f484b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:44.051117 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21324c0e-dff9-432d-9e93-49405e362cae None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:44.091526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f287bb-0631-4ab7-85cb-04d2ae0a842b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:44.092174 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f287bb-0631-4ab7-85cb-04d2ae0a842b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:44.092457 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f287bb-0631-4ab7-85cb-04d2ae0a842b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:44.092734 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f287bb-0631-4ab7-85cb-04d2ae0a842b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:44.157994 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954fcb1-1ecb-4628-8272-62c83b9f484b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:44.163357 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f287bb-0631-4ab7-85cb-04d2ae0a842b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:44.164842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f287bb-0631-4ab7-85cb-04d2ae0a842b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:44.191839 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b14a5-8a0c-460d-8c4b-b58312b632e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:44.192630 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b14a5-8a0c-460d-8c4b-b58312b632e1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:44.192909 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b14a5-8a0c-460d-8c4b-b58312b632e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:44.193179 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b14a5-8a0c-460d-8c4b-b58312b632e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:44.204223 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b14a5-8a0c-460d-8c4b-b58312b632e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:44.205715 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b14a5-8a0c-460d-8c4b-b58312b632e1 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:44.223689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-6e0b14a5-8a0c-460d-8c4b-b58312b632e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:44.223689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:44.223689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:44.223689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:44.223689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:44.223689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:44.223689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:44.223689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:44.223689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:44.223689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:44.223689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:44.223689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:44.223689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:44.223689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:44.223689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:44.224614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:44.224614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:44.224614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:44.224614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:44.224614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:44.224614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:44.224614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:44.224614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:44.224614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:44.224614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:44.224614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:44.224614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:44.224614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:44.224614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:44.224614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:44.224614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:44.224614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:44.225514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:44.225514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:44.225514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:44.225514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:44.225514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 325/652] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:44.226245 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b14a5-8a0c-460d-8c4b-b58312b632e1 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:44.274527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 328/653] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:01:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:01:44.276014 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f287bb-0631-4ab7-85cb-04d2ae0a842b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:44.328435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b14a5-8a0c-460d-8c4b-b58312b632e1 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:44.362437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfee98-d822-48af-9994-0b7763381b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:44.363100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfee98-d822-48af-9994-0b7763381b90 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:44.363380 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfee98-d822-48af-9994-0b7763381b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:44.363653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfee98-d822-48af-9994-0b7763381b90 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:44.364382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfee98-d822-48af-9994-0b7763381b90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:44.364683 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfee98-d822-48af-9994-0b7763381b90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:44.366186 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfee98-d822-48af-9994-0b7763381b90 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:44.378746 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f287bb-0631-4ab7-85cb-04d2ae0a842b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:44.382844 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 326/654] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:44.383726 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfee98-d822-48af-9994-0b7763381b90 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:44.422935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81740ac-f240-45e8-9e18-8a1168d03975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:44.422935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81740ac-f240-45e8-9e18-8a1168d03975 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:44.422935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81740ac-f240-45e8-9e18-8a1168d03975 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:44.422935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81740ac-f240-45e8-9e18-8a1168d03975 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:44.423702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81740ac-f240-45e8-9e18-8a1168d03975 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:44.423702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81740ac-f240-45e8-9e18-8a1168d03975 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:44.423702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81740ac-f240-45e8-9e18-8a1168d03975 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:44.438242 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 329/655] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:44.442675 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81740ac-f240-45e8-9e18-8a1168d03975 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:44.497730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfee98-d822-48af-9994-0b7763381b90 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:44.545095 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a31e2-6643-4cb5-bb09-48062a013278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:44.546439 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a31e2-6643-4cb5-bb09-48062a013278 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:44.546868 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a31e2-6643-4cb5-bb09-48062a013278 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:44.547283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a31e2-6643-4cb5-bb09-48062a013278 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:44.561957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a31e2-6643-4cb5-bb09-48062a013278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:44.564133 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a31e2-6643-4cb5-bb09-48062a013278 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:44.566476 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81740ac-f240-45e8-9e18-8a1168d03975 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:44.590362 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-330a31e2-6643-4cb5-bb09-48062a013278 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:44.590362 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:44.590362 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:44.590362 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:44.590362 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:44.590362 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:44.590362 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:44.590362 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:44.590362 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:44.590362 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:44.590362 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:44.590362 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:44.590362 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:44.590362 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:44.590362 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:44.591458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:44.591458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:44.591458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:44.591458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:44.591458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:44.591458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:44.591458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:44.591458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:44.591458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:44.591458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:44.591458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:44.591458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:44.591458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:44.591458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:44.591458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:44.591458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:44.591458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:44.592587 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:44.592587 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:44.592587 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:44.592587 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:44.594931 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 327/656] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:44.595850 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a31e2-6643-4cb5-bb09-48062a013278 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:44.613434 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8dca3-1e5a-4055-9ac2-4adb5c3174c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:44.614420 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8dca3-1e5a-4055-9ac2-4adb5c3174c6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:44.615109 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8dca3-1e5a-4055-9ac2-4adb5c3174c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:44.615109 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8dca3-1e5a-4055-9ac2-4adb5c3174c6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:44.624026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8dca3-1e5a-4055-9ac2-4adb5c3174c6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:44.625614 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8dca3-1e5a-4055-9ac2-4adb5c3174c6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:44.640485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-52e8dca3-1e5a-4055-9ac2-4adb5c3174c6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 15:01:44.640485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:44.640485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:44.640485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:44.640485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:44.640485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:44.640485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:44.640485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:44.640485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:44.640485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:44.640485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:44.640485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:44.640485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:01:44.640485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:01:44.640485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:01:44.640485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:01:44.641645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:44.641645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:44.641645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:01:44.641645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:44.641645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:01:44.641645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:44.641645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:44.641645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:44.641645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:44.641645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:44.641645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:44.641645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:44.641645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:44.641645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:44.641645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:44.641645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:44.641645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:44.641645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:44.642827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:44.642827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:44.642827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:01:44.642827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:01:44.642827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:01:44.642827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:01:44.642827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:01:44.642827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:01:44.642827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 15:01:44.642827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:44.644730 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 330/657] 10.222.0.76 () {56 vars in 1102 bytes} [Mon May 16 15:01:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:44.645704 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8dca3-1e5a-4055-9ac2-4adb5c3174c6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:44.724455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a31e2-6643-4cb5-bb09-48062a013278 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:44.750194 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8dca3-1e5a-4055-9ac2-4adb5c3174c6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:44.771038 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7a2fe-772b-412a-ad7c-5e5e85496d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:44.773080 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7a2fe-772b-412a-ad7c-5e5e85496d3a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:44.773641 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7a2fe-772b-412a-ad7c-5e5e85496d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:44.774060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7a2fe-772b-412a-ad7c-5e5e85496d3a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:44.785583 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7a2fe-772b-412a-ad7c-5e5e85496d3a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:44.787695 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7a2fe-772b-412a-ad7c-5e5e85496d3a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:44.794911 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7a40c-33bc-49f2-8604-a6b311d56c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:44.795766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7a40c-33bc-49f2-8604-a6b311d56c4f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:44.796295 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7a40c-33bc-49f2-8604-a6b311d56c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:44.796713 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7a40c-33bc-49f2-8604-a6b311d56c4f None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:44.797920 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7a40c-33bc-49f2-8604-a6b311d56c4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:44.798400 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7a40c-33bc-49f2-8604-a6b311d56c4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:44.799919 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7a40c-33bc-49f2-8604-a6b311d56c4f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:44.806570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-18d7a2fe-772b-412a-ad7c-5e5e85496d3a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 15:01:44.806570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:44.806570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:44.806570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:44.806570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:44.806570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:44.806570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:44.806570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:44.806570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:44.806570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:44.806570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:44.806570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:44.806570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:01:44.806570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:01:44.806570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:01:44.806570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:01:44.807766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:44.807766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:44.807766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:01:44.807766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:44.807766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:01:44.807766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:44.807766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:44.807766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:44.807766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:44.807766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:44.807766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:44.807766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:44.807766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:44.807766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:44.807766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:44.807766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:44.807766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:44.807766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:44.808916 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:44.808916 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:44.808916 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:01:44.808916 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:01:44.808916 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:01:44.808916 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:01:44.808916 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:01:44.808916 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:01:44.808916 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 15:01:44.808916 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:44.814453 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 328/658] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:01:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:44.815386 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7a2fe-772b-412a-ad7c-5e5e85496d3a None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:44.817324 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 331/659] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:44.818435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7a40c-33bc-49f2-8604-a6b311d56c4f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:44.918245 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7a2fe-772b-412a-ad7c-5e5e85496d3a None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:44.938106 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7a40c-33bc-49f2-8604-a6b311d56c4f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:44.952379 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588d6b3-3e48-4321-b8ce-3017a96898bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:44.953042 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588d6b3-3e48-4321-b8ce-3017a96898bc None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:44.953324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588d6b3-3e48-4321-b8ce-3017a96898bc None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:44.953599 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588d6b3-3e48-4321-b8ce-3017a96898bc None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:44.954471 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d588d6b3-3e48-4321-b8ce-3017a96898bc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:44.954779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d588d6b3-3e48-4321-b8ce-3017a96898bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:44.956227 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d588d6b3-3e48-4321-b8ce-3017a96898bc None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:44.971632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16265ae8-d739-4a64-a738-03f262f69bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:44.972295 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16265ae8-d739-4a64-a738-03f262f69bbe None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:44.972580 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16265ae8-d739-4a64-a738-03f262f69bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:44.972857 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16265ae8-d739-4a64-a738-03f262f69bbe None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:44.973695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16265ae8-d739-4a64-a738-03f262f69bbe None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:44.974002 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16265ae8-d739-4a64-a738-03f262f69bbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:44.975510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16265ae8-d739-4a64-a738-03f262f69bbe None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:44.977352 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 329/660] 10.222.0.76 () {56 vars in 1139 bytes} [Mon May 16 15:01:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:44.978265 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588d6b3-3e48-4321-b8ce-3017a96898bc None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:44.998641 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 332/661] 10.222.0.76 () {56 vars in 1137 bytes} [Mon May 16 15:01:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:44.998641 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205e372-8249-42c3-8a4e-d8a7ef3215a7 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:44.998641 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205e372-8249-42c3-8a4e-d8a7ef3215a7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:44.998641 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205e372-8249-42c3-8a4e-d8a7ef3215a7 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:44.998641 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 333/662] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:44.998641 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205e372-8249-42c3-8a4e-d8a7ef3215a7 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:45.092200 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588d6b3-3e48-4321-b8ce-3017a96898bc None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:45.104746 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205e372-8249-42c3-8a4e-d8a7ef3215a7 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:45.128028 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcee15-0fa2-4f80-84db-f470fd25a928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:45.128819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcee15-0fa2-4f80-84db-f470fd25a928 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:45.129358 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcee15-0fa2-4f80-84db-f470fd25a928 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:45.129628 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcee15-0fa2-4f80-84db-f470fd25a928 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:45.136316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcee15-0fa2-4f80-84db-f470fd25a928 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:45.137845 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcee15-0fa2-4f80-84db-f470fd25a928 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:45.141671 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e71df-6bea-4870-9af1-449bdcac9d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:45.142358 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e71df-6bea-4870-9af1-449bdcac9d1b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:45.142642 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e71df-6bea-4870-9af1-449bdcac9d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:45.142914 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e71df-6bea-4870-9af1-449bdcac9d1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:45.151241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-6bbcee15-0fa2-4f80-84db-f470fd25a928 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:45.151241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:45.151241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:45.151241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:45.151241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:45.151241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:45.151241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:45.151241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:45.151241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:45.151241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:45.151241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:45.151241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:45.151241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:01:45.151241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:01:45.151241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:01:45.152184 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:01:45.152184 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:45.152184 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:45.152184 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:45.152184 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:45.152184 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:45.152184 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:45.152184 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:45.152184 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:45.152184 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:45.152184 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:45.152184 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:45.152184 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:45.152184 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:45.152184 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:45.152184 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:45.152184 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:45.153101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:01:45.153101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:01:45.153101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:01:45.153101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:01:45.153101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:01:45.153101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:01:45.153101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:45.153101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:45.153101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 330/663] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:45.153602 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcee15-0fa2-4f80-84db-f470fd25a928 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:45.209716 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e71df-6bea-4870-9af1-449bdcac9d1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:45.211221 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e71df-6bea-4870-9af1-449bdcac9d1b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:45.255619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcee15-0fa2-4f80-84db-f470fd25a928 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:45.288919 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842674af-9759-48c2-90a9-b594a6c8aa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:45.289554 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842674af-9759-48c2-90a9-b594a6c8aa6a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:45.289832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842674af-9759-48c2-90a9-b594a6c8aa6a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:45.290099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842674af-9759-48c2-90a9-b594a6c8aa6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:45.311243 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 334/664] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:01:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:01:45.311243 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2459b-4dd0-488e-9b1c-82ca7d054281 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:45.311243 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2459b-4dd0-488e-9b1c-82ca7d054281 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:45.311243 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2459b-4dd0-488e-9b1c-82ca7d054281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:45.324891 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-bcc2459b-4dd0-488e-9b1c-82ca7d054281 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:45.326049 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bcc2459b-4dd0-488e-9b1c-82ca7d054281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:45.360000 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842674af-9759-48c2-90a9-b594a6c8aa6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:45.361579 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842674af-9759-48c2-90a9-b594a6c8aa6a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:45.390242 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 335/665] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:45.391190 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2459b-4dd0-488e-9b1c-82ca7d054281 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:45.475494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 331/666] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:01:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:01:45.475494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842674af-9759-48c2-90a9-b594a6c8aa6a None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:45.494594 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2459b-4dd0-488e-9b1c-82ca7d054281 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:45.528256 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0d07e-93d8-4174-953a-28daaaf36a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:45.528838 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0d07e-93d8-4174-953a-28daaaf36a83 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:45.529119 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0d07e-93d8-4174-953a-28daaaf36a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:45.529398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0d07e-93d8-4174-953a-28daaaf36a83 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:45.530217 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0d07e-93d8-4174-953a-28daaaf36a83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:45.530534 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0d07e-93d8-4174-953a-28daaaf36a83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:45.531958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0d07e-93d8-4174-953a-28daaaf36a83 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:45.549888 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 336/667] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:01:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:45.549888 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0d07e-93d8-4174-953a-28daaaf36a83 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:45.573022 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842674af-9759-48c2-90a9-b594a6c8aa6a None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:45.609944 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e084dea-48e8-4eb2-b0ff-cdecf888408a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:45.610923 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e084dea-48e8-4eb2-b0ff-cdecf888408a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:45.611303 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e084dea-48e8-4eb2-b0ff-cdecf888408a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:45.611677 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e084dea-48e8-4eb2-b0ff-cdecf888408a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:45.621723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e084dea-48e8-4eb2-b0ff-cdecf888408a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:45.623276 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e084dea-48e8-4eb2-b0ff-cdecf888408a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:45.647851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-4e084dea-48e8-4eb2-b0ff-cdecf888408a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:45.647851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:45.647851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:45.647851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:45.647851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:45.647851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:45.647851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:45.647851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:45.647851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:45.647851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:45.647851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:45.647851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:45.647851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:45.647851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:45.647851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:45.648957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:45.648957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:45.648957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:45.648957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:45.648957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:45.648957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:45.648957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:45.648957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:45.648957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:45.648957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:45.648957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:45.648957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:45.648957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:45.648957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:45.648957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:45.648957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:45.648957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:45.650660 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:45.650660 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:45.650660 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:45.650660 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:45.654443 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 332/668] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:45.655502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e084dea-48e8-4eb2-b0ff-cdecf888408a None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:45.661472 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0d07e-93d8-4174-953a-28daaaf36a83 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:45.697464 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f19d0f-dbf8-4661-9ccf-531a91231085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:45.698432 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f19d0f-dbf8-4661-9ccf-531a91231085 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:45.698811 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f19d0f-dbf8-4661-9ccf-531a91231085 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:45.699165 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f19d0f-dbf8-4661-9ccf-531a91231085 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:45.709070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f19d0f-dbf8-4661-9ccf-531a91231085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:45.716759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-00f19d0f-dbf8-4661-9ccf-531a91231085 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:45.716759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:45.716759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:45.716759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:45.716759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:45.716759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:45.716759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:45.716759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:45.716759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:45.716759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:45.716759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:45.716759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:45.716759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:45.716759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:45.716759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:45.716759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:45.717928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:45.717928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:45.717928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:45.717928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:45.717928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:45.717928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:45.717928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:45.717928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:45.717928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:45.717928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:45.717928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:45.717928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:45.717928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:45.717928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:45.717928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:45.717928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:45.718976 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:45.718976 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:45.718976 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:45.718976 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:45.718976 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:45.718976 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:45.718976 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:45.718976 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:45.718976 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:45.718976 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:45.718976 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:45.718976 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:45.723618 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 337/669] 10.222.0.76 () {56 vars in 1102 bytes} [Mon May 16 15:01:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:45.724327 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f19d0f-dbf8-4661-9ccf-531a91231085 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:45.754876 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e084dea-48e8-4eb2-b0ff-cdecf888408a None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:45.788042 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813dbf33-7660-4366-84a3-5f0a867449bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:45.788768 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dbf33-7660-4366-84a3-5f0a867449bf None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:45.789023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dbf33-7660-4366-84a3-5f0a867449bf None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:45.789293 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dbf33-7660-4366-84a3-5f0a867449bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:45.799876 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813dbf33-7660-4366-84a3-5f0a867449bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:45.801317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813dbf33-7660-4366-84a3-5f0a867449bf None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:45.819852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-813dbf33-7660-4366-84a3-5f0a867449bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:45.819852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:45.819852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:45.819852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:45.819852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:45.819852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:45.819852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:45.819852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:45.819852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:45.819852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:45.819852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:45.819852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:45.819852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:45.819852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:45.819852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:45.820771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:45.820771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:45.820771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:45.820771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:45.820771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:45.820771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:45.820771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:45.820771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:45.820771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:45.820771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:45.820771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:45.820771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:45.820771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:45.820771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:45.820771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:45.820771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:45.820771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:45.821699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:45.821699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:45.821699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:45.821699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:45.821699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 333/670] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:45.821983 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813dbf33-7660-4366-84a3-5f0a867449bf None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:45.830910 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f19d0f-dbf8-4661-9ccf-531a91231085 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:45.863521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacd8a7-1ee9-4b73-b935-599f306d3152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:45.864171 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacd8a7-1ee9-4b73-b935-599f306d3152 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:45.864454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacd8a7-1ee9-4b73-b935-599f306d3152 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:45.864730 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacd8a7-1ee9-4b73-b935-599f306d3152 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:45.865564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deacd8a7-1ee9-4b73-b935-599f306d3152 None admin] RBAC: Adding query filter params (role.id=f63aad4ab4a04108b87e1bf4ea8dfa53, scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9, user.id=9d85024f010c40129d79543b3ec4cfae) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:45.865875 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deacd8a7-1ee9-4b73-b935-599f306d3152 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:45.867346 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deacd8a7-1ee9-4b73-b935-599f306d3152 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:45.873843 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 338/671] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:01:45 2022] GET /identity/v3/role_assignments?user.id=9d85024f010c40129d79543b3ec4cfae&scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9&role.id=f63aad4ab4a04108b87e1bf4ea8dfa53 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:45.874501 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacd8a7-1ee9-4b73-b935-599f306d3152 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:45.939134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813dbf33-7660-4366-84a3-5f0a867449bf None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:45.980897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f771d-f9dc-4bef-bab2-89ce887a7de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:45.981576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f771d-f9dc-4bef-bab2-89ce887a7de0 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:45.981859 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f771d-f9dc-4bef-bab2-89ce887a7de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:45.982155 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f771d-f9dc-4bef-bab2-89ce887a7de0 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:45.982918 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f771d-f9dc-4bef-bab2-89ce887a7de0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:45.983225 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f771d-f9dc-4bef-bab2-89ce887a7de0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:45.984631 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f771d-f9dc-4bef-bab2-89ce887a7de0 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:46.002181 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 334/672] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:46.002181 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f771d-f9dc-4bef-bab2-89ce887a7de0 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:46.033104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deacd8a7-1ee9-4b73-b935-599f306d3152 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:46.074647 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66f331-6b2f-4a9e-b2fd-f69c7989d52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:46.075246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66f331-6b2f-4a9e-b2fd-f69c7989d52c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:46.075529 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66f331-6b2f-4a9e-b2fd-f69c7989d52c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:46.075800 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66f331-6b2f-4a9e-b2fd-f69c7989d52c None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:46.076552 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66f331-6b2f-4a9e-b2fd-f69c7989d52c None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:46.076857 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66f331-6b2f-4a9e-b2fd-f69c7989d52c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:46.078957 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66f331-6b2f-4a9e-b2fd-f69c7989d52c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:46.090759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 339/673] 10.222.0.76 () {56 vars in 1103 bytes} [Mon May 16 15:01:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:46.091084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66f331-6b2f-4a9e-b2fd-f69c7989d52c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:46.125694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f771d-f9dc-4bef-bab2-89ce887a7de0 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:46.162695 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d6bb4-48a5-4ed4-8818-f7383a64ccd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:46.163723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d6bb4-48a5-4ed4-8818-f7383a64ccd7 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:46.164250 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d6bb4-48a5-4ed4-8818-f7383a64ccd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:46.164734 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d6bb4-48a5-4ed4-8818-f7383a64ccd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:46.165696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d6bb4-48a5-4ed4-8818-f7383a64ccd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:46.166231 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d6bb4-48a5-4ed4-8818-f7383a64ccd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:46.167895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d6bb4-48a5-4ed4-8818-f7383a64ccd7 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:46.181754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 335/674] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:46.182961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d6bb4-48a5-4ed4-8818-f7383a64ccd7 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:46.205685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66f331-6b2f-4a9e-b2fd-f69c7989d52c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:46.239931 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6aa811-b260-4778-886e-47ff1dc5b441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:46.240717 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6aa811-b260-4778-886e-47ff1dc5b441 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:46.241012 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6aa811-b260-4778-886e-47ff1dc5b441 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:46.241277 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6aa811-b260-4778-886e-47ff1dc5b441 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:46.247950 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6aa811-b260-4778-886e-47ff1dc5b441 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:46.249385 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6aa811-b260-4778-886e-47ff1dc5b441 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:46.263779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-8f6aa811-b260-4778-886e-47ff1dc5b441 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:46.263779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:46.263779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:46.263779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:46.263779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:46.263779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:46.263779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:46.263779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:46.263779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:46.263779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:46.263779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:46.263779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:46.263779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:01:46.263779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:01:46.263779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:01:46.264756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:01:46.264756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:46.264756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:46.264756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:46.264756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:46.264756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:46.264756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:46.264756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:46.264756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:46.264756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:46.264756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:46.264756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:46.264756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:46.264756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:46.264756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:46.264756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:46.264756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:46.266360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:01:46.266360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:01:46.266360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:01:46.266360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:01:46.266360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:01:46.266360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:01:46.266360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:46.266360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:46.266360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 340/675] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:46.266360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6aa811-b260-4778-886e-47ff1dc5b441 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:46.291561 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d6bb4-48a5-4ed4-8818-f7383a64ccd7 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:46.326943 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1b744-2713-42ba-8cca-a1c212d4158c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:46.327656 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1b744-2713-42ba-8cca-a1c212d4158c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:46.327942 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1b744-2713-42ba-8cca-a1c212d4158c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:46.328215 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1b744-2713-42ba-8cca-a1c212d4158c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:46.338963 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1b744-2713-42ba-8cca-a1c212d4158c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:46.340436 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1b744-2713-42ba-8cca-a1c212d4158c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:46.359091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-4fd1b744-2713-42ba-8cca-a1c212d4158c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:46.359091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:46.359091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:46.359091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:46.359091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:46.359091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:46.359091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:46.359091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:46.359091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:46.359091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:46.359091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:46.359091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:46.359091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:46.359091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:46.359091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:46.360233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:46.360233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:46.360233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:46.360233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:46.360233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:46.360233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:46.360233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:46.360233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:46.360233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:46.360233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:46.360233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:46.360233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:46.360233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:46.360233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:46.360233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:46.360233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:46.360233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:46.361167 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:46.361167 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:46.361167 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:46.361167 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:46.361167 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 336/676] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:46.361663 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586079b5-7d6a-42db-af1a-1e2b05444d7f None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:46.361895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586079b5-7d6a-42db-af1a-1e2b05444d7f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:46.362524 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586079b5-7d6a-42db-af1a-1e2b05444d7f None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:46.366177 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 337/677] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:46.366177 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586079b5-7d6a-42db-af1a-1e2b05444d7f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:46.384901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6aa811-b260-4778-886e-47ff1dc5b441 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:46.420465 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6bbca3-98b6-4afc-a9c3-6a73bcf2e976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:46.421600 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bbca3-98b6-4afc-a9c3-6a73bcf2e976 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:46.422045 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bbca3-98b6-4afc-a9c3-6a73bcf2e976 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:46.422498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bbca3-98b6-4afc-a9c3-6a73bcf2e976 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:46.429335 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6bbca3-98b6-4afc-a9c3-6a73bcf2e976 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:46.431014 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6bbca3-98b6-4afc-a9c3-6a73bcf2e976 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:46.445149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-bc6bbca3-98b6-4afc-a9c3-6a73bcf2e976 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:46.445149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:46.445149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:46.445149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:46.445149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:46.445149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:46.445149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:46.445149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:46.445149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:46.445149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:46.445149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:46.445149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:46.445149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:01:46.445149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:01:46.445149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:01:46.446343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:01:46.446343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:46.446343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:46.446343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:46.446343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:46.446343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:46.446343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:46.446343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:46.446343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:46.446343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:46.446343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:46.446343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:46.446343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:46.446343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:46.446343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:46.446343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:46.446343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:46.447484 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:01:46.447484 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:01:46.447484 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:01:46.447484 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:01:46.447484 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:01:46.447484 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:01:46.447484 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:46.447484 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:46.449607 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 341/678] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:46.450570 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6bbca3-98b6-4afc-a9c3-6a73bcf2e976 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:46.473107 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586079b5-7d6a-42db-af1a-1e2b05444d7f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:46.513859 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e22ef-51bd-4a22-8e83-db22163a3158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:46.514551 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e22ef-51bd-4a22-8e83-db22163a3158 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:46.514831 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e22ef-51bd-4a22-8e83-db22163a3158 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:46.515110 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e22ef-51bd-4a22-8e83-db22163a3158 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:46.515897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e22ef-51bd-4a22-8e83-db22163a3158 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:46.516207 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e22ef-51bd-4a22-8e83-db22163a3158 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:46.517630 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e22ef-51bd-4a22-8e83-db22163a3158 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:46.529664 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 338/679] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:01:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:46.530907 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b4082-30ca-46d0-9fbb-59dfe8d14d96 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:46.531202 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b4082-30ca-46d0-9fbb-59dfe8d14d96 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:46.531477 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b4082-30ca-46d0-9fbb-59dfe8d14d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:46.547627 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-3a0b4082-30ca-46d0-9fbb-59dfe8d14d96 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:46.548802 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3a0b4082-30ca-46d0-9fbb-59dfe8d14d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:46.554246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6bbca3-98b6-4afc-a9c3-6a73bcf2e976 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:46.600427 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caec05c-6e3d-42ab-af12-ea31cbb515df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:46.601196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caec05c-6e3d-42ab-af12-ea31cbb515df None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:46.601573 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caec05c-6e3d-42ab-af12-ea31cbb515df None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:46.601917 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caec05c-6e3d-42ab-af12-ea31cbb515df None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:46.602859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caec05c-6e3d-42ab-af12-ea31cbb515df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:46.603252 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caec05c-6e3d-42ab-af12-ea31cbb515df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:46.604738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caec05c-6e3d-42ab-af12-ea31cbb515df None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:46.616985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 342/680] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:46.617971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caec05c-6e3d-42ab-af12-ea31cbb515df None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:46.630795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 339/681] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:46.631814 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b4082-30ca-46d0-9fbb-59dfe8d14d96 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:46.720577 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caec05c-6e3d-42ab-af12-ea31cbb515df None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:46.733034 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b4082-30ca-46d0-9fbb-59dfe8d14d96 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:46.761464 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6532464-552d-4e8f-a49f-f31c6952efe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:46.762133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6532464-552d-4e8f-a49f-f31c6952efe4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:46.762447 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6532464-552d-4e8f-a49f-f31c6952efe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:46.762724 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6532464-552d-4e8f-a49f-f31c6952efe4 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:46.763513 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6532464-552d-4e8f-a49f-f31c6952efe4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:46.763822 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6532464-552d-4e8f-a49f-f31c6952efe4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:46.765249 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6532464-552d-4e8f-a49f-f31c6952efe4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:46.766992 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4b799-9664-4299-9e6d-43948d69b79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:46.767706 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4b799-9664-4299-9e6d-43948d69b79a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:46.768046 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4b799-9664-4299-9e6d-43948d69b79a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:46.768380 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4b799-9664-4299-9e6d-43948d69b79a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:46.769267 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4b799-9664-4299-9e6d-43948d69b79a None admin] RBAC: Adding query filter params (role.id=f63aad4ab4a04108b87e1bf4ea8dfa53, scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9, user.id=15ff90527ece4406be62f449bdf71d93) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:46.769640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4b799-9664-4299-9e6d-43948d69b79a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:46.771144 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4b799-9664-4299-9e6d-43948d69b79a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:46.777758 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 340/682] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:01:46 2022] GET /identity/v3/role_assignments?user.id=15ff90527ece4406be62f449bdf71d93&scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9&role.id=f63aad4ab4a04108b87e1bf4ea8dfa53 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:46.778829 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4b799-9664-4299-9e6d-43948d69b79a None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:46.782566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 343/683] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:01:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:46.783512 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6532464-552d-4e8f-a49f-f31c6952efe4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:46.905597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6532464-552d-4e8f-a49f-f31c6952efe4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:46.912870 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4b799-9664-4299-9e6d-43948d69b79a None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:46.944060 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5634e8-f687-40a8-8e1f-c49be5bb1006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:46.945240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5634e8-f687-40a8-8e1f-c49be5bb1006 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:46.945748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5634e8-f687-40a8-8e1f-c49be5bb1006 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:46.946261 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5634e8-f687-40a8-8e1f-c49be5bb1006 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:46.958242 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5634e8-f687-40a8-8e1f-c49be5bb1006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:46.960493 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee0f8d-3c2b-4f5a-a1f2-f429036e92c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:46.960972 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5634e8-f687-40a8-8e1f-c49be5bb1006 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:46.961295 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee0f8d-3c2b-4f5a-a1f2-f429036e92c5 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:46.961581 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee0f8d-3c2b-4f5a-a1f2-f429036e92c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:46.961862 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee0f8d-3c2b-4f5a-a1f2-f429036e92c5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:46.971592 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee0f8d-3c2b-4f5a-a1f2-f429036e92c5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:46.973354 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee0f8d-3c2b-4f5a-a1f2-f429036e92c5 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:46.981590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-ef5634e8-f687-40a8-8e1f-c49be5bb1006 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:46.981590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:46.981590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:46.981590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:46.981590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:46.981590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:46.981590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:46.981590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:46.981590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:46.981590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:46.981590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:46.981590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:46.981590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:46.981590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:46.981590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:46.982633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:46.982633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:46.982633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:46.982633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:46.982633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:46.982633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:46.982633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:46.982633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:46.982633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:46.982633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:46.982633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:46.982633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:46.982633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:46.982633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:46.982633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:46.982633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:46.982633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:46.983717 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:46.983717 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:46.983717 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:46.983717 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:46.985695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 344/684] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:46.986705 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5634e8-f687-40a8-8e1f-c49be5bb1006 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:46.997426 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-70ee0f8d-3c2b-4f5a-a1f2-f429036e92c5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 15:01:46.997426 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:46.997426 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:46.997426 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:46.997426 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:46.997426 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:46.997426 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:46.997426 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:46.997426 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:46.997426 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:46.997426 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:46.997426 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:46.997426 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:01:46.997426 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:01:46.997426 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:01:46.997426 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:01:46.998455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:46.998455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:46.998455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:01:46.998455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:46.998455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:01:46.998455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:46.998455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:46.998455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:46.998455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:46.998455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:46.998455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:46.998455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:46.998455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:46.998455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:46.998455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:46.998455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:46.998455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:46.998455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:46.999403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:46.999403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:46.999403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:01:46.999403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:01:46.999403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:01:46.999403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:01:46.999403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:01:46.999403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:01:46.999403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 15:01:46.999403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:46.999403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 341/685] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:01:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:46.999403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee0f8d-3c2b-4f5a-a1f2-f429036e92c5 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:47.105889 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee0f8d-3c2b-4f5a-a1f2-f429036e92c5 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:47.126655 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5634e8-f687-40a8-8e1f-c49be5bb1006 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:47.144191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ced44-0d05-44aa-8669-b30975b65b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:47.145179 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ced44-0d05-44aa-8669-b30975b65b10 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:47.145656 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ced44-0d05-44aa-8669-b30975b65b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:47.146159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ced44-0d05-44aa-8669-b30975b65b10 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:47.147101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ced44-0d05-44aa-8669-b30975b65b10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:47.147595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ced44-0d05-44aa-8669-b30975b65b10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:47.149149 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ced44-0d05-44aa-8669-b30975b65b10 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:47.161429 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 342/686] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:47.162561 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ced44-0d05-44aa-8669-b30975b65b10 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:47.167529 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab518a4a-52c5-49d8-8eca-a5cf27de4477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:47.168194 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab518a4a-52c5-49d8-8eca-a5cf27de4477 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:47.168477 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab518a4a-52c5-49d8-8eca-a5cf27de4477 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:47.168755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab518a4a-52c5-49d8-8eca-a5cf27de4477 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:47.169595 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab518a4a-52c5-49d8-8eca-a5cf27de4477 None admin] RBAC: Adding query filter params (role.id=f63aad4ab4a04108b87e1bf4ea8dfa53, scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9, user.id=496e1178104d468e9b7ce53ea754ec74) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:47.169907 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab518a4a-52c5-49d8-8eca-a5cf27de4477 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:47.178172 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab518a4a-52c5-49d8-8eca-a5cf27de4477 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:47.179980 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 345/687] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:01:46 2022] GET /identity/v3/role_assignments?user.id=496e1178104d468e9b7ce53ea754ec74&scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9&role.id=f63aad4ab4a04108b87e1bf4ea8dfa53 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:47.181478 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab518a4a-52c5-49d8-8eca-a5cf27de4477 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:47.271728 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ced44-0d05-44aa-8669-b30975b65b10 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:47.288643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab518a4a-52c5-49d8-8eca-a5cf27de4477 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:47.307514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712d1db-53e7-4e1d-a8f0-24827d927e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:47.308205 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712d1db-53e7-4e1d-a8f0-24827d927e88 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:47.308490 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712d1db-53e7-4e1d-a8f0-24827d927e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:47.308769 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712d1db-53e7-4e1d-a8f0-24827d927e88 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:47.309697 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712d1db-53e7-4e1d-a8f0-24827d927e88 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:47.310007 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712d1db-53e7-4e1d-a8f0-24827d927e88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:47.311522 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712d1db-53e7-4e1d-a8f0-24827d927e88 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:47.324877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147bc59-e959-4a10-b975-fb424940a89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:47.325562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147bc59-e959-4a10-b975-fb424940a89e None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:47.325846 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147bc59-e959-4a10-b975-fb424940a89e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:47.326138 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147bc59-e959-4a10-b975-fb424940a89e None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:47.326871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147bc59-e959-4a10-b975-fb424940a89e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:47.328343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147bc59-e959-4a10-b975-fb424940a89e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:47.331617 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 343/688] 10.222.0.76 () {56 vars in 1135 bytes} [Mon May 16 15:01:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:47.337201 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712d1db-53e7-4e1d-a8f0-24827d927e88 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:47.430695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 346/689] 10.222.0.76 () {60 vars in 1132 bytes} [Mon May 16 15:01:47 2022] POST /identity/v3/users => generated 254 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:01:47.451260 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712d1db-53e7-4e1d-a8f0-24827d927e88 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:47.487932 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040579f-df33-4f4a-b33d-3e509a518b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:47.488595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040579f-df33-4f4a-b33d-3e509a518b32 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:47.488877 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040579f-df33-4f4a-b33d-3e509a518b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:47.489155 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040579f-df33-4f4a-b33d-3e509a518b32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:47.564265 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040579f-df33-4f4a-b33d-3e509a518b32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:47.565768 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040579f-df33-4f4a-b33d-3e509a518b32 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:47.672216 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 344/690] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:01:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:01:47.677649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147bc59-e959-4a10-b975-fb424940a89e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:47.795638 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147bc59-e959-4a10-b975-fb424940a89e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:47.831692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa81842-58bd-41cb-8212-365f44be23f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:47.832491 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa81842-58bd-41cb-8212-365f44be23f5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:47.832775 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa81842-58bd-41cb-8212-365f44be23f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:47.833048 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa81842-58bd-41cb-8212-365f44be23f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:47.855228 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa81842-58bd-41cb-8212-365f44be23f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:47.856710 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa81842-58bd-41cb-8212-365f44be23f5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:47.877457 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-0fa81842-58bd-41cb-8212-365f44be23f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:47.877457 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:47.877457 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:47.877457 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:47.877457 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:47.877457 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:47.877457 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:47.877457 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:47.877457 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:47.877457 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:47.877457 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:47.877457 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:47.877457 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:47.877457 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:47.877457 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:47.878440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:47.878440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:47.878440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:47.878440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:47.878440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:47.878440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:47.878440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:47.878440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:47.878440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:47.878440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:47.878440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:47.878440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:47.878440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:47.878440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:47.878440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:47.878440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:47.878440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:47.879599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:47.879599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:47.879599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:47.879599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:47.879599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 347/691] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:47.885055 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040579f-df33-4f4a-b33d-3e509a518b32 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:48.004830 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040579f-df33-4f4a-b33d-3e509a518b32 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:48.045175 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbfa02-88b8-4b83-b102-abaf70163e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:48.045899 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbfa02-88b8-4b83-b102-abaf70163e88 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:48.046152 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbfa02-88b8-4b83-b102-abaf70163e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:48.046435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbfa02-88b8-4b83-b102-abaf70163e88 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:48.047165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbfa02-88b8-4b83-b102-abaf70163e88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:48.047471 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbfa02-88b8-4b83-b102-abaf70163e88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:48.048850 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbfa02-88b8-4b83-b102-abaf70163e88 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:48.065384 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 345/692] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:48.067203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa81842-58bd-41cb-8212-365f44be23f5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:48.235910 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa81842-58bd-41cb-8212-365f44be23f5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:48.285561 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0744a8-e83e-4819-b6a4-8c374d72888c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:48.286417 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0744a8-e83e-4819-b6a4-8c374d72888c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:48.286703 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0744a8-e83e-4819-b6a4-8c374d72888c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:48.286977 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0744a8-e83e-4819-b6a4-8c374d72888c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:48.294368 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0744a8-e83e-4819-b6a4-8c374d72888c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:48.295833 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0744a8-e83e-4819-b6a4-8c374d72888c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:48.315170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-5b0744a8-e83e-4819-b6a4-8c374d72888c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:48.315170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:48.315170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:48.315170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:48.315170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:48.315170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:48.315170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:48.315170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:48.315170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:48.315170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:48.315170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:48.315170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:48.315170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:01:48.315170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:01:48.315170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:01:48.316081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:01:48.316081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:48.316081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:48.316081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:48.316081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:48.316081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:48.316081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:48.316081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:48.316081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:48.316081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:48.316081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:48.316081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:48.316081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:48.316081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:48.316081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:48.316081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:48.316081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:48.316986 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:01:48.316986 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:01:48.316986 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:01:48.316986 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:01:48.316986 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:01:48.316986 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:01:48.316986 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:48.316986 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:48.320556 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 348/693] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:48.322346 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbfa02-88b8-4b83-b102-abaf70163e88 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:48.425739 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbde85-bba3-42ac-9440-1f68f8002bd8 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:48.426091 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbde85-bba3-42ac-9440-1f68f8002bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:48.426316 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbde85-bba3-42ac-9440-1f68f8002bd8 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:48.427684 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 349/694] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:48.430229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbfa02-88b8-4b83-b102-abaf70163e88 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:48.433321 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976c075-7830-4993-9bcd-91e9b8fa28cb None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:48.433603 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976c075-7830-4993-9bcd-91e9b8fa28cb None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:48.433875 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976c075-7830-4993-9bcd-91e9b8fa28cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:48.464214 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e976c075-7830-4993-9bcd-91e9b8fa28cb None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:48.465854 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e976c075-7830-4993-9bcd-91e9b8fa28cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:48.470497 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c42a9-e26f-43b9-aae3-11b2c44c36bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:48.471173 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c42a9-e26f-43b9-aae3-11b2c44c36bd None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:48.471457 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c42a9-e26f-43b9-aae3-11b2c44c36bd None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:48.471736 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c42a9-e26f-43b9-aae3-11b2c44c36bd None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:48.472621 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c42a9-e26f-43b9-aae3-11b2c44c36bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:48.472933 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c42a9-e26f-43b9-aae3-11b2c44c36bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:48.474407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c42a9-e26f-43b9-aae3-11b2c44c36bd None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:48.492479 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 346/695] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:01:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:48.499301 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c42a9-e26f-43b9-aae3-11b2c44c36bd None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:48.606208 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 350/696] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:48.636480 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976c075-7830-4993-9bcd-91e9b8fa28cb None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:48.665730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c42a9-e26f-43b9-aae3-11b2c44c36bd None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:48.732848 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2718be-e207-401b-be04-d1cec0b1bf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:48.733505 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2718be-e207-401b-be04-d1cec0b1bf82 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:48.733786 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2718be-e207-401b-be04-d1cec0b1bf82 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:48.734065 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2718be-e207-401b-be04-d1cec0b1bf82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:48.734933 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2718be-e207-401b-be04-d1cec0b1bf82 None admin] RBAC: Adding query filter params (role.id=f63aad4ab4a04108b87e1bf4ea8dfa53, scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9, user.id=33470e30760842ca9e96bb7f0cf9f07d) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:48.735246 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2718be-e207-401b-be04-d1cec0b1bf82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:48.736682 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2718be-e207-401b-be04-d1cec0b1bf82 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:48.746077 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 347/697] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:01:48 2022] GET /identity/v3/role_assignments?user.id=33470e30760842ca9e96bb7f0cf9f07d&scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9&role.id=f63aad4ab4a04108b87e1bf4ea8dfa53 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:48.819655 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976c075-7830-4993-9bcd-91e9b8fa28cb None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:48.871842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96ad11-2edf-4552-bcdf-34fc462139d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:48.872665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96ad11-2edf-4552-bcdf-34fc462139d3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:48.872945 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96ad11-2edf-4552-bcdf-34fc462139d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:48.873219 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96ad11-2edf-4552-bcdf-34fc462139d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:48.890055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96ad11-2edf-4552-bcdf-34fc462139d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:48.901842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-0f96ad11-2edf-4552-bcdf-34fc462139d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:01:48.901842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:48.901842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:48.901842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:48.901842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:48.901842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:48.901842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:48.901842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:48.901842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:48.901842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:48.901842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:48.901842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:48.901842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:48.901842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:48.901842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:48.901842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:48.904124 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:48.904124 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:48.904124 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:48.904124 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:48.904124 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:48.904124 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:48.904124 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:48.904124 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:48.904124 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:48.904124 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:48.904124 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:48.904124 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:48.904124 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:48.904124 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:48.904124 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:48.904124 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:48.906184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:48.906184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:48.906184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:48.906184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:48.906184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:48.906184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:48.906184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:48.906184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:48.906184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:48.906184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:48.906184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:01:48.906184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:48.906184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 351/698] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:01:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:48.914190 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2718be-e207-401b-be04-d1cec0b1bf82 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:49.031437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2718be-e207-401b-be04-d1cec0b1bf82 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:49.069834 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b97ae-40cf-44cf-ab53-353f0c2b5de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:49.070538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b97ae-40cf-44cf-ab53-353f0c2b5de6 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:49.070821 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b97ae-40cf-44cf-ab53-353f0c2b5de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:49.071095 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b97ae-40cf-44cf-ab53-353f0c2b5de6 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:49.072391 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b97ae-40cf-44cf-ab53-353f0c2b5de6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:49.072696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b97ae-40cf-44cf-ab53-353f0c2b5de6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:49.074067 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b97ae-40cf-44cf-ab53-353f0c2b5de6 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:49.082865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 348/699] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:01:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:49.091295 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96ad11-2edf-4552-bcdf-34fc462139d3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:49.192251 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96ad11-2edf-4552-bcdf-34fc462139d3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:49.225883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580fba2-ffb9-4e05-9254-29cdbfa1b523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:49.226709 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580fba2-ffb9-4e05-9254-29cdbfa1b523 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:49.226994 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580fba2-ffb9-4e05-9254-29cdbfa1b523 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:49.227273 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580fba2-ffb9-4e05-9254-29cdbfa1b523 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:49.238203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5580fba2-ffb9-4e05-9254-29cdbfa1b523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:49.239660 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5580fba2-ffb9-4e05-9254-29cdbfa1b523 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:49.257504 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-5580fba2-ffb9-4e05-9254-29cdbfa1b523 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:49.257504 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:49.257504 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:49.257504 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:49.257504 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:49.257504 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:49.257504 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:49.257504 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:49.257504 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:49.257504 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:49.257504 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:49.257504 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:49.257504 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:49.257504 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:49.257504 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:49.260143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:49.260143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:49.260143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:49.260143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:49.260143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:49.260143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:49.260143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:49.260143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:49.260143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:49.260143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:49.260143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:49.260143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:49.260143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:49.260143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:49.260143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:49.260143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:49.260143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:49.262217 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:49.262217 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:49.262217 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:49.262217 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:49.262217 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 352/700] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:49.270144 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b97ae-40cf-44cf-ab53-353f0c2b5de6 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:49.368760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b97ae-40cf-44cf-ab53-353f0c2b5de6 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:49.403316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046ec3f-df2c-4de7-8aba-1807f1284a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:49.403988 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046ec3f-df2c-4de7-8aba-1807f1284a46 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:49.404271 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046ec3f-df2c-4de7-8aba-1807f1284a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:49.404544 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046ec3f-df2c-4de7-8aba-1807f1284a46 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:49.405269 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046ec3f-df2c-4de7-8aba-1807f1284a46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:49.405574 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046ec3f-df2c-4de7-8aba-1807f1284a46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:49.406986 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046ec3f-df2c-4de7-8aba-1807f1284a46 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:49.420122 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 349/701] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:49.425180 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580fba2-ffb9-4e05-9254-29cdbfa1b523 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:49.532535 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580fba2-ffb9-4e05-9254-29cdbfa1b523 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:49.542105 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f61d0-c171-40f1-8d9e-67b2b0e7ab93 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:49.542437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f61d0-c171-40f1-8d9e-67b2b0e7ab93 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:49.542747 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f61d0-c171-40f1-8d9e-67b2b0e7ab93 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:49.544377 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 350/702] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:01:49.551462 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95796e1e-bff9-4421-af9d-33c05d7c7392 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:49.551757 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95796e1e-bff9-4421-af9d-33c05d7c7392 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:49.552037 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95796e1e-bff9-4421-af9d-33c05d7c7392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:49.568746 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a46aa0-451d-4969-893c-73538be567ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:49.570013 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a46aa0-451d-4969-893c-73538be567ce None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:49.570339 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a46aa0-451d-4969-893c-73538be567ce None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:49.570621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a46aa0-451d-4969-893c-73538be567ce None admin] PATH_INFO: `/v3/users/nova` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:49.579866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a46aa0-451d-4969-893c-73538be567ce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:49.581344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a46aa0-451d-4969-893c-73538be567ce None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:49.586112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-95796e1e-bff9-4421-af9d-33c05d7c7392 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:49.587963 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-95796e1e-bff9-4421-af9d-33c05d7c7392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:49.596789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-84a46aa0-451d-4969-893c-73538be567ce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 15:01:49.596789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:49.596789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:49.596789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:49.596789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:49.596789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:49.596789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:49.596789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:49.596789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:49.596789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:49.596789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:49.596789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:49.596789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:01:49.596789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:01:49.596789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:01:49.596789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:01:49.598966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:49.598966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:49.598966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:01:49.598966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:49.598966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:01:49.598966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:49.598966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:49.598966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:49.598966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:49.598966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:49.598966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:49.598966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:49.598966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:49.598966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:49.598966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:49.598966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:49.598966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:49.598966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:49.601133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:49.601133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:49.601133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:01:49.601133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:01:49.601133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:01:49.601133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:01:49.601133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:01:49.601133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:01:49.601133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 15:01:49.601133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:49.601133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 353/703] 10.222.0.76 () {56 vars in 1093 bytes} [Mon May 16 15:01:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:49.607876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a46aa0-451d-4969-893c-73538be567ce None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:49.721276 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a46aa0-451d-4969-893c-73538be567ce None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:49.761548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1bbec-1399-40a0-82c8-4e6bba14df80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:49.762267 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1bbec-1399-40a0-82c8-4e6bba14df80 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:49.762998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1bbec-1399-40a0-82c8-4e6bba14df80 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:49.763285 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1bbec-1399-40a0-82c8-4e6bba14df80 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:49.764133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1bbec-1399-40a0-82c8-4e6bba14df80 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:49.764445 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1bbec-1399-40a0-82c8-4e6bba14df80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:49.765953 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1bbec-1399-40a0-82c8-4e6bba14df80 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:49.786321 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 354/704] 10.222.0.76 () {56 vars in 1133 bytes} [Mon May 16 15:01:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:49.791415 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1bbec-1399-40a0-82c8-4e6bba14df80 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:49.807825 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 351/705] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:01:49.842262 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95796e1e-bff9-4421-af9d-33c05d7c7392 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:49.902078 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1bbec-1399-40a0-82c8-4e6bba14df80 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:49.942197 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f020943-0e07-4802-a9c2-cde6407ef695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:49.942860 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f020943-0e07-4802-a9c2-cde6407ef695 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:49.943144 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f020943-0e07-4802-a9c2-cde6407ef695 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:49.943424 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f020943-0e07-4802-a9c2-cde6407ef695 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:50.025890 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f020943-0e07-4802-a9c2-cde6407ef695 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:50.027924 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f020943-0e07-4802-a9c2-cde6407ef695 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:50.108970 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95796e1e-bff9-4421-af9d-33c05d7c7392 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:50.144963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 355/706] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:01:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 15:01:50.145731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36e39c-0e0b-419d-932d-6414984e2de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:50.146437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c91686-34ca-4c30-abcb-2d4dac064944 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:50.146727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c91686-34ca-4c30-abcb-2d4dac064944 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:50.147005 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c91686-34ca-4c30-abcb-2d4dac064944 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:50.147480 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36e39c-0e0b-419d-932d-6414984e2de1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:50.148028 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36e39c-0e0b-419d-932d-6414984e2de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:50.152310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 356/707] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:50.152310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c91686-34ca-4c30-abcb-2d4dac064944 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:50.152490 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36e39c-0e0b-419d-932d-6414984e2de1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:50.152490 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36e39c-0e0b-419d-932d-6414984e2de1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:50.152490 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36e39c-0e0b-419d-932d-6414984e2de1 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:50.167754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-6a36e39c-0e0b-419d-932d-6414984e2de1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 15:01:50.167754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:50.167754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 15:01:50.167754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 15:01:50.167754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 15:01:50.167754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 15:01:50.167754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 15:01:50.167754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:01:50.167754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 15:01:50.167754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:50.167754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:01:50.167754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:50.167754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:50.167754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:50.167754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:50.167754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:50.167754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:50.169074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:50.169074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:50.169074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:50.169074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:50.169074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:50.169074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:50.169074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 15:01:50.169074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 15:01:50.169074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 15:01:50.169074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 15:01:50.169074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:50.169074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:50.169074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:50.169074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:50.169074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:50.169074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:50.170112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:50.170112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:50.170112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:50.170112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:50.170112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:50.170112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:50.170112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:50.170112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:50.170112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:50.170112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:50.170112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 15:01:50.170112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:01:50.170112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 15:01:50.170112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:50.172350 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 352/708] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:49 2022] GET /identity/v3/services/network => generated 88 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:01:50.173677 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf6655-6464-4c1a-9914-518652bc5640 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:50.173959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf6655-6464-4c1a-9914-518652bc5640 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:50.174256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf6655-6464-4c1a-9914-518652bc5640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:50.190948 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d9bf6655-6464-4c1a-9914-518652bc5640 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:50.192116 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d9bf6655-6464-4c1a-9914-518652bc5640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:50.258434 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 353/709] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:50.260824 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c91686-34ca-4c30-abcb-2d4dac064944 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:50.263723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f3162-2135-436e-b935-f51722c3fc88 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:50.264015 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f3162-2135-436e-b935-f51722c3fc88 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:50.264294 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f3162-2135-436e-b935-f51722c3fc88 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:50.265791 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 354/710] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:50.270454 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f3162-2135-436e-b935-f51722c3fc88 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:50.301142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bcf1d-4de5-4338-9d43-f60a9ece4aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:50.302354 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bcf1d-4de5-4338-9d43-f60a9ece4aae None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:50.302881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bcf1d-4de5-4338-9d43-f60a9ece4aae None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:50.303361 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bcf1d-4de5-4338-9d43-f60a9ece4aae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:50.315887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bcf1d-4de5-4338-9d43-f60a9ece4aae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:50.318194 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bcf1d-4de5-4338-9d43-f60a9ece4aae None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:50.338579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-bb1bcf1d-4de5-4338-9d43-f60a9ece4aae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:50.338579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:50.338579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:50.338579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:50.338579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:50.338579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:50.338579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:50.338579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:50.338579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:50.338579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:50.338579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:50.338579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:50.338579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:50.338579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:50.338579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:50.339691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:50.339691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:50.339691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:50.339691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:50.339691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:50.339691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:50.339691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:50.339691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:50.339691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:50.339691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:50.339691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:50.339691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:50.339691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:50.339691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:50.339691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:50.339691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:50.339691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:50.340901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:50.340901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:50.340901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:50.340901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:50.342851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 357/711] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:01:50.344308 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9aa0c6-5609-468f-b5a0-39b6b131dd10 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:50.344750 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9aa0c6-5609-468f-b5a0-39b6b131dd10 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:50.345157 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9aa0c6-5609-468f-b5a0-39b6b131dd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:50.363297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-2a9aa0c6-5609-468f-b5a0-39b6b131dd10 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:50.364489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2a9aa0c6-5609-468f-b5a0-39b6b131dd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:50.370914 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f3162-2135-436e-b935-f51722c3fc88 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:50.405400 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdf10a-5bdf-4a66-85c3-e61328c50642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:50.406070 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdf10a-5bdf-4a66-85c3-e61328c50642 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:50.406382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdf10a-5bdf-4a66-85c3-e61328c50642 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:50.406659 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdf10a-5bdf-4a66-85c3-e61328c50642 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:50.407366 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdf10a-5bdf-4a66-85c3-e61328c50642 None admin] RBAC: Adding query filter params (name=network) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:50.407675 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdf10a-5bdf-4a66-85c3-e61328c50642 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:50.409059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdf10a-5bdf-4a66-85c3-e61328c50642 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:50.413735 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 355/712] 10.222.0.76 () {56 vars in 1112 bytes} [Mon May 16 15:01:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:50.414548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdf10a-5bdf-4a66-85c3-e61328c50642 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:50.450204 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 358/713] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:50.450204 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9aa0c6-5609-468f-b5a0-39b6b131dd10 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:50.513412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdf10a-5bdf-4a66-85c3-e61328c50642 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:50.546981 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3e98a-4b73-4af3-b93f-b5c2ffe85eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:50.547785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3e98a-4b73-4af3-b93f-b5c2ffe85eab None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:50.548069 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3e98a-4b73-4af3-b93f-b5c2ffe85eab None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:50.548346 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3e98a-4b73-4af3-b93f-b5c2ffe85eab None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:50.548998 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3e98a-4b73-4af3-b93f-b5c2ffe85eab None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:50.550473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3e98a-4b73-4af3-b93f-b5c2ffe85eab None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:50.554939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9aa0c6-5609-468f-b5a0-39b6b131dd10 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:50.565356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-e5b3e98a-4b73-4af3-b93f-b5c2ffe85eab None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 15:01:50.565356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:50.565356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 15:01:50.565356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 15:01:50.565356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 15:01:50.565356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 15:01:50.565356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 15:01:50.565356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:01:50.565356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 15:01:50.565356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:50.565356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:01:50.565356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:50.565356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:50.565356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:50.565356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:50.565356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:50.566723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:50.566723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:50.566723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:50.566723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:50.566723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:50.566723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:50.566723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:50.566723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 15:01:50.566723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 15:01:50.566723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 15:01:50.566723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 15:01:50.566723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:50.566723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:50.566723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:50.566723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:50.566723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:50.567756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:50.567756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:50.567756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:50.567756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:50.567756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:50.567756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:50.567756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:50.567756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:50.567756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:50.567756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:50.567756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:50.567756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 15:01:50.567756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:01:50.567756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 15:01:50.567756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:50.567756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 356/714] 10.222.0.76 () {56 vars in 1129 bytes} [Mon May 16 15:01:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:50.568701 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3e98a-4b73-4af3-b93f-b5c2ffe85eab None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:50.598112 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029ab43-1f0b-4521-bd40-ceafd70c81ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:50.598919 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029ab43-1f0b-4521-bd40-ceafd70c81ae None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:50.599274 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029ab43-1f0b-4521-bd40-ceafd70c81ae None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:50.599657 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029ab43-1f0b-4521-bd40-ceafd70c81ae None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:50.600453 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029ab43-1f0b-4521-bd40-ceafd70c81ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:50.600835 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029ab43-1f0b-4521-bd40-ceafd70c81ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:50.602328 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029ab43-1f0b-4521-bd40-ceafd70c81ae None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:50.619703 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 359/715] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:50.619703 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029ab43-1f0b-4521-bd40-ceafd70c81ae None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:50.673637 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3e98a-4b73-4af3-b93f-b5c2ffe85eab None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:50.705569 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ee5fb-665f-477c-9743-d5b51470820f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:50.706261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ee5fb-665f-477c-9743-d5b51470820f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:50.706541 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ee5fb-665f-477c-9743-d5b51470820f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:50.706814 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ee5fb-665f-477c-9743-d5b51470820f None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:50.707525 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ee5fb-665f-477c-9743-d5b51470820f None admin] RBAC: Adding query filter params (type=network) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:50.707828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ee5fb-665f-477c-9743-d5b51470820f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:50.709191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ee5fb-665f-477c-9743-d5b51470820f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:50.726376 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 357/716] 10.222.0.76 () {56 vars in 1112 bytes} [Mon May 16 15:01:50 2022] GET /identity/v3/services?type=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:50.726376 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ee5fb-665f-477c-9743-d5b51470820f None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:50.743930 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029ab43-1f0b-4521-bd40-ceafd70c81ae None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:50.792798 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad78d3d-2ae3-4768-9c7b-a9ae36ab941c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:50.794350 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad78d3d-2ae3-4768-9c7b-a9ae36ab941c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:50.794862 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad78d3d-2ae3-4768-9c7b-a9ae36ab941c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:50.795363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad78d3d-2ae3-4768-9c7b-a9ae36ab941c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:50.811010 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad78d3d-2ae3-4768-9c7b-a9ae36ab941c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:50.822584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-8ad78d3d-2ae3-4768-9c7b-a9ae36ab941c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:50.822584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:50.822584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:50.822584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:50.822584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:50.822584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:50.822584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:50.822584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:50.822584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:50.822584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:50.822584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:50.822584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:50.822584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:50.822584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:50.822584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:50.822584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:50.823627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:50.823627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:50.823627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:50.823627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:50.823627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:50.823627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:50.823627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:50.823627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:50.823627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:50.823627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:50.823627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:50.823627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:50.823627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:50.823627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:50.823627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:50.823627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:50.824453 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:50.824453 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:50.824453 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:50.824453 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:50.824453 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:50.824453 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:50.824453 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:50.824453 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:50.824453 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:50.824453 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:50.824453 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:50.824453 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:50.832084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 360/717] 10.222.0.76 () {56 vars in 1102 bytes} [Mon May 16 15:01:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:50.832712 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad78d3d-2ae3-4768-9c7b-a9ae36ab941c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:50.854912 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ee5fb-665f-477c-9743-d5b51470820f None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:50.903929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f812b1e-5e48-4fb0-8593-fec87cedd2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:50.904584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f812b1e-5e48-4fb0-8593-fec87cedd2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:50.904865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f812b1e-5e48-4fb0-8593-fec87cedd2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:50.905135 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f812b1e-5e48-4fb0-8593-fec87cedd2e4 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:50.905848 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f812b1e-5e48-4fb0-8593-fec87cedd2e4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:50.906180 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f812b1e-5e48-4fb0-8593-fec87cedd2e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:50.907598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f812b1e-5e48-4fb0-8593-fec87cedd2e4 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:50.912386 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 358/718] 10.222.0.76 () {56 vars in 1124 bytes} [Mon May 16 15:01:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:50.913330 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f812b1e-5e48-4fb0-8593-fec87cedd2e4 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:50.969434 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad78d3d-2ae3-4768-9c7b-a9ae36ab941c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:51.003557 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a107b16-5385-4549-9c6c-8667b0d3e60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:51.004341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a107b16-5385-4549-9c6c-8667b0d3e60e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:51.004618 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a107b16-5385-4549-9c6c-8667b0d3e60e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:51.004888 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a107b16-5385-4549-9c6c-8667b0d3e60e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:51.012182 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a107b16-5385-4549-9c6c-8667b0d3e60e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:51.013627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a107b16-5385-4549-9c6c-8667b0d3e60e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:51.027738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-7a107b16-5385-4549-9c6c-8667b0d3e60e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:51.027738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:51.027738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:51.027738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:51.027738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:51.027738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:51.027738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:51.027738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:51.027738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:51.027738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:51.027738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:51.027738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:51.027738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:01:51.027738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:01:51.027738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:01:51.028648 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:01:51.028648 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:51.028648 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:51.028648 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:51.028648 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:51.028648 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:51.028648 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:51.028648 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:51.028648 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:51.028648 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:51.028648 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:51.028648 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:51.028648 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:51.028648 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:51.028648 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:51.028648 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:51.028648 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:51.029523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:01:51.029523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:01:51.029523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:01:51.029523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:01:51.029523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:01:51.029523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:01:51.029523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:51.029523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:51.031892 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f812b1e-5e48-4fb0-8593-fec87cedd2e4 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:51.033707 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 361/719] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:51.035189 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a107b16-5385-4549-9c6c-8667b0d3e60e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:51.073760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abe733-42fa-495d-bb0b-7f68ff19740b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:51.074714 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abe733-42fa-495d-bb0b-7f68ff19740b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:51.075570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abe733-42fa-495d-bb0b-7f68ff19740b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:51.075993 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abe733-42fa-495d-bb0b-7f68ff19740b None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:51.076908 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abe733-42fa-495d-bb0b-7f68ff19740b None admin] RBAC: Adding query filter params (name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:51.077686 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abe733-42fa-495d-bb0b-7f68ff19740b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:51.079866 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abe733-42fa-495d-bb0b-7f68ff19740b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:51.094923 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 359/720] 10.222.0.76 () {56 vars in 1103 bytes} [Mon May 16 15:01:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:51.096653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abe733-42fa-495d-bb0b-7f68ff19740b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:51.156995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a107b16-5385-4549-9c6c-8667b0d3e60e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:51.200343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105183e5-4d94-4097-8790-b0ee96be07f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:51.201692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105183e5-4d94-4097-8790-b0ee96be07f0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:51.202119 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105183e5-4d94-4097-8790-b0ee96be07f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:51.202793 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105183e5-4d94-4097-8790-b0ee96be07f0 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:51.203827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105183e5-4d94-4097-8790-b0ee96be07f0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:51.204275 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105183e5-4d94-4097-8790-b0ee96be07f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:51.206319 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105183e5-4d94-4097-8790-b0ee96be07f0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:51.207338 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abe733-42fa-495d-bb0b-7f68ff19740b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:51.214076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 362/721] 10.222.0.76 () {56 vars in 1124 bytes} [Mon May 16 15:01:51 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:51.215214 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105183e5-4d94-4097-8790-b0ee96be07f0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:51.251048 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5b221-7aad-46bc-8394-a64205d8025a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:51.252163 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5b221-7aad-46bc-8394-a64205d8025a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:51.252589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5b221-7aad-46bc-8394-a64205d8025a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:51.254092 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5b221-7aad-46bc-8394-a64205d8025a None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:51.255087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5b221-7aad-46bc-8394-a64205d8025a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:51.255536 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5b221-7aad-46bc-8394-a64205d8025a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:51.257147 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5b221-7aad-46bc-8394-a64205d8025a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:51.275096 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 360/722] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:01:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:51.282219 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5b221-7aad-46bc-8394-a64205d8025a None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:51.388445 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105183e5-4d94-4097-8790-b0ee96be07f0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:51.423092 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5b221-7aad-46bc-8394-a64205d8025a None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:51.465875 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6e144-81b2-4e57-880b-8a5f1ef9ee0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:51.466573 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6e144-81b2-4e57-880b-8a5f1ef9ee0b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:51.466850 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6e144-81b2-4e57-880b-8a5f1ef9ee0b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:51.467120 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6e144-81b2-4e57-880b-8a5f1ef9ee0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:51.467952 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6e144-81b2-4e57-880b-8a5f1ef9ee0b None admin] RBAC: Adding query filter params (role.id=f6c8fc0dc0f24de3907b0960a1201901, scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9, user.id=9d85024f010c40129d79543b3ec4cfae) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:51.468263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6e144-81b2-4e57-880b-8a5f1ef9ee0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:51.469678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6e144-81b2-4e57-880b-8a5f1ef9ee0b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:51.475929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 361/723] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:01:51 2022] GET /identity/v3/role_assignments?user.id=9d85024f010c40129d79543b3ec4cfae&scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9&role.id=f6c8fc0dc0f24de3907b0960a1201901 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:51.484634 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78328eec-4c66-4833-8828-bc36b4705389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:51.485557 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78328eec-4c66-4833-8828-bc36b4705389 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:51.486026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78328eec-4c66-4833-8828-bc36b4705389 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:51.486430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78328eec-4c66-4833-8828-bc36b4705389 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:51.500158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78328eec-4c66-4833-8828-bc36b4705389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:51.501846 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78328eec-4c66-4833-8828-bc36b4705389 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:51.522076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-78328eec-4c66-4833-8828-bc36b4705389 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:51.522076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:51.522076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:51.522076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:51.522076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:51.522076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:51.522076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:51.522076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:51.522076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:51.522076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:51.522076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:51.522076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:51.522076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:51.522076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:51.522076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:51.523079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:51.523079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:51.523079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:51.523079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:51.523079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:51.523079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:51.523079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:51.523079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:51.523079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:51.523079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:51.523079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:51.523079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:51.523079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:51.523079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:51.523079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:51.523079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:51.523079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:51.523995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:51.523995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:51.523995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:51.523995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:51.528292 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 363/724] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:51.529695 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6e144-81b2-4e57-880b-8a5f1ef9ee0b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:51.640312 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6e144-81b2-4e57-880b-8a5f1ef9ee0b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:51.680266 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5888b9d-4dd9-4ca2-8453-2d7aac31ac43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:51.680895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5888b9d-4dd9-4ca2-8453-2d7aac31ac43 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:51.681177 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5888b9d-4dd9-4ca2-8453-2d7aac31ac43 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:51.681452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5888b9d-4dd9-4ca2-8453-2d7aac31ac43 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:51.682275 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5888b9d-4dd9-4ca2-8453-2d7aac31ac43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:51.682580 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5888b9d-4dd9-4ca2-8453-2d7aac31ac43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:51.684067 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5888b9d-4dd9-4ca2-8453-2d7aac31ac43 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:51.701472 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 362/725] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:51.702895 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78328eec-4c66-4833-8828-bc36b4705389 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:51.813841 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78328eec-4c66-4833-8828-bc36b4705389 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:51.856365 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e077c-2564-4701-89df-99222a77b58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:51.857182 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e077c-2564-4701-89df-99222a77b58a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:51.857463 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e077c-2564-4701-89df-99222a77b58a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:51.857736 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e077c-2564-4701-89df-99222a77b58a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:51.865473 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e077c-2564-4701-89df-99222a77b58a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:51.866944 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e077c-2564-4701-89df-99222a77b58a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:51.887873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-fb9e077c-2564-4701-89df-99222a77b58a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 15:01:51.887873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:51.887873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:51.887873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:51.887873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:51.887873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:51.887873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:51.887873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:51.887873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:51.887873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:51.887873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:51.887873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:51.887873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:01:51.887873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:01:51.887873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:01:51.887873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:01:51.888887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:51.888887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:51.888887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:01:51.888887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:51.888887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:01:51.888887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:51.888887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:51.888887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:51.888887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:51.888887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:51.888887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:51.888887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:51.888887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:51.888887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:51.888887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:51.888887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:51.888887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:51.888887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:51.889882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:51.889882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:51.889882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:01:51.889882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:01:51.889882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:01:51.889882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:01:51.889882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:01:51.889882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:01:51.889882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 15:01:51.889882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:51.891784 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32ce2c-a8ce-4ae6-8ab5-397d3938aa0d None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:51.892073 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32ce2c-a8ce-4ae6-8ab5-397d3938aa0d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:51.892354 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32ce2c-a8ce-4ae6-8ab5-397d3938aa0d None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:51.893542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 364/726] 10.222.0.76 () {56 vars in 1117 bytes} [Mon May 16 15:01:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:51.894150 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 363/727] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:51.894869 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e077c-2564-4701-89df-99222a77b58a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:51.906517 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53415c15-7c01-4d73-93b4-cb000ca95ffb None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:51.906806 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53415c15-7c01-4d73-93b4-cb000ca95ffb None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:51.907082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53415c15-7c01-4d73-93b4-cb000ca95ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:51.954377 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-53415c15-7c01-4d73-93b4-cb000ca95ffb None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:51.955584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-53415c15-7c01-4d73-93b4-cb000ca95ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:52.007941 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e077c-2564-4701-89df-99222a77b58a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:52.048222 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ef97a-b135-4946-8e7c-822e4e0c093c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:52.049229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ef97a-b135-4946-8e7c-822e4e0c093c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:52.049676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ef97a-b135-4946-8e7c-822e4e0c093c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:52.050114 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ef97a-b135-4946-8e7c-822e4e0c093c None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:52.051153 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ef97a-b135-4946-8e7c-822e4e0c093c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:52.051652 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ef97a-b135-4946-8e7c-822e4e0c093c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:52.053272 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ef97a-b135-4946-8e7c-822e4e0c093c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:52.078115 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 365/728] 10.222.0.76 () {56 vars in 1149 bytes} [Mon May 16 15:01:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:52.079762 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ef97a-b135-4946-8e7c-822e4e0c093c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:52.132718 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 364/729] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 15:01:52.167598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53415c15-7c01-4d73-93b4-cb000ca95ffb None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:52.197176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ef97a-b135-4946-8e7c-822e4e0c093c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:52.246940 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59bbf3-640a-47ab-a71f-2accd53511c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:52.247531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59bbf3-640a-47ab-a71f-2accd53511c0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:52.247818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59bbf3-640a-47ab-a71f-2accd53511c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:52.248109 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59bbf3-640a-47ab-a71f-2accd53511c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:52.329696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53415c15-7c01-4d73-93b4-cb000ca95ffb None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:52.344080 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59bbf3-640a-47ab-a71f-2accd53511c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:52.345564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59bbf3-640a-47ab-a71f-2accd53511c0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:52.414151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985d0f8-181f-43f3-86ec-c2bb56059e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:52.415206 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985d0f8-181f-43f3-86ec-c2bb56059e2e None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:52.418638 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985d0f8-181f-43f3-86ec-c2bb56059e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:52.418638 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985d0f8-181f-43f3-86ec-c2bb56059e2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:52.438735 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985d0f8-181f-43f3-86ec-c2bb56059e2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:52.451016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-3985d0f8-181f-43f3-86ec-c2bb56059e2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:01:52.451016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:52.451016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:52.451016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:52.451016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:52.451016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:52.451016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:52.451016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:52.451016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:52.451016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:52.451016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:52.451016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:52.451016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:52.451016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:52.451016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:52.451016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:52.457297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:52.457297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:52.457297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:52.457297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:52.457297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:52.457297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:52.457297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:52.457297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:52.457297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:52.457297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:52.457297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:52.457297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:52.457297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:52.457297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:52.457297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:52.457297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:52.458176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:52.458176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:52.458176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:52.458176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:52.458176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:52.458176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:52.458176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:52.458176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:52.458176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:52.458176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:52.458176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:01:52.458176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:52.458176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 365/730] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:01:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:01:52.464018 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985d0f8-181f-43f3-86ec-c2bb56059e2e None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:52.479102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 366/731] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:01:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:01:52.484637 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59bbf3-640a-47ab-a71f-2accd53511c0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:52.604017 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985d0f8-181f-43f3-86ec-c2bb56059e2e None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:52.613151 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59bbf3-640a-47ab-a71f-2accd53511c0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:52.638724 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e817e-a2c2-4a16-a2c2-35c88d694127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:52.639452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e817e-a2c2-4a16-a2c2-35c88d694127 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:52.639737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e817e-a2c2-4a16-a2c2-35c88d694127 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:52.640050 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e817e-a2c2-4a16-a2c2-35c88d694127 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:52.640801 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e817e-a2c2-4a16-a2c2-35c88d694127 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:52.641146 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e817e-a2c2-4a16-a2c2-35c88d694127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:52.642582 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e817e-a2c2-4a16-a2c2-35c88d694127 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:52.651830 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 366/732] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:01:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:52.657668 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e817e-a2c2-4a16-a2c2-35c88d694127 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:52.693389 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d3dcf-0c8c-41bd-b4d4-eb8204f19fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:52.696753 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d3dcf-0c8c-41bd-b4d4-eb8204f19fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:52.697040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d3dcf-0c8c-41bd-b4d4-eb8204f19fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:52.697312 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d3dcf-0c8c-41bd-b4d4-eb8204f19fd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:52.719446 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d3dcf-0c8c-41bd-b4d4-eb8204f19fd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:52.722101 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d3dcf-0c8c-41bd-b4d4-eb8204f19fd8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:52.761606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-358d3dcf-0c8c-41bd-b4d4-eb8204f19fd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:52.761606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:52.761606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:52.761606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:52.761606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:52.761606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:52.761606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:52.761606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:52.761606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:52.761606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:52.761606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:52.761606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:52.761606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:52.761606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:52.761606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:52.762589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:52.762589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:52.762589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:52.762589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:52.762589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:52.762589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:52.762589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:52.762589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:52.762589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:52.762589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:52.762589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:52.762589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:52.762589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:52.762589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:52.762589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:52.762589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:52.762589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:52.763502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:52.763502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:52.763502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:52.763502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:52.767374 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 367/733] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:01:52.768219 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d3dcf-0c8c-41bd-b4d4-eb8204f19fd8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:52.867868 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e817e-a2c2-4a16-a2c2-35c88d694127 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:52.910338 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e2f3c-94a1-47b0-866d-67586a708cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:52.911496 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e2f3c-94a1-47b0-866d-67586a708cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:52.911783 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e2f3c-94a1-47b0-866d-67586a708cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:52.912323 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e2f3c-94a1-47b0-866d-67586a708cb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:52.924781 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e2f3c-94a1-47b0-866d-67586a708cb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:52.926289 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e2f3c-94a1-47b0-866d-67586a708cb5 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:52.946483 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-850e2f3c-94a1-47b0-866d-67586a708cb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:52.946483 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:52.946483 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:52.946483 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:52.946483 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:52.946483 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:52.946483 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:52.946483 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:52.946483 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:52.946483 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:52.946483 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:52.946483 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:52.946483 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:52.946483 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:52.946483 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:52.948576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:52.948576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:52.948576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:52.948576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:52.948576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:52.948576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:52.948576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:52.948576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:52.948576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:52.948576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:52.948576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:52.948576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:52.948576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:52.948576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:52.948576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:52.948576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:52.948576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:52.950407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:52.950407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:52.950407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:52.950407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:52.950407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 367/734] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:52.959302 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e2f3c-94a1-47b0-866d-67586a708cb5 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:53.001823 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d3dcf-0c8c-41bd-b4d4-eb8204f19fd8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:53.066108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bde617-040c-4872-94b0-2cb5e70ba35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:53.066900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bde617-040c-4872-94b0-2cb5e70ba35f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:53.067083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bde617-040c-4872-94b0-2cb5e70ba35f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:53.067363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bde617-040c-4872-94b0-2cb5e70ba35f None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:53.068100 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bde617-040c-4872-94b0-2cb5e70ba35f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:53.068408 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bde617-040c-4872-94b0-2cb5e70ba35f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:53.069822 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bde617-040c-4872-94b0-2cb5e70ba35f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:53.094776 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 368/735] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:53.111543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bde617-040c-4872-94b0-2cb5e70ba35f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:53.130928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e2f3c-94a1-47b0-866d-67586a708cb5 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:53.168212 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ca453-90a7-415f-afa5-1e89abc0b490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:53.168880 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ca453-90a7-415f-afa5-1e89abc0b490 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:53.169160 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ca453-90a7-415f-afa5-1e89abc0b490 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:53.169434 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ca453-90a7-415f-afa5-1e89abc0b490 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:53.170174 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ca453-90a7-415f-afa5-1e89abc0b490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:53.170487 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ca453-90a7-415f-afa5-1e89abc0b490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:53.171858 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ca453-90a7-415f-afa5-1e89abc0b490 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:53.202528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 368/736] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:53.204314 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ca453-90a7-415f-afa5-1e89abc0b490 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:53.292041 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bde617-040c-4872-94b0-2cb5e70ba35f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:53.327593 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ca453-90a7-415f-afa5-1e89abc0b490 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:53.336099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c27620-db53-4714-b049-3ef5dbf39390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:53.337075 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c27620-db53-4714-b049-3ef5dbf39390 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:53.337451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c27620-db53-4714-b049-3ef5dbf39390 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:53.337822 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c27620-db53-4714-b049-3ef5dbf39390 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:53.346070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c27620-db53-4714-b049-3ef5dbf39390 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:53.347984 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c27620-db53-4714-b049-3ef5dbf39390 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:53.363250 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89593009-389d-49bb-a4a2-81e9967c8a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:53.364727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89593009-389d-49bb-a4a2-81e9967c8a24 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:53.365230 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89593009-389d-49bb-a4a2-81e9967c8a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:53.365742 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89593009-389d-49bb-a4a2-81e9967c8a24 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:53.366166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-70c27620-db53-4714-b049-3ef5dbf39390 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:53.366166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:53.366166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:53.366166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:53.366166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:53.366166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:53.366166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:53.366166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:53.366166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:53.366166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:53.366166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:53.366166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:53.366166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:01:53.366166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:01:53.366166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:01:53.367102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:01:53.367102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:53.367102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:53.367102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:53.367102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:53.367102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:53.367102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:53.367102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:53.367102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:53.367102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:53.367102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:53.367102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:53.367102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:53.367102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:53.367102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:53.367102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:53.367102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:53.368569 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:01:53.368569 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:01:53.368569 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:01:53.368569 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:01:53.368569 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:01:53.368569 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:01:53.368569 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:53.368569 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:53.376007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 369/737] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:01:53.376007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb25ae-7de6-4eac-bfd4-0f6e94b8e766 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:53.376007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb25ae-7de6-4eac-bfd4-0f6e94b8e766 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:53.376263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb25ae-7de6-4eac-bfd4-0f6e94b8e766 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:53.378362 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 370/738] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:53.378465 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89593009-389d-49bb-a4a2-81e9967c8a24 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:53.379655 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb25ae-7de6-4eac-bfd4-0f6e94b8e766 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:53.384139 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89593009-389d-49bb-a4a2-81e9967c8a24 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:53.399938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-89593009-389d-49bb-a4a2-81e9967c8a24 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 15:01:53.399938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:53.399938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:53.399938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:53.399938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:53.399938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:53.399938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:53.399938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:53.399938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:53.399938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:53.399938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:53.399938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:53.399938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:01:53.399938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:01:53.399938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:01:53.399938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:01:53.401093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:53.401093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:53.401093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:01:53.401093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:53.401093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:01:53.401093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:53.401093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:53.401093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:53.401093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:53.401093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:53.401093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:53.401093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:53.401093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:53.401093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:53.401093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:53.401093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:53.401093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:53.401093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:53.402023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:53.402023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:53.402023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:01:53.402023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:01:53.402023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:01:53.402023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:01:53.402023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:01:53.402023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:01:53.402023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 15:01:53.402023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:53.404543 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 369/739] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:01:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:53.405917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18852f45-12b4-4429-be88-ac70a773d565 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:53.406385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18852f45-12b4-4429-be88-ac70a773d565 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:53.406814 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18852f45-12b4-4429-be88-ac70a773d565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:53.508135 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb25ae-7de6-4eac-bfd4-0f6e94b8e766 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:53.547783 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-18852f45-12b4-4429-be88-ac70a773d565 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:53.549274 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-18852f45-12b4-4429-be88-ac70a773d565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:53.564204 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87ba92-2556-4252-ae93-07b49eb9a268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:53.565576 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87ba92-2556-4252-ae93-07b49eb9a268 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:53.566162 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87ba92-2556-4252-ae93-07b49eb9a268 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:53.566692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87ba92-2556-4252-ae93-07b49eb9a268 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:53.567670 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87ba92-2556-4252-ae93-07b49eb9a268 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:53.568213 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87ba92-2556-4252-ae93-07b49eb9a268 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:53.569845 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87ba92-2556-4252-ae93-07b49eb9a268 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:53.589042 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 371/740] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:01:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:53.590222 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87ba92-2556-4252-ae93-07b49eb9a268 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:53.641528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 370/741] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:53.642989 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18852f45-12b4-4429-be88-ac70a773d565 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:53.711831 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87ba92-2556-4252-ae93-07b49eb9a268 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:53.754539 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf10bc-9fe0-48aa-89b6-a5bb7fd6130a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:53.755696 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf10bc-9fe0-48aa-89b6-a5bb7fd6130a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:53.756054 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf10bc-9fe0-48aa-89b6-a5bb7fd6130a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:53.756398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf10bc-9fe0-48aa-89b6-a5bb7fd6130a None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:53.757342 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf10bc-9fe0-48aa-89b6-a5bb7fd6130a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:53.757744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf10bc-9fe0-48aa-89b6-a5bb7fd6130a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:53.759916 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf10bc-9fe0-48aa-89b6-a5bb7fd6130a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:53.776511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18852f45-12b4-4429-be88-ac70a773d565 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:53.784978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 372/742] 10.222.0.76 () {56 vars in 1135 bytes} [Mon May 16 15:01:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:53.785927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf10bc-9fe0-48aa-89b6-a5bb7fd6130a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:53.819211 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b2ffd-57be-46a8-a003-aa1018838c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:53.822049 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b2ffd-57be-46a8-a003-aa1018838c56 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:53.822839 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b2ffd-57be-46a8-a003-aa1018838c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:53.823560 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b2ffd-57be-46a8-a003-aa1018838c56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:53.824601 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b2ffd-57be-46a8-a003-aa1018838c56 None admin] RBAC: Adding query filter params (role.id=f63aad4ab4a04108b87e1bf4ea8dfa53, scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9, user.id=1a7181297bf14a57b3bf1f3c8b178d3c) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:53.825090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b2ffd-57be-46a8-a003-aa1018838c56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:53.827691 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b2ffd-57be-46a8-a003-aa1018838c56 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:53.834390 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 371/743] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:01:53 2022] GET /identity/v3/role_assignments?user.id=1a7181297bf14a57b3bf1f3c8b178d3c&scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9&role.id=f63aad4ab4a04108b87e1bf4ea8dfa53 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:53.835949 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b2ffd-57be-46a8-a003-aa1018838c56 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:53.952455 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf10bc-9fe0-48aa-89b6-a5bb7fd6130a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:53.995053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fe6ba-ea9c-403f-883f-4cb6a4226da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:53.996051 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fe6ba-ea9c-403f-883f-4cb6a4226da4 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:53.996515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fe6ba-ea9c-403f-883f-4cb6a4226da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:53.996967 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fe6ba-ea9c-403f-883f-4cb6a4226da4 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:53.997910 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9fe6ba-ea9c-403f-883f-4cb6a4226da4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:53.999543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9fe6ba-ea9c-403f-883f-4cb6a4226da4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:54.009422 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b2ffd-57be-46a8-a003-aa1018838c56 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:54.044154 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66425478-53e6-4527-b29e-7b14a4d2c046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:54.044812 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66425478-53e6-4527-b29e-7b14a4d2c046 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:54.045094 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66425478-53e6-4527-b29e-7b14a4d2c046 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:54.045370 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66425478-53e6-4527-b29e-7b14a4d2c046 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:54.112356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66425478-53e6-4527-b29e-7b14a4d2c046 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:54.113801 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66425478-53e6-4527-b29e-7b14a4d2c046 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:54.148449 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 373/744] 10.222.0.76 () {60 vars in 1141 bytes} [Mon May 16 15:01:53 2022] POST /identity/v3/services => generated 240 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:01:54.150676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9fedc-225e-4d5f-bb02-cd2b93e29b09 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:54.151131 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9fedc-225e-4d5f-bb02-cd2b93e29b09 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:54.151606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9fedc-225e-4d5f-bb02-cd2b93e29b09 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:54.153469 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 374/745] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:54.155171 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2227f6a-8649-4e0f-a669-8225e64e239d None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:54.155932 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2227f6a-8649-4e0f-a669-8225e64e239d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:54.156423 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2227f6a-8649-4e0f-a669-8225e64e239d None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:54.158169 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 375/746] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:54.160249 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0f1f6-4e1d-46aa-b38f-c981b1c1a5df None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:54.160777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0f1f6-4e1d-46aa-b38f-c981b1c1a5df None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:54.161265 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0f1f6-4e1d-46aa-b38f-c981b1c1a5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:54.180279 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e4e0f1f6-4e1d-46aa-b38f-c981b1c1a5df None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:54.182632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e4e0f1f6-4e1d-46aa-b38f-c981b1c1a5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:54.226908 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 372/747] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:01:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 15:01:54.229105 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ace8b-4a94-42fb-8bd2-eb031ec72428 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:54.229105 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ace8b-4a94-42fb-8bd2-eb031ec72428 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:54.229316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ace8b-4a94-42fb-8bd2-eb031ec72428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:54.247395 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9d0ace8b-4a94-42fb-8bd2-eb031ec72428 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:54.248556 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9d0ace8b-4a94-42fb-8bd2-eb031ec72428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:54.268910 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 376/748] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:54 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:54.270287 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0f1f6-4e1d-46aa-b38f-c981b1c1a5df None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:54.332386 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 373/749] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:54 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 15:01:54.333365 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ace8b-4a94-42fb-8bd2-eb031ec72428 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:54.385685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0f1f6-4e1d-46aa-b38f-c981b1c1a5df None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:54.427916 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699adc6f-8f37-4f91-9626-6f4f57d3a633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:54.428986 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699adc6f-8f37-4f91-9626-6f4f57d3a633 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:54.429307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699adc6f-8f37-4f91-9626-6f4f57d3a633 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:54.429583 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699adc6f-8f37-4f91-9626-6f4f57d3a633 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:54.442587 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699adc6f-8f37-4f91-9626-6f4f57d3a633 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:54.444412 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699adc6f-8f37-4f91-9626-6f4f57d3a633 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:54.461650 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ace8b-4a94-42fb-8bd2-eb031ec72428 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:54.467213 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-699adc6f-8f37-4f91-9626-6f4f57d3a633 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:54.467213 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:54.467213 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:54.467213 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:54.467213 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:54.467213 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:54.467213 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:54.467213 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:54.467213 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:54.467213 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:54.467213 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:54.467213 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:54.467213 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:54.467213 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:54.467213 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:54.468099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:54.468099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:54.468099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:54.468099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:54.468099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:54.468099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:54.468099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:54.468099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:54.468099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:54.468099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:54.468099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:54.468099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:54.468099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:54.468099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:54.468099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:54.468099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:54.468099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:54.468981 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:54.468981 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:54.468981 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:54.468981 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:54.468981 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 377/750] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:54.469257 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699adc6f-8f37-4f91-9626-6f4f57d3a633 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:54.499093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac051d0b-9a27-4a81-b246-b5445b769f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:54.499844 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac051d0b-9a27-4a81-b246-b5445b769f94 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:54.500117 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac051d0b-9a27-4a81-b246-b5445b769f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:54.506174 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac051d0b-9a27-4a81-b246-b5445b769f94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:54.511963 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac051d0b-9a27-4a81-b246-b5445b769f94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:54.520589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-ac051d0b-9a27-4a81-b246-b5445b769f94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:01:54.520589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:54.520589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:54.520589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:54.520589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:54.520589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:54.520589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:54.520589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:54.520589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:54.520589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:54.520589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:54.520589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:54.520589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:54.520589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:54.520589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:54.520589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:54.521549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:54.521549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:54.521549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:54.521549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:54.521549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:54.521549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:54.521549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:54.521549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:54.521549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:54.521549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:54.521549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:54.521549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:54.521549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:54.521549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:54.521549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:54.521549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:54.522450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:54.522450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:54.522450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:54.522450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:54.522450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:54.522450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:54.522450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:54.522450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:54.522450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:54.522450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:54.522450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:01:54.522450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:54.524471 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 374/751] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:01:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:54.525291 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac051d0b-9a27-4a81-b246-b5445b769f94 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:54.582178 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699adc6f-8f37-4f91-9626-6f4f57d3a633 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:54.617632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b5224-b3a8-448e-8ffc-6d8ea140abc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:54.618366 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b5224-b3a8-448e-8ffc-6d8ea140abc6 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:54.618651 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b5224-b3a8-448e-8ffc-6d8ea140abc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:54.618929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b5224-b3a8-448e-8ffc-6d8ea140abc6 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:54.619659 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b5224-b3a8-448e-8ffc-6d8ea140abc6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:54.621039 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b5224-b3a8-448e-8ffc-6d8ea140abc6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:54.629937 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac051d0b-9a27-4a81-b246-b5445b769f94 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:54.666896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821b2fa-2f11-4984-b8fa-e4e292b7899b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:54.667597 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821b2fa-2f11-4984-b8fa-e4e292b7899b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:54.667869 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821b2fa-2f11-4984-b8fa-e4e292b7899b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:54.668142 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821b2fa-2f11-4984-b8fa-e4e292b7899b None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:54.668859 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821b2fa-2f11-4984-b8fa-e4e292b7899b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:54.669163 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821b2fa-2f11-4984-b8fa-e4e292b7899b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:54.670579 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821b2fa-2f11-4984-b8fa-e4e292b7899b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:54.682738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 375/752] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:54.683735 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821b2fa-2f11-4984-b8fa-e4e292b7899b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:54.715974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 378/753] 10.222.0.76 () {60 vars in 1141 bytes} [Mon May 16 15:01:54 2022] POST /identity/v3/services => generated 251 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:01:54.717407 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b5224-b3a8-448e-8ffc-6d8ea140abc6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:54.845430 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821b2fa-2f11-4984-b8fa-e4e292b7899b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:54.889111 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9719183-c6b0-42a2-ae41-b2b8e94d0dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:54.889798 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9719183-c6b0-42a2-ae41-b2b8e94d0dee None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:54.890078 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9719183-c6b0-42a2-ae41-b2b8e94d0dee None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:54.890382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9719183-c6b0-42a2-ae41-b2b8e94d0dee None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:54.891140 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9719183-c6b0-42a2-ae41-b2b8e94d0dee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:54.891442 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9719183-c6b0-42a2-ae41-b2b8e94d0dee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:54.892826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9719183-c6b0-42a2-ae41-b2b8e94d0dee None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:54.904733 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 376/754] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:01:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:54.910380 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9719183-c6b0-42a2-ae41-b2b8e94d0dee None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:54.961869 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b5224-b3a8-448e-8ffc-6d8ea140abc6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:55.024046 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9719183-c6b0-42a2-ae41-b2b8e94d0dee None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:55.024783 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b74ee0-f733-4d3d-8a3c-e7a974eb48b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:55.025595 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b74ee0-f733-4d3d-8a3c-e7a974eb48b4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:55.025884 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b74ee0-f733-4d3d-8a3c-e7a974eb48b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:55.026179 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b74ee0-f733-4d3d-8a3c-e7a974eb48b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:55.035890 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b74ee0-f733-4d3d-8a3c-e7a974eb48b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:55.042829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b74ee0-f733-4d3d-8a3c-e7a974eb48b4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:55.063874 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6061f32-5a10-44d9-bb94-eb775d5ab73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:55.064833 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6061f32-5a10-44d9-bb94-eb775d5ab73e None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:55.065136 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6061f32-5a10-44d9-bb94-eb775d5ab73e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:55.065389 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6061f32-5a10-44d9-bb94-eb775d5ab73e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:55.069918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-57b74ee0-f733-4d3d-8a3c-e7a974eb48b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:55.069918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:55.069918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:55.069918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:55.069918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:55.069918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:55.069918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:55.069918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:55.069918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:55.069918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:55.069918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:55.069918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:55.069918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:01:55.069918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:01:55.069918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:01:55.070936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:01:55.070936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:55.070936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:55.070936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:55.070936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:55.070936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:55.070936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:55.070936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:55.070936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:55.070936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:55.070936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:55.070936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:55.070936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:55.070936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:55.070936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:55.070936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:55.070936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:55.071818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:01:55.071818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:01:55.071818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:01:55.071818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:01:55.071818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:01:55.071818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:01:55.071818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:55.071818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:55.073780 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 379/755] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:55.078424 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b74ee0-f733-4d3d-8a3c-e7a974eb48b4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:55.082728 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6061f32-5a10-44d9-bb94-eb775d5ab73e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:55.085355 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6061f32-5a10-44d9-bb94-eb775d5ab73e None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:55.104419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-f6061f32-5a10-44d9-bb94-eb775d5ab73e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:55.104419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:55.104419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:55.104419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:55.104419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:55.104419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:55.104419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:55.104419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:55.104419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:55.104419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:55.104419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:55.104419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:55.104419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:55.104419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:55.104419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:55.106982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:55.106982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:55.106982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:55.106982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:55.106982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:55.106982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:55.106982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:55.106982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:55.106982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:55.106982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:55.106982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:55.106982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:55.106982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:55.106982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:55.106982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:55.106982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:55.106982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:55.109989 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:55.109989 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:55.109989 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:55.109989 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:55.109989 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 377/756] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:01:55.118313 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6061f32-5a10-44d9-bb94-eb775d5ab73e None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:55.191905 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b74ee0-f733-4d3d-8a3c-e7a974eb48b4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:55.223911 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6061f32-5a10-44d9-bb94-eb775d5ab73e None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:55.228368 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5889b1-427b-4725-ac45-be03045bc8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:55.229041 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5889b1-427b-4725-ac45-be03045bc8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:55.229322 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5889b1-427b-4725-ac45-be03045bc8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:55.229597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5889b1-427b-4725-ac45-be03045bc8e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:55.230435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5889b1-427b-4725-ac45-be03045bc8e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:55.230862 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5889b1-427b-4725-ac45-be03045bc8e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:55.232344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5889b1-427b-4725-ac45-be03045bc8e5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:55.245065 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 380/757] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:01:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:55.252626 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5889b1-427b-4725-ac45-be03045bc8e5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:55.268934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3f1bc-f142-4e5c-8566-df4b0bd0fa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:55.269605 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3f1bc-f142-4e5c-8566-df4b0bd0fa4b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:55.270257 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3f1bc-f142-4e5c-8566-df4b0bd0fa4b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:55.270540 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3f1bc-f142-4e5c-8566-df4b0bd0fa4b None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:55.271575 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3f1bc-f142-4e5c-8566-df4b0bd0fa4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:55.271883 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3f1bc-f142-4e5c-8566-df4b0bd0fa4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:55.273819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3f1bc-f142-4e5c-8566-df4b0bd0fa4b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:55.291325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 378/758] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:55.298623 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3f1bc-f142-4e5c-8566-df4b0bd0fa4b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:55.380057 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5889b1-427b-4725-ac45-be03045bc8e5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:55.418537 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a8887-ea26-4054-a597-7b25b2083cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:55.419195 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a8887-ea26-4054-a597-7b25b2083cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:55.419473 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a8887-ea26-4054-a597-7b25b2083cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:55.419750 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a8887-ea26-4054-a597-7b25b2083cf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:55.420583 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a8887-ea26-4054-a597-7b25b2083cf0 None admin] RBAC: Adding query filter params (role.id=f6c8fc0dc0f24de3907b0960a1201901, scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9, user.id=33470e30760842ca9e96bb7f0cf9f07d) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:55.420900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a8887-ea26-4054-a597-7b25b2083cf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:55.427669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3f1bc-f142-4e5c-8566-df4b0bd0fa4b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:55.431135 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a8887-ea26-4054-a597-7b25b2083cf0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:55.445424 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 381/759] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:01:55 2022] GET /identity/v3/role_assignments?user.id=33470e30760842ca9e96bb7f0cf9f07d&scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9&role.id=f6c8fc0dc0f24de3907b0960a1201901 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:55.467986 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dcbe2-c251-4a3f-bf75-2f1faca4af23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:55.468857 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dcbe2-c251-4a3f-bf75-2f1faca4af23 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:55.469144 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dcbe2-c251-4a3f-bf75-2f1faca4af23 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:55.469425 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dcbe2-c251-4a3f-bf75-2f1faca4af23 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:55.479447 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607dcbe2-c251-4a3f-bf75-2f1faca4af23 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:55.480947 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607dcbe2-c251-4a3f-bf75-2f1faca4af23 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:55.497324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-607dcbe2-c251-4a3f-bf75-2f1faca4af23 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 15:01:55.497324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:55.497324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:55.497324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:55.497324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:55.497324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:55.497324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:55.497324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:55.497324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:55.497324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:55.497324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:55.497324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:55.497324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:01:55.497324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:01:55.497324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:01:55.497324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:01:55.499653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:55.499653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:55.499653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:01:55.499653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:55.499653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:01:55.499653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:55.499653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:55.499653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:55.499653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:55.499653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:55.499653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:55.499653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:55.499653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:55.499653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:55.499653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:55.499653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:55.499653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:55.499653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:55.501162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:55.501162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:55.501162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:01:55.501162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:01:55.501162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:01:55.501162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:01:55.501162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:01:55.501162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:01:55.501162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 15:01:55.501162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:55.501162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 379/760] 10.222.0.76 () {56 vars in 1093 bytes} [Mon May 16 15:01:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:55.507468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a8887-ea26-4054-a597-7b25b2083cf0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:55.674585 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a8887-ea26-4054-a597-7b25b2083cf0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:55.716287 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44ab83-0b76-4474-8237-3b181a9c24c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:55.716967 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44ab83-0b76-4474-8237-3b181a9c24c9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:55.717249 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44ab83-0b76-4474-8237-3b181a9c24c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:55.717521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44ab83-0b76-4474-8237-3b181a9c24c9 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:55.718394 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44ab83-0b76-4474-8237-3b181a9c24c9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:55.718704 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44ab83-0b76-4474-8237-3b181a9c24c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:55.720156 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44ab83-0b76-4474-8237-3b181a9c24c9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:55.748680 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 382/761] 10.222.0.76 () {56 vars in 1133 bytes} [Mon May 16 15:01:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:55.754395 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dcbe2-c251-4a3f-bf75-2f1faca4af23 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:55.881425 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dcbe2-c251-4a3f-bf75-2f1faca4af23 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:55.917068 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5d615-ea03-4de3-8296-f920bd9bf38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:55.917876 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5d615-ea03-4de3-8296-f920bd9bf38b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:55.918178 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5d615-ea03-4de3-8296-f920bd9bf38b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:55.918462 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5d615-ea03-4de3-8296-f920bd9bf38b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:55.929736 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5d615-ea03-4de3-8296-f920bd9bf38b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:55.931727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5d615-ea03-4de3-8296-f920bd9bf38b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:55.960374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-5ec5d615-ea03-4de3-8296-f920bd9bf38b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:55.960374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:55.960374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:55.960374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:55.960374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:55.960374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:55.960374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:55.960374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:55.960374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:55.960374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:55.960374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:55.960374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:55.960374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:55.960374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:55.960374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:55.961357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:55.961357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:55.961357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:55.961357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:55.961357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:55.961357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:55.961357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:55.961357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:55.961357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:55.961357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:55.961357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:55.961357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:55.961357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:55.961357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:55.961357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:55.961357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:55.961357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:55.962806 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:55.962806 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:55.962806 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:55.962806 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:55.963024 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 380/762] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:55.972552 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44ab83-0b76-4474-8237-3b181a9c24c9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:56.130028 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44ab83-0b76-4474-8237-3b181a9c24c9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:56.166019 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121de7b6-46b4-44bf-98cf-e6dd4d091b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:56.166722 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121de7b6-46b4-44bf-98cf-e6dd4d091b61 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:56.167003 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121de7b6-46b4-44bf-98cf-e6dd4d091b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:56.167279 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121de7b6-46b4-44bf-98cf-e6dd4d091b61 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:56.167998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121de7b6-46b4-44bf-98cf-e6dd4d091b61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:56.168304 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121de7b6-46b4-44bf-98cf-e6dd4d091b61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:56.169681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121de7b6-46b4-44bf-98cf-e6dd4d091b61 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:56.185202 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 383/763] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:56.190923 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5d615-ea03-4de3-8296-f920bd9bf38b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:56.306414 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5d615-ea03-4de3-8296-f920bd9bf38b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:56.310310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410894f-f43a-45e1-9230-c1c6c23c7e4e None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:56.310805 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410894f-f43a-45e1-9230-c1c6c23c7e4e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:56.310881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410894f-f43a-45e1-9230-c1c6c23c7e4e None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:56.312519 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 384/764] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:56.323183 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cda37-f97c-46cb-9588-140124484129 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:56.323470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cda37-f97c-46cb-9588-140124484129 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:56.323734 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cda37-f97c-46cb-9588-140124484129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:56.350840 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c6439-882b-49b9-a60e-ab1f1030e983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:56.352053 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c6439-882b-49b9-a60e-ab1f1030e983 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:56.352538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c6439-882b-49b9-a60e-ab1f1030e983 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:56.353028 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c6439-882b-49b9-a60e-ab1f1030e983 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:56.353132 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9a0cda37-f97c-46cb-9588-140124484129 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:56.354430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9a0cda37-f97c-46cb-9588-140124484129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:56.362703 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c6439-882b-49b9-a60e-ab1f1030e983 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:56.364453 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c6439-882b-49b9-a60e-ab1f1030e983 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:56.386500 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-a85c6439-882b-49b9-a60e-ab1f1030e983 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:56.386500 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:56.386500 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:56.386500 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:56.386500 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:56.386500 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:56.386500 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:56.386500 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:56.386500 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:56.386500 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:56.386500 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:56.386500 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:56.386500 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:01:56.386500 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:01:56.386500 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:01:56.387431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:01:56.387431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:56.387431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:56.387431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:56.387431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:56.387431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:56.387431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:56.387431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:56.387431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:56.387431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:56.387431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:56.387431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:56.387431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:56.387431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:56.387431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:56.387431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:56.387431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:56.388313 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:01:56.388313 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:01:56.388313 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:01:56.388313 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:01:56.388313 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:01:56.388313 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:01:56.388313 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:56.388313 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:56.400802 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 381/765] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:56.407091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c6439-882b-49b9-a60e-ab1f1030e983 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:56.491954 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 385/766] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:01:56.528131 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cda37-f97c-46cb-9588-140124484129 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:56.546254 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c6439-882b-49b9-a60e-ab1f1030e983 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:56.591638 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7a854-2149-4baa-bbbe-74727084a123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:56.592167 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7a854-2149-4baa-bbbe-74727084a123 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:56.592452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7a854-2149-4baa-bbbe-74727084a123 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:56.592727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7a854-2149-4baa-bbbe-74727084a123 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:56.593526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7a854-2149-4baa-bbbe-74727084a123 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:56.593834 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7a854-2149-4baa-bbbe-74727084a123 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:56.595321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7a854-2149-4baa-bbbe-74727084a123 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:56.616240 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 382/767] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:01:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:56.623034 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7a854-2149-4baa-bbbe-74727084a123 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:56.655721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cda37-f97c-46cb-9588-140124484129 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:56.702814 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e0de5-5868-4a69-a6bb-c7da15281813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:56.703625 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e0de5-5868-4a69-a6bb-c7da15281813 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:56.703903 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e0de5-5868-4a69-a6bb-c7da15281813 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:56.704170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e0de5-5868-4a69-a6bb-c7da15281813 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:56.719812 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e0de5-5868-4a69-a6bb-c7da15281813 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:56.725929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7a854-2149-4baa-bbbe-74727084a123 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:56.737827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-526e0de5-5868-4a69-a6bb-c7da15281813 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:56.737827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:56.737827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:56.737827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:56.737827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:56.737827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:56.737827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:56.737827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:56.737827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:56.737827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:56.737827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:56.737827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:56.737827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:56.737827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:56.737827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:56.737827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:56.738844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:56.738844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:56.738844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:56.738844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:56.738844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:56.738844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:56.738844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:56.738844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:56.738844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:56.738844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:56.738844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:56.738844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:56.738844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:56.738844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:56.738844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:56.738844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:56.739666 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:56.739666 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:56.739666 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:56.739666 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:56.739666 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:56.739666 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:56.739666 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:56.739666 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:56.739666 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:56.739666 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:56.739666 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 15:01:56.739666 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:56.739666 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 386/768] 10.222.0.76 () {56 vars in 1102 bytes} [Mon May 16 15:01:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:56.745364 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e0de5-5868-4a69-a6bb-c7da15281813 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:56.775814 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b753e0c-e63c-4474-92ea-ba7784833750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:56.776710 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b753e0c-e63c-4474-92ea-ba7784833750 None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:56.776991 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b753e0c-e63c-4474-92ea-ba7784833750 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:56.777265 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b753e0c-e63c-4474-92ea-ba7784833750 None admin] PATH_INFO: `/v3/projects/681a6490f3c04f9fa2830cfde3deb2e9/users/9d85024f010c40129d79543b3ec4cfae/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:56.783437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b753e0c-e63c-4474-92ea-ba7784833750 None admin] RBAC: Authorizing `identity:create_grant(project_id=681a6490f3c04f9fa2830cfde3deb2e9, user_id=9d85024f010c40129d79543b3ec4cfae, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:56.784887 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b753e0c-e63c-4474-92ea-ba7784833750 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:56.854810 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e0de5-5868-4a69-a6bb-c7da15281813 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:56.864974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 383/769] 10.222.0.76 () {58 vars in 1439 bytes} [Mon May 16 15:01:56 2022] PUT /identity/v3/projects/681a6490f3c04f9fa2830cfde3deb2e9/users/9d85024f010c40129d79543b3ec4cfae/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:01:56.899994 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe30dc-5f25-433c-b8a2-53683252cf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:56.900684 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe30dc-5f25-433c-b8a2-53683252cf73 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:56.900963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe30dc-5f25-433c-b8a2-53683252cf73 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:56.901232 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe30dc-5f25-433c-b8a2-53683252cf73 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:56.901996 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe30dc-5f25-433c-b8a2-53683252cf73 None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:56.902321 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe30dc-5f25-433c-b8a2-53683252cf73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:56.903726 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe30dc-5f25-433c-b8a2-53683252cf73 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:56.917287 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 387/770] 10.222.0.76 () {56 vars in 1103 bytes} [Mon May 16 15:01:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:56.918707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b753e0c-e63c-4474-92ea-ba7784833750 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:57.059365 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b753e0c-e63c-4474-92ea-ba7784833750 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:57.089145 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1996809-c206-4f79-a34e-ff208acbbc30 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:57.089471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1996809-c206-4f79-a34e-ff208acbbc30 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:57.089686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1996809-c206-4f79-a34e-ff208acbbc30 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:57.091356 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 388/771] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:57.096581 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cfe28-916c-4829-b0b5-d77531f9ca25 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:57.096902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cfe28-916c-4829-b0b5-d77531f9ca25 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:57.097177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cfe28-916c-4829-b0b5-d77531f9ca25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:57.100058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70437af7-5d3e-4db4-91ac-5d22dd4dbc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:57.100945 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70437af7-5d3e-4db4-91ac-5d22dd4dbc81 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:57.101226 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70437af7-5d3e-4db4-91ac-5d22dd4dbc81 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:57.101498 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70437af7-5d3e-4db4-91ac-5d22dd4dbc81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:57.111961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70437af7-5d3e-4db4-91ac-5d22dd4dbc81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:57.113412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70437af7-5d3e-4db4-91ac-5d22dd4dbc81 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:57.115098 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-773cfe28-916c-4829-b0b5-d77531f9ca25 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:57.116271 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-773cfe28-916c-4829-b0b5-d77531f9ca25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:57.131831 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-70437af7-5d3e-4db4-91ac-5d22dd4dbc81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:57.131831 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:57.131831 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:57.131831 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:57.131831 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:57.131831 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:57.131831 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:57.131831 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:57.131831 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:57.131831 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:57.131831 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:57.131831 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:57.131831 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:57.131831 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:57.131831 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:57.134437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:57.134437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:57.134437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:57.134437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:57.134437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:57.134437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:57.134437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:57.134437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:57.134437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:57.134437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:57.134437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:57.134437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:57.134437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:57.134437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:57.134437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:57.134437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:57.134437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:57.136495 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:57.136495 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:57.136495 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:57.136495 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:57.136495 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 384/772] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:57.142186 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70437af7-5d3e-4db4-91ac-5d22dd4dbc81 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:57.198247 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 389/773] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 15:01:57.217725 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cfe28-916c-4829-b0b5-d77531f9ca25 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:57.246618 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70437af7-5d3e-4db4-91ac-5d22dd4dbc81 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:57.282844 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9490e-5438-4436-9dae-96ce29ff76b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:57.283515 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9490e-5438-4436-9dae-96ce29ff76b1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:57.283796 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9490e-5438-4436-9dae-96ce29ff76b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:57.284068 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9490e-5438-4436-9dae-96ce29ff76b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:57.284793 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9490e-5438-4436-9dae-96ce29ff76b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:57.285096 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9490e-5438-4436-9dae-96ce29ff76b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:57.286483 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9490e-5438-4436-9dae-96ce29ff76b1 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:57.299830 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 385/774] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:57.306035 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9490e-5438-4436-9dae-96ce29ff76b1 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:57.388269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cfe28-916c-4829-b0b5-d77531f9ca25 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:57.428476 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9490e-5438-4436-9dae-96ce29ff76b1 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:57.462312 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce36778-c6f7-4c5b-9ee6-50b4bbba8b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:57.463110 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce36778-c6f7-4c5b-9ee6-50b4bbba8b2d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:57.463385 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce36778-c6f7-4c5b-9ee6-50b4bbba8b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:57.463654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce36778-c6f7-4c5b-9ee6-50b4bbba8b2d None admin] PATH_INFO: `/v3/services/network` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:57.464311 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce36778-c6f7-4c5b-9ee6-50b4bbba8b2d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:57.465480 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a923f-93c8-468d-a0c5-f7aa30d3fcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:57.466375 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a923f-93c8-468d-a0c5-f7aa30d3fcba None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:57.466653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a923f-93c8-468d-a0c5-f7aa30d3fcba None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:57.466980 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a923f-93c8-468d-a0c5-f7aa30d3fcba None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:57.470602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce36778-c6f7-4c5b-9ee6-50b4bbba8b2d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:57.475384 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a923f-93c8-468d-a0c5-f7aa30d3fcba None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:57.477556 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a923f-93c8-468d-a0c5-f7aa30d3fcba None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:57.493568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-8b4a923f-93c8-468d-a0c5-f7aa30d3fcba None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 15:01:57.493568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:57.493568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:57.493568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:57.493568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:57.493568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:57.493568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:57.493568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:57.493568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:57.493568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:57.493568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:57.493568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:57.493568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:01:57.493568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:01:57.493568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:01:57.493568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:01:57.495788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:57.495788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:57.495788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:01:57.495788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:57.495788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:01:57.495788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:01:57.495788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:57.495788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:57.495788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:57.495788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:57.495788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:57.495788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:57.495788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:57.495788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:57.495788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:57.495788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:57.495788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:57.495788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:57.497996 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:57.497996 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:57.497996 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:01:57.497996 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:01:57.497996 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:01:57.497996 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:01:57.497996 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:01:57.497996 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:01:57.497996 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 15:01:57.497996 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:57.497996 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 386/775] 10.222.0.76 () {56 vars in 1117 bytes} [Mon May 16 15:01:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:57.506149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-3ce36778-c6f7-4c5b-9ee6-50b4bbba8b2d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 15:01:57.506149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:57.506149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 15:01:57.506149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 15:01:57.506149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 15:01:57.506149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 15:01:57.506149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 15:01:57.506149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:01:57.506149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 15:01:57.506149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:57.506149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:01:57.506149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:57.506149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:57.506149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:57.506149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:57.506149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:57.506149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:57.509000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:57.509000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:57.509000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:57.509000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:57.509000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:57.509000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:57.509000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 15:01:57.509000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 15:01:57.509000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 15:01:57.509000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 15:01:57.509000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:57.509000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:57.509000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:57.509000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:57.509000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:57.509000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:57.510991 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:57.510991 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:57.510991 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:57.510991 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:57.510991 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:57.510991 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:57.510991 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:57.510991 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:57.510991 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:57.510991 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:57.510991 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 15:01:57.510991 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:01:57.510991 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 15:01:57.510991 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:57.512673 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a923f-93c8-468d-a0c5-f7aa30d3fcba None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:57.512816 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 390/776] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:57 2022] GET /identity/v3/services/network => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:01:57.512816 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce36778-c6f7-4c5b-9ee6-50b4bbba8b2d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:57.608489 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a923f-93c8-468d-a0c5-f7aa30d3fcba None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:57.662698 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798616a6-9b4d-4472-8c97-b9cb118d6961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:57.663305 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798616a6-9b4d-4472-8c97-b9cb118d6961 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:57.663587 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798616a6-9b4d-4472-8c97-b9cb118d6961 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:57.663863 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798616a6-9b4d-4472-8c97-b9cb118d6961 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:57.665283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798616a6-9b4d-4472-8c97-b9cb118d6961 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:57.665591 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798616a6-9b4d-4472-8c97-b9cb118d6961 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:57.667505 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798616a6-9b4d-4472-8c97-b9cb118d6961 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:57.687894 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 387/777] 10.222.0.76 () {56 vars in 1149 bytes} [Mon May 16 15:01:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:57.693447 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798616a6-9b4d-4472-8c97-b9cb118d6961 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:57.758897 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce36778-c6f7-4c5b-9ee6-50b4bbba8b2d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:57.810144 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbb2c5-2a46-44de-b272-b927278d3bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:57.810840 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbb2c5-2a46-44de-b272-b927278d3bed None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:57.811122 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbb2c5-2a46-44de-b272-b927278d3bed None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:57.811446 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbb2c5-2a46-44de-b272-b927278d3bed None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:57.812174 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbb2c5-2a46-44de-b272-b927278d3bed None admin] RBAC: Adding query filter params (name=network) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:57.812481 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbb2c5-2a46-44de-b272-b927278d3bed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:57.813964 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbb2c5-2a46-44de-b272-b927278d3bed None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:57.819737 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 391/778] 10.222.0.76 () {56 vars in 1112 bytes} [Mon May 16 15:01:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:57.826064 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbb2c5-2a46-44de-b272-b927278d3bed None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:57.862169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798616a6-9b4d-4472-8c97-b9cb118d6961 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:57.896823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d961bd6-32d9-4a36-9f16-ccf37b1b99a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:57.897613 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d961bd6-32d9-4a36-9f16-ccf37b1b99a7 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:57.897891 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d961bd6-32d9-4a36-9f16-ccf37b1b99a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:57.898183 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d961bd6-32d9-4a36-9f16-ccf37b1b99a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:57.909018 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d961bd6-32d9-4a36-9f16-ccf37b1b99a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:57.910510 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d961bd6-32d9-4a36-9f16-ccf37b1b99a7 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:57.929684 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbb2c5-2a46-44de-b272-b927278d3bed None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:57.936357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-8d961bd6-32d9-4a36-9f16-ccf37b1b99a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:57.936357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:57.936357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:57.936357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:57.936357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:57.936357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:57.936357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:57.936357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:57.936357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:57.936357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:57.936357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:57.936357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:57.936357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:57.936357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:57.936357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:57.938343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:57.938343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:57.938343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:57.938343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:57.938343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:57.938343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:57.938343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:57.938343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:57.938343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:57.938343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:57.938343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:57.938343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:57.938343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:57.938343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:57.938343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:57.938343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:57.938343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:57.940402 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:57.940402 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:57.940402 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:57.940402 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:57.940402 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 388/779] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:57.951652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d961bd6-32d9-4a36-9f16-ccf37b1b99a7 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:57.969868 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47721c-d962-44b4-af62-3d9a3c81efb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:57.970570 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47721c-d962-44b4-af62-3d9a3c81efb6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:57.970847 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47721c-d962-44b4-af62-3d9a3c81efb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:57.971177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47721c-d962-44b4-af62-3d9a3c81efb6 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:57.971950 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47721c-d962-44b4-af62-3d9a3c81efb6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:57.972310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47721c-d962-44b4-af62-3d9a3c81efb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:57.973689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47721c-d962-44b4-af62-3d9a3c81efb6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:57.980855 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 392/780] 10.222.0.76 () {56 vars in 1112 bytes} [Mon May 16 15:01:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:57.986421 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47721c-d962-44b4-af62-3d9a3c81efb6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:58.089414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47721c-d962-44b4-af62-3d9a3c81efb6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:58.095577 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d961bd6-32d9-4a36-9f16-ccf37b1b99a7 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:58.124292 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8e931-4739-4a6e-8ddd-b0b0252a3b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:58.124957 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8e931-4739-4a6e-8ddd-b0b0252a3b6c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:58.125239 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8e931-4739-4a6e-8ddd-b0b0252a3b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:58.125513 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8e931-4739-4a6e-8ddd-b0b0252a3b6c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:58.126335 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8e931-4739-4a6e-8ddd-b0b0252a3b6c None admin] RBAC: Adding query filter params (interface=public, service_id=df7a8e0e88dd472484710a723de5fedb, region_id=RegionOne) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:58.126647 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8e931-4739-4a6e-8ddd-b0b0252a3b6c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:58.128011 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8e931-4739-4a6e-8ddd-b0b0252a3b6c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:58.141180 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 393/781] 10.222.0.76 () {56 vars in 1251 bytes} [Mon May 16 15:01:57 2022] GET /identity/v3/endpoints?service_id=df7a8e0e88dd472484710a723de5fedb&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:58.141180 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6fe73-e7a7-4322-a354-f58e36cb8c07 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:58.141180 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6fe73-e7a7-4322-a354-f58e36cb8c07 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:58.141180 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6fe73-e7a7-4322-a354-f58e36cb8c07 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:58.141180 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 394/782] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:58.141180 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6fe73-e7a7-4322-a354-f58e36cb8c07 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:58.143109 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610070e0-456b-4c9d-aa52-e75b58be84f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:58.144213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610070e0-456b-4c9d-aa52-e75b58be84f1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:58.144676 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610070e0-456b-4c9d-aa52-e75b58be84f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:58.145962 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610070e0-456b-4c9d-aa52-e75b58be84f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:58.146865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610070e0-456b-4c9d-aa52-e75b58be84f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:58.147312 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610070e0-456b-4c9d-aa52-e75b58be84f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:58.149444 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610070e0-456b-4c9d-aa52-e75b58be84f1 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:58.167330 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 389/783] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:58.169153 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4ebdf-17e3-4240-b066-31e46298113e None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:58.169570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4ebdf-17e3-4240-b066-31e46298113e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:58.169972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4ebdf-17e3-4240-b066-31e46298113e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:58.189530 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5cf4ebdf-17e3-4240-b066-31e46298113e None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:58.191401 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5cf4ebdf-17e3-4240-b066-31e46298113e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:58.250739 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6fe73-e7a7-4322-a354-f58e36cb8c07 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:58.290621 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 390/784] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:01:58.291946 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4ebdf-17e3-4240-b066-31e46298113e None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:58.298421 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbd964-ebb0-4f08-8570-8c93f0bfb691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:58.299102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbd964-ebb0-4f08-8570-8c93f0bfb691 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:58.299383 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbd964-ebb0-4f08-8570-8c93f0bfb691 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:58.299658 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbd964-ebb0-4f08-8570-8c93f0bfb691 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:58.300423 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbd964-ebb0-4f08-8570-8c93f0bfb691 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:58.302646 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbd964-ebb0-4f08-8570-8c93f0bfb691 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:58.311093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 395/785] 10.222.0.76 () {56 vars in 1087 bytes} [Mon May 16 15:01:58 2022] GET /identity/v3/services => generated 772 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:58.324603 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbd964-ebb0-4f08-8570-8c93f0bfb691 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:58.409087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4ebdf-17e3-4240-b066-31e46298113e None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:58.433366 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbd964-ebb0-4f08-8570-8c93f0bfb691 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:58.458845 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c680a-dc8c-4bec-96ab-98d122e8942c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:58.458845 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c680a-dc8c-4bec-96ab-98d122e8942c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:58.458845 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c680a-dc8c-4bec-96ab-98d122e8942c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:58.458845 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c680a-dc8c-4bec-96ab-98d122e8942c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:58.461696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c680a-dc8c-4bec-96ab-98d122e8942c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:58.463613 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c680a-dc8c-4bec-96ab-98d122e8942c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:58.480132 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf1cea-24bb-457b-bfab-46ca036ae0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:58.481157 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf1cea-24bb-457b-bfab-46ca036ae0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:58.481514 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf1cea-24bb-457b-bfab-46ca036ae0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:58.481863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf1cea-24bb-457b-bfab-46ca036ae0b3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:58.482737 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf1cea-24bb-457b-bfab-46ca036ae0b3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:58.484296 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf1cea-24bb-457b-bfab-46ca036ae0b3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:58.485898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-d73c680a-dc8c-4bec-96ab-98d122e8942c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:58.485898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:58.485898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:58.485898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:58.485898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:58.485898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:58.485898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:58.485898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:58.485898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:58.485898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:58.485898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:58.485898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:58.485898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:01:58.485898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:01:58.485898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:01:58.486985 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:01:58.486985 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:58.486985 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:58.486985 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:58.486985 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:58.486985 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:58.486985 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:58.486985 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:58.486985 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:58.486985 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:58.486985 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:58.486985 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:58.486985 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:58.486985 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:58.486985 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:58.486985 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:58.486985 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:58.487962 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:01:58.487962 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:01:58.487962 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:01:58.487962 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:01:58.487962 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:01:58.487962 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:01:58.487962 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:01:58.487962 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:58.494473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 391/786] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:01:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:58.497007 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c680a-dc8c-4bec-96ab-98d122e8942c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:58.498934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-4bdf1cea-24bb-457b-bfab-46ca036ae0b3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 15:01:58.498934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:58.498934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 15:01:58.498934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 15:01:58.498934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 15:01:58.498934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 15:01:58.498934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 15:01:58.498934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:01:58.498934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 15:01:58.498934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:58.498934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:01:58.498934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:58.498934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:58.498934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:58.498934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:58.498934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:58.499896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:58.499896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:58.499896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:58.499896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:58.499896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:58.499896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:58.499896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:58.499896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 15:01:58.499896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 15:01:58.499896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 15:01:58.499896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 15:01:58.499896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:58.499896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:58.499896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:58.499896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:58.499896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:58.500744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:58.500744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:58.500744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:58.500744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:58.500744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:58.500744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:58.500744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:58.500744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:58.500744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:58.500744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:58.500744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:58.500744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 15:01:58.500744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:01:58.500744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 15:01:58.500744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:58.504706 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 396/787] 10.222.0.76 () {56 vars in 1129 bytes} [Mon May 16 15:01:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:58.506971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf1cea-24bb-457b-bfab-46ca036ae0b3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:58.607537 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c680a-dc8c-4bec-96ab-98d122e8942c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:58.612736 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf1cea-24bb-457b-bfab-46ca036ae0b3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:58.644091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58143b-5d60-4b9f-9b9f-0f3f5c9cec31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:58.645558 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58143b-5d60-4b9f-9b9f-0f3f5c9cec31 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:58.646066 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58143b-5d60-4b9f-9b9f-0f3f5c9cec31 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:58.646584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58143b-5d60-4b9f-9b9f-0f3f5c9cec31 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:58.647910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58143b-5d60-4b9f-9b9f-0f3f5c9cec31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:58.648439 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58143b-5d60-4b9f-9b9f-0f3f5c9cec31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:58.649838 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db20647-d775-452d-a875-6f051369db88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:58.650591 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58143b-5d60-4b9f-9b9f-0f3f5c9cec31 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:58.650944 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db20647-d775-452d-a875-6f051369db88 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:58.651228 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db20647-d775-452d-a875-6f051369db88 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:58.651502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db20647-d775-452d-a875-6f051369db88 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:58.652222 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db20647-d775-452d-a875-6f051369db88 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:58.652529 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db20647-d775-452d-a875-6f051369db88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:58.655055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db20647-d775-452d-a875-6f051369db88 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:58.660183 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 397/788] 10.222.0.76 () {56 vars in 1124 bytes} [Mon May 16 15:01:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:58.661515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3871946-b60d-4839-8a97-9d6a06a65f39 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:58.661934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3871946-b60d-4839-8a97-9d6a06a65f39 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:58.662250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3871946-b60d-4839-8a97-9d6a06a65f39 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:58.663708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 398/789] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:01:58.667728 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 392/790] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:01:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:58.673964 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3871946-b60d-4839-8a97-9d6a06a65f39 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:58.675441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36412a7-5988-4ea7-ab60-65151af12dec None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:58.675967 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36412a7-5988-4ea7-ab60-65151af12dec None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:58.676454 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36412a7-5988-4ea7-ab60-65151af12dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:58.694926 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-f36412a7-5988-4ea7-ab60-65151af12dec None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:58.696643 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f36412a7-5988-4ea7-ab60-65151af12dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:58.774455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 393/791] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:01:58.775213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36412a7-5988-4ea7-ab60-65151af12dec None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:58.821869 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3871946-b60d-4839-8a97-9d6a06a65f39 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:58.856765 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69963c-90b4-45cb-bae7-d973cb389f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:58.857439 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69963c-90b4-45cb-bae7-d973cb389f65 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:58.857723 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69963c-90b4-45cb-bae7-d973cb389f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:58.857997 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69963c-90b4-45cb-bae7-d973cb389f65 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:58.858760 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69963c-90b4-45cb-bae7-d973cb389f65 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:58.859065 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69963c-90b4-45cb-bae7-d973cb389f65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:58.860448 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69963c-90b4-45cb-bae7-d973cb389f65 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:58.865701 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 399/792] 10.222.0.76 () {56 vars in 1124 bytes} [Mon May 16 15:01:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:58.866534 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69963c-90b4-45cb-bae7-d973cb389f65 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:58.876230 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36412a7-5988-4ea7-ab60-65151af12dec None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:58.910844 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ec71f-a80e-4634-a55d-8fffdb1eda90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:58.911747 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ec71f-a80e-4634-a55d-8fffdb1eda90 None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:58.912035 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ec71f-a80e-4634-a55d-8fffdb1eda90 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:58.912310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ec71f-a80e-4634-a55d-8fffdb1eda90 None admin] PATH_INFO: `/v3/projects/681a6490f3c04f9fa2830cfde3deb2e9/users/1a7181297bf14a57b3bf1f3c8b178d3c/roles/f63aad4ab4a04108b87e1bf4ea8dfa53` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:58.927447 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ec71f-a80e-4634-a55d-8fffdb1eda90 None admin] RBAC: Authorizing `identity:create_grant(project_id=681a6490f3c04f9fa2830cfde3deb2e9, user_id=1a7181297bf14a57b3bf1f3c8b178d3c, role_id=f63aad4ab4a04108b87e1bf4ea8dfa53)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:58.928919 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ec71f-a80e-4634-a55d-8fffdb1eda90 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:58.972628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69963c-90b4-45cb-bae7-d973cb389f65 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:59.007409 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d7422-c516-4060-ac21-435a9ec36358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:59.008784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d7422-c516-4060-ac21-435a9ec36358 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:59.009070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d7422-c516-4060-ac21-435a9ec36358 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:59.009636 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d7422-c516-4060-ac21-435a9ec36358 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:59.022275 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 394/793] 10.222.0.76 () {58 vars in 1439 bytes} [Mon May 16 15:01:58 2022] PUT /identity/v3/projects/681a6490f3c04f9fa2830cfde3deb2e9/users/1a7181297bf14a57b3bf1f3c8b178d3c/roles/f63aad4ab4a04108b87e1bf4ea8dfa53 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:01:59.022275 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ec71f-a80e-4634-a55d-8fffdb1eda90 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:59.047619 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d7422-c516-4060-ac21-435a9ec36358 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:59.056430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-9d2d7422-c516-4060-ac21-435a9ec36358 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:01:59.056430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:59.056430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:59.056430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:59.056430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:59.056430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:59.056430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:59.056430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:59.056430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:59.056430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:59.056430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:59.056430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:59.056430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:59.056430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:59.056430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:59.056430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:59.057454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:59.057454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:59.057454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:59.057454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:59.057454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:59.057454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:59.057454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:59.057454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:59.057454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:59.057454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:59.057454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:59.057454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:59.057454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:59.057454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:59.057454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:59.057454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:59.059038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:59.059038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:59.059038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:59.059038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:59.059038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:59.059038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:59.059038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:59.059038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:59.059038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:59.059038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:59.059038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:01:59.059038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:59.059038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 400/794] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:01:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:59.068749 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d7422-c516-4060-ac21-435a9ec36358 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:59.235323 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ec71f-a80e-4634-a55d-8fffdb1eda90 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:59.266341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d7422-c516-4060-ac21-435a9ec36358 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:59.276928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8234b-772f-4a53-bcfd-d42eda3600c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:59.277609 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8234b-772f-4a53-bcfd-d42eda3600c6 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:59.277893 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8234b-772f-4a53-bcfd-d42eda3600c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:59.279961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8234b-772f-4a53-bcfd-d42eda3600c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:59.280745 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8234b-772f-4a53-bcfd-d42eda3600c6 None admin] RBAC: Adding query filter params (interface=public, service_id=af3b163e407440ed9c212d70015e3e8a, region_id=RegionOne) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:59.281072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8234b-772f-4a53-bcfd-d42eda3600c6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:59.282485 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8234b-772f-4a53-bcfd-d42eda3600c6 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:59.291148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 395/795] 10.222.0.76 () {56 vars in 1251 bytes} [Mon May 16 15:01:59 2022] GET /identity/v3/endpoints?service_id=af3b163e407440ed9c212d70015e3e8a&interface=public®ion_id=RegionOne => generated 194 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:59.296524 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8234b-772f-4a53-bcfd-d42eda3600c6 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:59.304840 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e91801-93db-4ebe-b241-a737b25a1eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:59.305483 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e91801-93db-4ebe-b241-a737b25a1eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:59.306291 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e91801-93db-4ebe-b241-a737b25a1eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:59.306747 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e91801-93db-4ebe-b241-a737b25a1eb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:59.308015 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e91801-93db-4ebe-b241-a737b25a1eb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:59.308334 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e91801-93db-4ebe-b241-a737b25a1eb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:59.310218 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e91801-93db-4ebe-b241-a737b25a1eb7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:59.322469 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 401/796] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:01:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:59.329063 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e91801-93db-4ebe-b241-a737b25a1eb7 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:59.424583 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8234b-772f-4a53-bcfd-d42eda3600c6 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:59.462725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260166e-b569-4f68-84a6-e5675c785e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:59.468115 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260166e-b569-4f68-84a6-e5675c785e23 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:59.468115 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260166e-b569-4f68-84a6-e5675c785e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:59.468115 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260166e-b569-4f68-84a6-e5675c785e23 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:59.468115 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260166e-b569-4f68-84a6-e5675c785e23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:59.468115 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260166e-b569-4f68-84a6-e5675c785e23 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:59.472123 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 396/797] 10.222.0.76 () {56 vars in 1087 bytes} [Mon May 16 15:01:59 2022] GET /identity/v3/services => generated 772 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:01:59.594481 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e91801-93db-4ebe-b241-a737b25a1eb7 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:59.631389 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f0bb7-7204-413a-abe9-b9decd9f7abc None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:59.632026 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f0bb7-7204-413a-abe9-b9decd9f7abc None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:59.632509 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f0bb7-7204-413a-abe9-b9decd9f7abc None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:59.635026 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 397/798] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:01:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:01:59.639045 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a96e0-9ba9-4b44-a272-b51dd8185f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:59.639045 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a96e0-9ba9-4b44-a272-b51dd8185f71 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:59.639045 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a96e0-9ba9-4b44-a272-b51dd8185f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:59.639432 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a96e0-9ba9-4b44-a272-b51dd8185f71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:59.640770 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1fb83-2fdf-4ec0-88f2-769b236d5563 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:59.641062 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1fb83-2fdf-4ec0-88f2-769b236d5563 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:59.641339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1fb83-2fdf-4ec0-88f2-769b236d5563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:59.653512 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a96e0-9ba9-4b44-a272-b51dd8185f71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:59.655018 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a96e0-9ba9-4b44-a272-b51dd8185f71 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:59.671267 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0cd1fb83-2fdf-4ec0-88f2-769b236d5563 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:01:59.672470 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0cd1fb83-2fdf-4ec0-88f2-769b236d5563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:01:59.674004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-dd5a96e0-9ba9-4b44-a272-b51dd8185f71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:59.674004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:59.674004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:59.674004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:59.674004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:59.674004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:59.674004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:59.674004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:59.674004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:59.674004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:59.674004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:59.674004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:59.674004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:01:59.674004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:01:59.674004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:01:59.674893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:01:59.674893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:59.674893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:59.674893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:59.674893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:59.674893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:59.674893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:59.674893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:59.674893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:01:59.674893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:59.674893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:59.674893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:59.674893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:59.674893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:59.674893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:59.674893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:59.674893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:59.675808 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:01:59.675808 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:01:59.675808 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:01:59.675808 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:01:59.675808 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 402/799] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:01:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:01:59.682037 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a96e0-9ba9-4b44-a272-b51dd8185f71 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:59.755448 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 398/800] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:01:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:01:59.781546 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1fb83-2fdf-4ec0-88f2-769b236d5563 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:59.810839 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a96e0-9ba9-4b44-a272-b51dd8185f71 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:59.848739 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f71bc-c31a-4d8a-a92f-014fe6873abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:59.849341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f71bc-c31a-4d8a-a92f-014fe6873abc None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:59.849624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f71bc-c31a-4d8a-a92f-014fe6873abc None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:59.849899 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f71bc-c31a-4d8a-a92f-014fe6873abc None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:59.850664 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f71bc-c31a-4d8a-a92f-014fe6873abc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:01:59.850971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f71bc-c31a-4d8a-a92f-014fe6873abc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:01:59.852385 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f71bc-c31a-4d8a-a92f-014fe6873abc None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:01:59.864016 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 403/801] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:01:59.870805 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f71bc-c31a-4d8a-a92f-014fe6873abc None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:01:59.933083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1fb83-2fdf-4ec0-88f2-769b236d5563 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:01:59.974322 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42212003-aaf0-4c01-8698-e3a15b386c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:01:59.975168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42212003-aaf0-4c01-8698-e3a15b386c87 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:01:59.975455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42212003-aaf0-4c01-8698-e3a15b386c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:01:59.975730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42212003-aaf0-4c01-8698-e3a15b386c87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:01:59.986874 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42212003-aaf0-4c01-8698-e3a15b386c87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:01:59.994622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-42212003-aaf0-4c01-8698-e3a15b386c87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:01:59.994622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:01:59.994622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:01:59.994622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:01:59.994622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:01:59.994622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:01:59.994622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:01:59.994622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:01:59.994622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:01:59.994622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:01:59.994622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:01:59.994622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:01:59.994622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:01:59.994622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:01:59.994622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:01:59.994622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:01:59.995604 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:01:59.995604 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:01:59.995604 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:01:59.995604 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:01:59.995604 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:01:59.995604 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:01:59.995604 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:01:59.995604 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:01:59.995604 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:01:59.995604 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:01:59.995604 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:01:59.995604 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:01:59.995604 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:01:59.995604 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:01:59.995604 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:01:59.995604 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:01:59.996473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:01:59.996473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:01:59.996473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:01:59.996473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:01:59.996473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:01:59.996473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:01:59.996473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:01:59.996473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:01:59.996473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:01:59.996473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:01:59.996473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:01:59.996473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:01:59.996473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 399/802] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:01:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:02:00.001968 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42212003-aaf0-4c01-8698-e3a15b386c87 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:00.076609 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f71bc-c31a-4d8a-a92f-014fe6873abc None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:00.143149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8d91d-12cf-4e25-a552-eeb4d0adce32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:00.143954 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8d91d-12cf-4e25-a552-eeb4d0adce32 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:00.144238 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8d91d-12cf-4e25-a552-eeb4d0adce32 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:00.144514 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8d91d-12cf-4e25-a552-eeb4d0adce32 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:00.159521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd8d91d-12cf-4e25-a552-eeb4d0adce32 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:00.160979 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd8d91d-12cf-4e25-a552-eeb4d0adce32 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:00.186508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-5dd8d91d-12cf-4e25-a552-eeb4d0adce32 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 15:02:00.186508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:00.186508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:00.186508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:00.186508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:00.186508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:00.186508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:00.186508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:00.186508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:00.186508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:00.186508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:00.186508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:00.186508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:02:00.186508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:02:00.186508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:02:00.186508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:02:00.187510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:00.187510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:00.187510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:02:00.187510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:02:00.187510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:02:00.187510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:02:00.187510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:00.187510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:00.187510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:00.187510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:00.187510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:00.187510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:00.187510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:00.187510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:00.187510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:00.187510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:00.187510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:00.187510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:00.188470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:00.188470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:00.188470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:02:00.188470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:02:00.188470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:02:00.188470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:02:00.188470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:02:00.188470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:02:00.188470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 15:02:00.188470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:00.188470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 404/803] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:01:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:00.189086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42212003-aaf0-4c01-8698-e3a15b386c87 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:00.197035 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8d91d-12cf-4e25-a552-eeb4d0adce32 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:00.260145 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509acba-e64d-4806-b850-5cf1e051d9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:00.260824 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509acba-e64d-4806-b850-5cf1e051d9fa None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:00.261106 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509acba-e64d-4806-b850-5cf1e051d9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:00.265540 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509acba-e64d-4806-b850-5cf1e051d9fa None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:00.266447 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509acba-e64d-4806-b850-5cf1e051d9fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:00.266772 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509acba-e64d-4806-b850-5cf1e051d9fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:00.268152 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509acba-e64d-4806-b850-5cf1e051d9fa None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:00.283661 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 400/804] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:02:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:00.291152 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509acba-e64d-4806-b850-5cf1e051d9fa None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:00.341388 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8d91d-12cf-4e25-a552-eeb4d0adce32 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:00.378977 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c0d0f-7a1a-4cde-bb50-aba480f9dbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:00.379647 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c0d0f-7a1a-4cde-bb50-aba480f9dbf0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:00.379925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c0d0f-7a1a-4cde-bb50-aba480f9dbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:00.380197 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c0d0f-7a1a-4cde-bb50-aba480f9dbf0 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:00.381029 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c0d0f-7a1a-4cde-bb50-aba480f9dbf0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:00.381330 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c0d0f-7a1a-4cde-bb50-aba480f9dbf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:00.382784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c0d0f-7a1a-4cde-bb50-aba480f9dbf0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:00.422384 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 405/805] 10.222.0.76 () {56 vars in 1135 bytes} [Mon May 16 15:02:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:00.424868 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c0d0f-7a1a-4cde-bb50-aba480f9dbf0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:00.497213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509acba-e64d-4806-b850-5cf1e051d9fa None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:00.575910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0e1f8-18af-45cb-86d3-121f66f74475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:00.577117 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0e1f8-18af-45cb-86d3-121f66f74475 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:00.577614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0e1f8-18af-45cb-86d3-121f66f74475 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:00.578110 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0e1f8-18af-45cb-86d3-121f66f74475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:00.591317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0e1f8-18af-45cb-86d3-121f66f74475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:00.593770 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0e1f8-18af-45cb-86d3-121f66f74475 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:00.615277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-bea0e1f8-18af-45cb-86d3-121f66f74475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:00.615277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:00.615277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:00.615277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:00.615277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:00.615277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:00.615277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:00.615277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:00.615277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:00.615277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:00.615277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:00.615277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:00.615277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:02:00.615277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:02:00.615277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:02:00.616242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:02:00.616242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:00.616242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:00.616242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:00.616242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:00.616242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:00.616242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:00.616242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:00.616242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:00.616242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:00.616242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:00.616242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:00.616242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:00.616242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:00.616242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:00.616242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:00.616242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:00.617134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:02:00.617134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:02:00.617134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:00.617134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:00.619829 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 401/806] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:00.625228 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0e1f8-18af-45cb-86d3-121f66f74475 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:00.640622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c0d0f-7a1a-4cde-bb50-aba480f9dbf0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:00.706213 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c087635-654b-4586-bf52-20203c7d88f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:00.706928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c087635-654b-4586-bf52-20203c7d88f7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:00.707206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c087635-654b-4586-bf52-20203c7d88f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:00.707476 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c087635-654b-4586-bf52-20203c7d88f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:00.725377 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c087635-654b-4586-bf52-20203c7d88f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:00.727431 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c087635-654b-4586-bf52-20203c7d88f7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:00.761878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-0c087635-654b-4586-bf52-20203c7d88f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:00.761878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:00.761878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:00.761878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:00.761878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:00.761878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:00.761878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:00.761878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:00.761878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:00.761878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:00.761878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:00.761878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:00.761878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:02:00.761878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:02:00.761878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:02:00.762971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:02:00.762971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:00.762971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:00.762971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:00.762971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:00.762971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:00.762971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:00.762971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:00.762971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:00.762971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:00.762971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:00.762971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:00.762971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:00.762971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:00.762971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:00.762971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:00.762971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:00.763881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:02:00.763881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:02:00.763881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:00.763881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:00.777978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 406/807] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:00.778992 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c087635-654b-4586-bf52-20203c7d88f7 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:00.826389 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0e1f8-18af-45cb-86d3-121f66f74475 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:00.860863 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0887ea3-5530-49fe-8bd2-13c29f257dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:00.861528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0887ea3-5530-49fe-8bd2-13c29f257dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:00.861805 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0887ea3-5530-49fe-8bd2-13c29f257dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:00.862079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0887ea3-5530-49fe-8bd2-13c29f257dc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:00.862894 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0887ea3-5530-49fe-8bd2-13c29f257dc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:00.863196 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0887ea3-5530-49fe-8bd2-13c29f257dc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:00.864560 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0887ea3-5530-49fe-8bd2-13c29f257dc2 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:00.877278 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 402/808] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:00.882809 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0887ea3-5530-49fe-8bd2-13c29f257dc2 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:00.989413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c087635-654b-4586-bf52-20203c7d88f7 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:01.027334 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0887ea3-5530-49fe-8bd2-13c29f257dc2 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:01.028541 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b884db-caed-48be-b577-e16ed5305ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:01.029217 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b884db-caed-48be-b577-e16ed5305ecf None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:01.029495 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b884db-caed-48be-b577-e16ed5305ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:01.029766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b884db-caed-48be-b577-e16ed5305ecf None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:01.030726 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b884db-caed-48be-b577-e16ed5305ecf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:01.031087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b884db-caed-48be-b577-e16ed5305ecf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:01.033366 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b884db-caed-48be-b577-e16ed5305ecf None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:01.051981 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 407/809] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:01.051981 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9ffc2-d700-4678-9a0b-de605661d12b None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:01.051981 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9ffc2-d700-4678-9a0b-de605661d12b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:01.051981 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9ffc2-d700-4678-9a0b-de605661d12b None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:01.051981 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 408/810] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:01.052882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9ffc2-d700-4678-9a0b-de605661d12b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:01.073796 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a096fb-3ef3-4a1c-aa7a-4a220db4102e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:01.075039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a096fb-3ef3-4a1c-aa7a-4a220db4102e None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:01.075572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a096fb-3ef3-4a1c-aa7a-4a220db4102e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:01.076093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a096fb-3ef3-4a1c-aa7a-4a220db4102e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:01.083946 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a096fb-3ef3-4a1c-aa7a-4a220db4102e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:01.085810 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a096fb-3ef3-4a1c-aa7a-4a220db4102e None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:01.102185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-51a096fb-3ef3-4a1c-aa7a-4a220db4102e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 15:02:01.102185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:01.102185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:01.102185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:01.102185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:01.102185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:01.102185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:01.102185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:01.102185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:01.102185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:01.102185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:01.102185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:01.102185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:02:01.102185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:02:01.102185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:02:01.102185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:02:01.103189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:01.103189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:01.103189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:02:01.103189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:02:01.103189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:02:01.103189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:02:01.103189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:01.103189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:01.103189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:01.103189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:01.103189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:01.103189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:01.103189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:01.103189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:01.103189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:01.103189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:01.103189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:01.103189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:01.104168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:01.104168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:01.104168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:02:01.104168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:02:01.104168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:02:01.104168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:02:01.104168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:02:01.104168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:02:01.104168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 15:02:01.104168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:01.106884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 403/811] 10.222.0.76 () {56 vars in 1093 bytes} [Mon May 16 15:02:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:01.108453 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f109b27-c52e-48f2-8b7e-6b7ed69b2f28 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:01.108955 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f109b27-c52e-48f2-8b7e-6b7ed69b2f28 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:01.109440 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f109b27-c52e-48f2-8b7e-6b7ed69b2f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:01.129147 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-3f109b27-c52e-48f2-8b7e-6b7ed69b2f28 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:01.130760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3f109b27-c52e-48f2-8b7e-6b7ed69b2f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:01.181930 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9ffc2-d700-4678-9a0b-de605661d12b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:01.199217 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 404/812] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:01.200520 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f109b27-c52e-48f2-8b7e-6b7ed69b2f28 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:01.222510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba85331-d978-4ae8-957b-b8913705db5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:01.223306 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba85331-d978-4ae8-957b-b8913705db5a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:01.223587 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba85331-d978-4ae8-957b-b8913705db5a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:01.223858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba85331-d978-4ae8-957b-b8913705db5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:01.233579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba85331-d978-4ae8-957b-b8913705db5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:01.235321 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba85331-d978-4ae8-957b-b8913705db5a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:01.254682 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-6ba85331-d978-4ae8-957b-b8913705db5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:02:01.254682 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:01.254682 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:01.254682 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:01.254682 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:01.254682 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:01.254682 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:01.254682 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:01.254682 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:01.254682 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:01.254682 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:01.254682 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:01.254682 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:02:01.254682 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:02:01.254682 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:02:01.255597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:02:01.255597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:01.255597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:01.255597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:01.255597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:01.255597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:01.255597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:01.255597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:01.255597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:01.255597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:01.255597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:01.255597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:01.255597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:01.255597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:01.255597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:01.255597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:01.255597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:01.256518 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:02:01.256518 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:02:01.256518 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:02:01.256518 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:02:01.256518 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:02:01.256518 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:02:01.256518 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:02:01.256518 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:01.257405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 409/813] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:02:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:01.262207 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba85331-d978-4ae8-957b-b8913705db5a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:01.313814 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f109b27-c52e-48f2-8b7e-6b7ed69b2f28 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:01.348731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16682a61-d656-44eb-a1e4-fbfc82bcbb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:01.349779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16682a61-d656-44eb-a1e4-fbfc82bcbb6b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:01.350303 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16682a61-d656-44eb-a1e4-fbfc82bcbb6b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:01.350796 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16682a61-d656-44eb-a1e4-fbfc82bcbb6b None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:01.351874 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16682a61-d656-44eb-a1e4-fbfc82bcbb6b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:01.352397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16682a61-d656-44eb-a1e4-fbfc82bcbb6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:01.354037 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16682a61-d656-44eb-a1e4-fbfc82bcbb6b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:01.372223 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 405/814] 10.222.0.76 () {56 vars in 1133 bytes} [Mon May 16 15:02:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:01.373353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16682a61-d656-44eb-a1e4-fbfc82bcbb6b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:01.388366 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba85331-d978-4ae8-957b-b8913705db5a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:01.423224 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bbb7f-f598-4b32-9310-28cc716638cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:01.424388 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bbb7f-f598-4b32-9310-28cc716638cb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:01.424876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bbb7f-f598-4b32-9310-28cc716638cb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:01.425364 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bbb7f-f598-4b32-9310-28cc716638cb None admin] PATH_INFO: `/v3/services/network` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:01.426422 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bbb7f-f598-4b32-9310-28cc716638cb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:01.428035 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bbb7f-f598-4b32-9310-28cc716638cb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:01.441348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e12bbb7f-f598-4b32-9310-28cc716638cb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 15:02:01.441348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:01.441348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 15:02:01.441348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 15:02:01.441348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 15:02:01.441348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 15:02:01.441348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 15:02:01.441348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:01.441348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 15:02:01.441348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:01.441348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:02:01.441348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:01.441348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:01.441348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:01.441348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:01.441348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:01.441348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:01.442403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:01.442403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:01.442403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:01.442403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:01.442403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:01.442403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:01.442403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 15:02:01.442403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 15:02:01.442403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 15:02:01.442403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 15:02:01.442403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:01.442403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:01.442403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:01.442403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:01.442403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:01.442403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:01.443246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:01.443246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:01.443246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:01.443246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:01.443246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:01.443246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:01.443246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:01.443246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:01.443246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:01.443246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:01.443246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 15:02:01.443246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:01.443246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 15:02:01.443246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:01.446740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 410/815] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:02:01 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:01.447873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bbb7f-f598-4b32-9310-28cc716638cb None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:01.496796 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16682a61-d656-44eb-a1e4-fbfc82bcbb6b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:01.534288 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337052fe-5164-4b69-a8b6-7009d7ed57e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:01.535325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337052fe-5164-4b69-a8b6-7009d7ed57e1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:01.535824 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337052fe-5164-4b69-a8b6-7009d7ed57e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:01.536321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337052fe-5164-4b69-a8b6-7009d7ed57e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:01.537353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337052fe-5164-4b69-a8b6-7009d7ed57e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:01.538020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337052fe-5164-4b69-a8b6-7009d7ed57e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:01.540413 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337052fe-5164-4b69-a8b6-7009d7ed57e1 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:01.558257 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 406/816] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:02:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:01.559558 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337052fe-5164-4b69-a8b6-7009d7ed57e1 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:01.566212 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bbb7f-f598-4b32-9310-28cc716638cb None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:01.605936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf22d0-9ad8-4d76-b141-1d816f839afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:01.606985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf22d0-9ad8-4d76-b141-1d816f839afe None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:01.607507 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf22d0-9ad8-4d76-b141-1d816f839afe None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:01.607982 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf22d0-9ad8-4d76-b141-1d816f839afe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:01.676170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf22d0-9ad8-4d76-b141-1d816f839afe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:01.678563 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf22d0-9ad8-4d76-b141-1d816f839afe None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:01.685816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337052fe-5164-4b69-a8b6-7009d7ed57e1 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:01.717903 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfaa3d-2224-4b24-8ba7-73e3497ce9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:01.718596 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfaa3d-2224-4b24-8ba7-73e3497ce9c5 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:01.718874 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfaa3d-2224-4b24-8ba7-73e3497ce9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:01.719149 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfaa3d-2224-4b24-8ba7-73e3497ce9c5 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:01.719846 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfaa3d-2224-4b24-8ba7-73e3497ce9c5 None admin] RBAC: Adding query filter params (name=network) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:01.720149 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfaa3d-2224-4b24-8ba7-73e3497ce9c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:01.721535 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfaa3d-2224-4b24-8ba7-73e3497ce9c5 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:01.725837 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 407/817] 10.222.0.76 () {56 vars in 1112 bytes} [Mon May 16 15:02:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:01.727270 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfaa3d-2224-4b24-8ba7-73e3497ce9c5 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:01.778044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 411/818] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:02:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 15:02:01.779752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048dcc4-cf4f-4096-9b26-8f1f4c8de602 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:01.780189 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048dcc4-cf4f-4096-9b26-8f1f4c8de602 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:01.780601 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048dcc4-cf4f-4096-9b26-8f1f4c8de602 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:01.782243 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 412/819] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:01.783061 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048dcc4-cf4f-4096-9b26-8f1f4c8de602 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:01.840277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfaa3d-2224-4b24-8ba7-73e3497ce9c5 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:01.873188 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baddd5-77e3-4123-9ae0-e2e5245ea620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:01.874322 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baddd5-77e3-4123-9ae0-e2e5245ea620 None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:01.874773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baddd5-77e3-4123-9ae0-e2e5245ea620 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:01.875044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baddd5-77e3-4123-9ae0-e2e5245ea620 None admin] PATH_INFO: `/v3/projects/681a6490f3c04f9fa2830cfde3deb2e9/users/33470e30760842ca9e96bb7f0cf9f07d/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:01.876989 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baddd5-77e3-4123-9ae0-e2e5245ea620 None admin] RBAC: Authorizing `identity:create_grant(project_id=681a6490f3c04f9fa2830cfde3deb2e9, user_id=33470e30760842ca9e96bb7f0cf9f07d, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:01.878708 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baddd5-77e3-4123-9ae0-e2e5245ea620 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:01.881237 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048dcc4-cf4f-4096-9b26-8f1f4c8de602 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:01.916436 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf63ed-da23-4dc8-aeb9-0383d1b8bb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:01.917118 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf63ed-da23-4dc8-aeb9-0383d1b8bb65 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:01.917399 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf63ed-da23-4dc8-aeb9-0383d1b8bb65 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:01.917670 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf63ed-da23-4dc8-aeb9-0383d1b8bb65 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:01.918456 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf63ed-da23-4dc8-aeb9-0383d1b8bb65 None admin] RBAC: Adding query filter params (type=network) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:01.918756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf63ed-da23-4dc8-aeb9-0383d1b8bb65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:01.920173 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf63ed-da23-4dc8-aeb9-0383d1b8bb65 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:01.925891 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 413/820] 10.222.0.76 () {56 vars in 1112 bytes} [Mon May 16 15:02:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:01.926794 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf63ed-da23-4dc8-aeb9-0383d1b8bb65 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:02.006178 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 408/821] 10.222.0.76 () {58 vars in 1439 bytes} [Mon May 16 15:02:01 2022] PUT /identity/v3/projects/681a6490f3c04f9fa2830cfde3deb2e9/users/33470e30760842ca9e96bb7f0cf9f07d/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:02:02.006178 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869843a-3183-4fbb-9b8c-d88414ce2355 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:02.006178 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869843a-3183-4fbb-9b8c-d88414ce2355 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:02.006178 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869843a-3183-4fbb-9b8c-d88414ce2355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:02.019797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0869843a-3183-4fbb-9b8c-d88414ce2355 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:02.021155 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0869843a-3183-4fbb-9b8c-d88414ce2355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:02.042762 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf63ed-da23-4dc8-aeb9-0383d1b8bb65 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:02.092290 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a10d1a-0791-4eed-8fa7-d89c307c3894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:02.093656 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a10d1a-0791-4eed-8fa7-d89c307c3894 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:02.094173 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a10d1a-0791-4eed-8fa7-d89c307c3894 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:02.094634 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a10d1a-0791-4eed-8fa7-d89c307c3894 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:02.095103 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 409/822] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:02.096058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869843a-3183-4fbb-9b8c-d88414ce2355 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:02.110487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a10d1a-0791-4eed-8fa7-d89c307c3894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:02.113870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a10d1a-0791-4eed-8fa7-d89c307c3894 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:02.143766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-41a10d1a-0791-4eed-8fa7-d89c307c3894 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:02.143766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:02.143766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:02.143766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:02.143766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:02.143766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:02.143766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:02.143766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:02.143766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:02.143766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:02.143766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:02.143766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:02.143766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:02:02.143766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:02:02.143766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:02:02.144786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:02:02.144786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:02.144786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:02.144786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:02.144786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:02.144786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:02.144786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:02.144786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:02.144786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:02.144786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:02.144786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:02.144786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:02.144786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:02.144786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:02.144786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:02.144786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:02.144786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:02.145681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:02:02.145681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:02:02.145681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:02.145681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:02.145681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 414/823] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:02.146554 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8de254-7df0-4067-ace1-17af2a50ed1f None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:02.146754 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8de254-7df0-4067-ace1-17af2a50ed1f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:02.146990 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8de254-7df0-4067-ace1-17af2a50ed1f None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:02.149047 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 415/824] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:02.149703 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8de254-7df0-4067-ace1-17af2a50ed1f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:02.220463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869843a-3183-4fbb-9b8c-d88414ce2355 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:02.253858 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254dd0e7-fb04-4ba3-b1e5-130401772d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:02.254546 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dd0e7-fb04-4ba3-b1e5-130401772d99 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:02.254821 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dd0e7-fb04-4ba3-b1e5-130401772d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:02.255093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dd0e7-fb04-4ba3-b1e5-130401772d99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:02.255825 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254dd0e7-fb04-4ba3-b1e5-130401772d99 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:02.257177 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254dd0e7-fb04-4ba3-b1e5-130401772d99 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:02.258622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8de254-7df0-4067-ace1-17af2a50ed1f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:02.291485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabd7ef-1c6c-42f7-9321-590b9ad9faea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:02.292303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabd7ef-1c6c-42f7-9321-590b9ad9faea None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:02.292586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabd7ef-1c6c-42f7-9321-590b9ad9faea None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:02.292859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabd7ef-1c6c-42f7-9321-590b9ad9faea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:02.302843 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabd7ef-1c6c-42f7-9321-590b9ad9faea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:02:02.311147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-fcabd7ef-1c6c-42f7-9321-590b9ad9faea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 15:02:02.311147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:02.311147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:02.311147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:02.311147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:02.311147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:02.311147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:02.311147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:02.311147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:02.311147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:02.311147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:02.311147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:02.311147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:02:02.311147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:02:02.311147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:02:02.311147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:02:02.312093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:02:02.312093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:02:02.312093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:02:02.312093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:02:02.312093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:02.312093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:02.312093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:02.312093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:02.312093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:02.312093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:02.312093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:02.312093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:02.312093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:02.312093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:02.312093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:02.312093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:02.312958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:02.312958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:02.312958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:02.312958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:02.312958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:02:02.312958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:02:02.312958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:02:02.312958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:02:02.312958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:02:02.312958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:02:02.312958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 15:02:02.312958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:02.312958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 416/825] 10.222.0.76 () {56 vars in 1102 bytes} [Mon May 16 15:02:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:02.313662 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabd7ef-1c6c-42f7-9321-590b9ad9faea None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:02.355771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 410/826] 10.222.0.76 () {60 vars in 1144 bytes} [Mon May 16 15:02:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:02:02.355771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffdb65-0c31-4ea4-9a25-177d01ec0c12 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:02.355771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffdb65-0c31-4ea4-9a25-177d01ec0c12 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:02.355771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffdb65-0c31-4ea4-9a25-177d01ec0c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:02.368472 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0cffdb65-0c31-4ea4-9a25-177d01ec0c12 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:02.369849 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0cffdb65-0c31-4ea4-9a25-177d01ec0c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:02.444221 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabd7ef-1c6c-42f7-9321-590b9ad9faea None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:02.452617 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 411/827] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:02.454283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffdb65-0c31-4ea4-9a25-177d01ec0c12 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:02.499251 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc814d-4995-4d42-9f81-7215c230520d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:02.500684 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc814d-4995-4d42-9f81-7215c230520d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:02.501146 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc814d-4995-4d42-9f81-7215c230520d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:02.501434 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc814d-4995-4d42-9f81-7215c230520d None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:02.502865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc814d-4995-4d42-9f81-7215c230520d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:02.503525 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc814d-4995-4d42-9f81-7215c230520d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:02.505013 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc814d-4995-4d42-9f81-7215c230520d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:02.520923 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 417/828] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:02.521805 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc814d-4995-4d42-9f81-7215c230520d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:02.593245 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffdb65-0c31-4ea4-9a25-177d01ec0c12 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:02.637362 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b576b-ca07-40d7-9d05-b56e7117429c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:02.638042 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b576b-ca07-40d7-9d05-b56e7117429c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:02.638358 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b576b-ca07-40d7-9d05-b56e7117429c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:02.638633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b576b-ca07-40d7-9d05-b56e7117429c None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:02.639387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b576b-ca07-40d7-9d05-b56e7117429c None admin] RBAC: Adding query filter params (name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:02.639698 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b576b-ca07-40d7-9d05-b56e7117429c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:02.641083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b576b-ca07-40d7-9d05-b56e7117429c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:02.651347 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 412/829] 10.222.0.76 () {56 vars in 1103 bytes} [Mon May 16 15:02:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:02.652547 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b576b-ca07-40d7-9d05-b56e7117429c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:02.660128 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc814d-4995-4d42-9f81-7215c230520d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:02.692801 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa301e-9e33-4ece-ae1d-3395a7f3ba6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:02.693604 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa301e-9e33-4ece-ae1d-3395a7f3ba6a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:02.693889 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa301e-9e33-4ece-ae1d-3395a7f3ba6a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:02.694190 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa301e-9e33-4ece-ae1d-3395a7f3ba6a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:02.694854 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa301e-9e33-4ece-ae1d-3395a7f3ba6a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:02.696263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa301e-9e33-4ece-ae1d-3395a7f3ba6a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:02.708107 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e5aa301e-9e33-4ece-ae1d-3395a7f3ba6a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 15:02:02.708107 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:02.708107 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 15:02:02.708107 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 15:02:02.708107 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 15:02:02.708107 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 15:02:02.708107 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 15:02:02.708107 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:02.708107 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 15:02:02.708107 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:02.708107 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:02:02.708107 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:02.708107 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:02.708107 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:02.708107 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:02.708107 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:02.709196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:02.709196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:02.709196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:02.709196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:02.709196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:02.709196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:02.709196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:02.709196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 15:02:02.709196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 15:02:02.709196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 15:02:02.709196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 15:02:02.709196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:02.709196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:02.709196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:02.709196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:02.709196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:02.710023 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:02.710023 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:02.710023 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:02.710023 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:02.710023 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:02.710023 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:02.710023 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:02.710023 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:02.710023 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:02.710023 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:02.710023 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:02.710023 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 15:02:02.710023 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:02.710023 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 15:02:02.710023 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:02.712611 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 418/830] 10.222.0.76 () {56 vars in 1129 bytes} [Mon May 16 15:02:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:02.713296 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa301e-9e33-4ece-ae1d-3395a7f3ba6a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:02.755489 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b576b-ca07-40d7-9d05-b56e7117429c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:02.787669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72d1ce-c98d-422b-8ffd-601ce1357a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:02.788806 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72d1ce-c98d-422b-8ffd-601ce1357a78 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:02.789454 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72d1ce-c98d-422b-8ffd-601ce1357a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:02.789947 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72d1ce-c98d-422b-8ffd-601ce1357a78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:02.796865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72d1ce-c98d-422b-8ffd-601ce1357a78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:02.798549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72d1ce-c98d-422b-8ffd-601ce1357a78 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:02.810565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa301e-9e33-4ece-ae1d-3395a7f3ba6a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:02.813233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-8c72d1ce-c98d-422b-8ffd-601ce1357a78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:02:02.813233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:02.813233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:02.813233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:02.813233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:02.813233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:02.813233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:02.813233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:02.813233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:02.813233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:02.813233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:02.813233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:02.813233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:02:02.813233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:02:02.813233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:02:02.814189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:02:02.814189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:02.814189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:02.814189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:02.814189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:02.814189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:02.814189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:02.814189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:02.814189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:02.814189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:02.814189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:02.814189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:02.814189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:02.814189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:02.814189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:02.814189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:02.814189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:02.815117 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:02:02.815117 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:02:02.815117 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:02:02.815117 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:02:02.815117 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:02:02.815117 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:02:02.815117 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:02:02.815117 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:02.818277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 413/831] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:02:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:02.819364 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72d1ce-c98d-422b-8ffd-601ce1357a78 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:02.844637 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c97b6-b87a-4eae-b358-5ff7c95873c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:02.845428 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c97b6-b87a-4eae-b358-5ff7c95873c1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:02.845712 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c97b6-b87a-4eae-b358-5ff7c95873c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:02.845985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c97b6-b87a-4eae-b358-5ff7c95873c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:02.856446 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c97b6-b87a-4eae-b358-5ff7c95873c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:02.857896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c97b6-b87a-4eae-b358-5ff7c95873c1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:02.875297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-ca4c97b6-b87a-4eae-b358-5ff7c95873c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:02.875297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:02.875297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:02.875297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:02.875297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:02.875297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:02.875297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:02.875297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:02.875297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:02.875297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:02.875297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:02.875297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:02.875297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:02:02.875297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:02:02.875297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:02:02.876226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:02:02.876226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:02.876226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:02.876226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:02.876226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:02.876226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:02.876226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:02.876226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:02.876226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:02.876226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:02.876226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:02.876226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:02.876226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:02.876226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:02.876226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:02.876226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:02.876226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:02.877116 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:02:02.877116 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:02:02.877116 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:02.877116 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:02.877116 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 419/832] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:02.877405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c97b6-b87a-4eae-b358-5ff7c95873c1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:02.925818 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72d1ce-c98d-422b-8ffd-601ce1357a78 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:02.959294 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb52aa9-9af2-4f77-b86b-d4b0a5c3f214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:02.959952 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb52aa9-9af2-4f77-b86b-d4b0a5c3f214 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:02.960233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb52aa9-9af2-4f77-b86b-d4b0a5c3f214 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:02.960509 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb52aa9-9af2-4f77-b86b-d4b0a5c3f214 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:02.961741 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb52aa9-9af2-4f77-b86b-d4b0a5c3f214 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:02.962046 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb52aa9-9af2-4f77-b86b-d4b0a5c3f214 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:02.963449 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb52aa9-9af2-4f77-b86b-d4b0a5c3f214 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:02.972376 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 414/833] 10.222.0.76 () {56 vars in 1124 bytes} [Mon May 16 15:02:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:02.972376 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb52aa9-9af2-4f77-b86b-d4b0a5c3f214 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:02.982538 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c97b6-b87a-4eae-b358-5ff7c95873c1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:03.016161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36ae8c-e4cf-4d8a-940b-5002bccaed40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:03.016805 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36ae8c-e4cf-4d8a-940b-5002bccaed40 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:03.017092 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36ae8c-e4cf-4d8a-940b-5002bccaed40 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:03.017364 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36ae8c-e4cf-4d8a-940b-5002bccaed40 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:03.018169 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36ae8c-e4cf-4d8a-940b-5002bccaed40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:03.018486 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36ae8c-e4cf-4d8a-940b-5002bccaed40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:03.019902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36ae8c-e4cf-4d8a-940b-5002bccaed40 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:03.034236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 420/834] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:02:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:03.034236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36ae8c-e4cf-4d8a-940b-5002bccaed40 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:03.071827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb52aa9-9af2-4f77-b86b-d4b0a5c3f214 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:03.104498 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61675194-4cf4-4675-980b-63a2adfeda37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:03.105153 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61675194-4cf4-4675-980b-63a2adfeda37 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:03.105431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61675194-4cf4-4675-980b-63a2adfeda37 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:03.105703 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61675194-4cf4-4675-980b-63a2adfeda37 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:03.106445 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61675194-4cf4-4675-980b-63a2adfeda37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:03.106745 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61675194-4cf4-4675-980b-63a2adfeda37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:03.108109 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61675194-4cf4-4675-980b-63a2adfeda37 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:03.123092 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 415/835] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:03.123092 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61675194-4cf4-4675-980b-63a2adfeda37 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:03.136812 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36ae8c-e4cf-4d8a-940b-5002bccaed40 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:03.171714 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67a04e-1ad6-4e89-83bf-8f4e8d85daeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:03.172377 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67a04e-1ad6-4e89-83bf-8f4e8d85daeb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:03.172656 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67a04e-1ad6-4e89-83bf-8f4e8d85daeb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:03.172927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67a04e-1ad6-4e89-83bf-8f4e8d85daeb None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:03.173630 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a67a04e-1ad6-4e89-83bf-8f4e8d85daeb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:03.173934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a67a04e-1ad6-4e89-83bf-8f4e8d85daeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:03.175339 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a67a04e-1ad6-4e89-83bf-8f4e8d85daeb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:03.180152 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 421/836] 10.222.0.76 () {56 vars in 1124 bytes} [Mon May 16 15:02:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:03.180861 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67a04e-1ad6-4e89-83bf-8f4e8d85daeb None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:03.229497 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61675194-4cf4-4675-980b-63a2adfeda37 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:03.262654 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cce05e-8de4-4076-a9d6-bafeb7365b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:03.263312 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cce05e-8de4-4076-a9d6-bafeb7365b79 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:03.263600 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cce05e-8de4-4076-a9d6-bafeb7365b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:03.263867 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cce05e-8de4-4076-a9d6-bafeb7365b79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:03.264695 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cce05e-8de4-4076-a9d6-bafeb7365b79 None admin] RBAC: Adding query filter params (role.id=f6c8fc0dc0f24de3907b0960a1201901, scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9, user.id=9d85024f010c40129d79543b3ec4cfae) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:03.265011 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cce05e-8de4-4076-a9d6-bafeb7365b79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:03.266471 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cce05e-8de4-4076-a9d6-bafeb7365b79 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:03.282159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 416/837] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:02:03 2022] GET /identity/v3/role_assignments?user.id=9d85024f010c40129d79543b3ec4cfae&scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9&role.id=f6c8fc0dc0f24de3907b0960a1201901 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:03.282159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cce05e-8de4-4076-a9d6-bafeb7365b79 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:03.306956 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67a04e-1ad6-4e89-83bf-8f4e8d85daeb None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:03.346387 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca3202-5cb2-463c-af63-95a2f5c077f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:03.347214 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca3202-5cb2-463c-af63-95a2f5c077f8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:03.347495 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca3202-5cb2-463c-af63-95a2f5c077f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:03.347774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca3202-5cb2-463c-af63-95a2f5c077f8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:03.357614 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca3202-5cb2-463c-af63-95a2f5c077f8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:03.359156 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca3202-5cb2-463c-af63-95a2f5c077f8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:03.376040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d9ca3202-5cb2-463c-af63-95a2f5c077f8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 15:02:03.376040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:03.376040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:03.376040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:03.376040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:03.376040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:03.376040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:03.376040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:03.376040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:03.376040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:03.376040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:03.376040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:03.376040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:02:03.376040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:02:03.376040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:02:03.376040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:02:03.377246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:03.377246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:03.377246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:02:03.377246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:02:03.377246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:02:03.377246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:02:03.377246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:03.377246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:03.377246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:03.377246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:03.377246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:03.377246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:03.377246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:03.377246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:03.377246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:03.377246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:03.377246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:03.377246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:03.378715 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:03.378715 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:03.378715 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:02:03.378715 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:02:03.378715 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:02:03.378715 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:02:03.378715 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:02:03.378715 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:02:03.378715 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 15:02:03.378715 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:03.382322 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 422/838] 10.222.0.76 () {56 vars in 1117 bytes} [Mon May 16 15:02:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:03.383324 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca3202-5cb2-463c-af63-95a2f5c077f8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:03.401471 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cce05e-8de4-4076-a9d6-bafeb7365b79 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:03.437881 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540455a-fb93-4297-bd3d-4526072b4bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:03.438640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540455a-fb93-4297-bd3d-4526072b4bff None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:03.439017 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540455a-fb93-4297-bd3d-4526072b4bff None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:03.439408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540455a-fb93-4297-bd3d-4526072b4bff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:03.440253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540455a-fb93-4297-bd3d-4526072b4bff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:03.441739 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540455a-fb93-4297-bd3d-4526072b4bff None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:03.492675 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca3202-5cb2-463c-af63-95a2f5c077f8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:03.525506 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 417/839] 10.222.0.76 () {60 vars in 1144 bytes} [Mon May 16 15:02:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:02:03.534140 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f689cd-593e-42a2-87a4-f38007f19a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:03.534841 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f689cd-593e-42a2-87a4-f38007f19a74 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:03.535126 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f689cd-593e-42a2-87a4-f38007f19a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:03.535403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f689cd-593e-42a2-87a4-f38007f19a74 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:03.536260 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f689cd-593e-42a2-87a4-f38007f19a74 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:03.536571 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f689cd-593e-42a2-87a4-f38007f19a74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:03.538049 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f689cd-593e-42a2-87a4-f38007f19a74 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:03.559578 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 423/840] 10.222.0.76 () {56 vars in 1149 bytes} [Mon May 16 15:02:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:03.565066 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540455a-fb93-4297-bd3d-4526072b4bff None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:03.682021 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540455a-fb93-4297-bd3d-4526072b4bff None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:03.719280 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1485c-a00e-41a1-a5da-82675dba4578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:03.719919 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1485c-a00e-41a1-a5da-82675dba4578 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:03.720208 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1485c-a00e-41a1-a5da-82675dba4578 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:03.720487 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1485c-a00e-41a1-a5da-82675dba4578 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:03.790459 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1485c-a00e-41a1-a5da-82675dba4578 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:03.791924 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1485c-a00e-41a1-a5da-82675dba4578 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:03.891743 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 418/841] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:02:03 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 15:02:03.897001 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f689cd-593e-42a2-87a4-f38007f19a74 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:03.998751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f689cd-593e-42a2-87a4-f38007f19a74 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:04.034306 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526470c-fce8-4ff7-906e-92fbb0a7cd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:04.035109 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526470c-fce8-4ff7-906e-92fbb0a7cd27 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:04.035392 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526470c-fce8-4ff7-906e-92fbb0a7cd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:04.035671 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526470c-fce8-4ff7-906e-92fbb0a7cd27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:04.045885 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526470c-fce8-4ff7-906e-92fbb0a7cd27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:04.047436 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526470c-fce8-4ff7-906e-92fbb0a7cd27 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:04.065011 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-2526470c-fce8-4ff7-906e-92fbb0a7cd27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:04.065011 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:04.065011 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:04.065011 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:04.065011 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:04.065011 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:04.065011 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:04.065011 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:04.065011 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:04.065011 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:04.065011 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:04.065011 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:04.065011 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:02:04.065011 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:02:04.065011 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:02:04.065933 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:02:04.065933 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:04.065933 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:04.065933 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:04.065933 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:04.065933 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:04.065933 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:04.065933 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:04.065933 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:04.065933 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:04.065933 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:04.065933 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:04.065933 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:04.065933 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:04.065933 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:04.065933 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:04.065933 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:04.066844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:02:04.066844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:02:04.066844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:04.066844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:04.066844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 424/842] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:04.072810 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1485c-a00e-41a1-a5da-82675dba4578 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:04.182762 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1485c-a00e-41a1-a5da-82675dba4578 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:04.219343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b610a3-b94d-42fc-b690-9c10184b241b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:04.220315 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b610a3-b94d-42fc-b690-9c10184b241b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:04.220780 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b610a3-b94d-42fc-b690-9c10184b241b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:04.221237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b610a3-b94d-42fc-b690-9c10184b241b None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:04.222153 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b610a3-b94d-42fc-b690-9c10184b241b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:04.222670 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b610a3-b94d-42fc-b690-9c10184b241b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:04.224236 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b610a3-b94d-42fc-b690-9c10184b241b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:04.236768 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 419/843] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:04.242402 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526470c-fce8-4ff7-906e-92fbb0a7cd27 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:04.292961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75d593-c337-49cf-b3f5-f5c333f5a2ef None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:04.293153 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75d593-c337-49cf-b3f5-f5c333f5a2ef None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:04.293432 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75d593-c337-49cf-b3f5-f5c333f5a2ef None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:04.296142 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 420/844] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:02:04.300079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c9576-aed5-40ae-8c1b-47dfb4b7d4e1 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:04.300365 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c9576-aed5-40ae-8c1b-47dfb4b7d4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:04.300642 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c9576-aed5-40ae-8c1b-47dfb4b7d4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:04.319193 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-412c9576-aed5-40ae-8c1b-47dfb4b7d4e1 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:04.320754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-412c9576-aed5-40ae-8c1b-47dfb4b7d4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:04.342501 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526470c-fce8-4ff7-906e-92fbb0a7cd27 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:04.381156 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7dffd-9809-4531-8aea-1cd994883f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:04.382222 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7dffd-9809-4531-8aea-1cd994883f65 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:04.382535 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7dffd-9809-4531-8aea-1cd994883f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:04.382820 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7dffd-9809-4531-8aea-1cd994883f65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:04.390948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7dffd-9809-4531-8aea-1cd994883f65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:04.393041 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7dffd-9809-4531-8aea-1cd994883f65 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:04.403051 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 421/845] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 15:02:04.414621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-5cb7dffd-9809-4531-8aea-1cd994883f65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:02:04.414621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:04.414621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:04.414621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:04.414621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:04.414621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:04.414621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:04.414621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:04.414621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:04.414621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:04.414621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:04.414621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:04.414621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:02:04.414621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:02:04.414621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:02:04.415515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:02:04.415515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:04.415515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:04.415515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:04.415515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:04.415515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:04.415515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:04.415515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:04.415515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:04.415515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:04.415515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:04.415515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:04.415515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:04.415515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:04.415515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:04.415515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:04.415515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:04.416416 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:02:04.416416 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:02:04.416416 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:02:04.416416 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:02:04.416416 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:02:04.416416 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:02:04.416416 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:02:04.416416 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:04.416416 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 425/846] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:02:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:04.416911 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c9576-aed5-40ae-8c1b-47dfb4b7d4e1 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:04.428646 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7dffd-9809-4531-8aea-1cd994883f65 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:04.544062 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c9576-aed5-40ae-8c1b-47dfb4b7d4e1 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:04.547967 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7dffd-9809-4531-8aea-1cd994883f65 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:04.580546 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c5356-f43f-4fe3-8737-ce6ae67bf843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:04.581210 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c5356-f43f-4fe3-8737-ce6ae67bf843 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:04.581493 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c5356-f43f-4fe3-8737-ce6ae67bf843 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:04.581768 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c5356-f43f-4fe3-8737-ce6ae67bf843 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:04.582616 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c5356-f43f-4fe3-8737-ce6ae67bf843 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:04.582925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c5356-f43f-4fe3-8737-ce6ae67bf843 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:04.584373 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c5356-f43f-4fe3-8737-ce6ae67bf843 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:04.589469 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc25d40-bb81-4a0d-96f3-ce877adb17c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:04.590331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc25d40-bb81-4a0d-96f3-ce877adb17c7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:04.591426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc25d40-bb81-4a0d-96f3-ce877adb17c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:04.594504 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc25d40-bb81-4a0d-96f3-ce877adb17c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:04.606203 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 422/847] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:02:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:04.607170 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c5356-f43f-4fe3-8737-ce6ae67bf843 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:04.607970 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc25d40-bb81-4a0d-96f3-ce877adb17c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:02:04.617789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-6dc25d40-bb81-4a0d-96f3-ce877adb17c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:02:04.617789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:04.617789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:04.617789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:04.617789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:04.617789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:04.617789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:04.617789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:04.617789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:04.617789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:04.617789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:04.617789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:04.617789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:02:04.617789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:02:04.617789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:02:04.617789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:02:04.618771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:02:04.618771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:02:04.618771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:02:04.618771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:02:04.618771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:04.618771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:04.618771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:04.618771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:04.618771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:04.618771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:04.618771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:04.618771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:04.618771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:04.618771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:04.618771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:04.618771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:04.619632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:04.619632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:04.619632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:04.619632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:04.619632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:02:04.619632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:02:04.619632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:02:04.619632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:02:04.619632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:02:04.619632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:02:04.619632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:02:04.619632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:04.622541 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 426/848] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:02:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:02:04.627675 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc25d40-bb81-4a0d-96f3-ce877adb17c7 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:04.721318 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c5356-f43f-4fe3-8737-ce6ae67bf843 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:04.753891 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc25d40-bb81-4a0d-96f3-ce877adb17c7 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:04.754885 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a2360-8efb-407e-910b-e8c5c76034fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:04.755552 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a2360-8efb-407e-910b-e8c5c76034fd None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:04.755831 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a2360-8efb-407e-910b-e8c5c76034fd None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:04.756103 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a2360-8efb-407e-910b-e8c5c76034fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:04.756952 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a2360-8efb-407e-910b-e8c5c76034fd None admin] RBAC: Adding query filter params (role.id=f63aad4ab4a04108b87e1bf4ea8dfa53, scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9, user.id=1a7181297bf14a57b3bf1f3c8b178d3c) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:04.757260 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a2360-8efb-407e-910b-e8c5c76034fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:04.759517 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a2360-8efb-407e-910b-e8c5c76034fd None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:04.765902 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 423/849] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:02:04 2022] GET /identity/v3/role_assignments?user.id=1a7181297bf14a57b3bf1f3c8b178d3c&scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9&role.id=f63aad4ab4a04108b87e1bf4ea8dfa53 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:04.799289 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d5cbf-3c2d-4631-abe4-2220494669c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:04.800224 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d5cbf-3c2d-4631-abe4-2220494669c9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:04.800657 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d5cbf-3c2d-4631-abe4-2220494669c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:04.801087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d5cbf-3c2d-4631-abe4-2220494669c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:04.802020 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d5cbf-3c2d-4631-abe4-2220494669c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:04.802618 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d5cbf-3c2d-4631-abe4-2220494669c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:04.804200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d5cbf-3c2d-4631-abe4-2220494669c9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:04.814716 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 427/850] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:02:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:04.821125 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a2360-8efb-407e-910b-e8c5c76034fd None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:04.933481 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a2360-8efb-407e-910b-e8c5c76034fd None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:04.969300 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409432c4-87a6-47b3-8012-70427ac446ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:04.970363 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409432c4-87a6-47b3-8012-70427ac446ec None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:04.970815 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409432c4-87a6-47b3-8012-70427ac446ec None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:04.971239 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409432c4-87a6-47b3-8012-70427ac446ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:04.982824 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409432c4-87a6-47b3-8012-70427ac446ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:04.984494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409432c4-87a6-47b3-8012-70427ac446ec None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:05.002204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-409432c4-87a6-47b3-8012-70427ac446ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:05.002204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:05.002204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:05.002204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:05.002204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:05.002204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:05.002204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:05.002204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:05.002204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:05.002204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:05.002204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:05.002204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:05.002204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:02:05.002204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:02:05.002204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:02:05.003575 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:02:05.003575 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:05.003575 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:05.003575 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:05.003575 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:05.003575 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:05.003575 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:05.003575 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:05.003575 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:05.003575 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:05.003575 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:05.003575 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:05.003575 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:05.003575 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:05.003575 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:05.003575 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:05.003575 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:05.004714 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:02:05.004714 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:02:05.004714 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:05.004714 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:05.006218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 424/851] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:05.012526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d5cbf-3c2d-4631-abe4-2220494669c9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:05.118222 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d5cbf-3c2d-4631-abe4-2220494669c9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:05.152749 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b313cc5-2417-4a0f-9beb-b12cfa2efe3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:05.153958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b313cc5-2417-4a0f-9beb-b12cfa2efe3f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:05.154434 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b313cc5-2417-4a0f-9beb-b12cfa2efe3f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:05.154719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b313cc5-2417-4a0f-9beb-b12cfa2efe3f None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:05.155521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b313cc5-2417-4a0f-9beb-b12cfa2efe3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:05.155831 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b313cc5-2417-4a0f-9beb-b12cfa2efe3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:05.157270 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b313cc5-2417-4a0f-9beb-b12cfa2efe3f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:05.171882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 428/852] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:05.177055 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409432c4-87a6-47b3-8012-70427ac446ec None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:05.278348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409432c4-87a6-47b3-8012-70427ac446ec None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:05.311343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48000ae2-6dfe-43da-a5ca-74df499d5a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:05.312143 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48000ae2-6dfe-43da-a5ca-74df499d5a6c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:05.312420 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48000ae2-6dfe-43da-a5ca-74df499d5a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:05.312688 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48000ae2-6dfe-43da-a5ca-74df499d5a6c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:05.321526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48000ae2-6dfe-43da-a5ca-74df499d5a6c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:05.322983 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48000ae2-6dfe-43da-a5ca-74df499d5a6c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:05.345283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-48000ae2-6dfe-43da-a5ca-74df499d5a6c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 15:02:05.345283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:05.345283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:05.345283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:05.345283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:05.345283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:05.345283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:05.345283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:05.345283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:05.345283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:05.345283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:05.345283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:05.345283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:02:05.345283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:02:05.345283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:02:05.345283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:02:05.346339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:05.346339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:05.346339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:02:05.346339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:02:05.346339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:02:05.346339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:02:05.346339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:05.346339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:05.346339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:05.346339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:05.346339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:05.346339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:05.346339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:05.346339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:05.346339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:05.346339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:05.346339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:05.346339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:05.347306 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:05.347306 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:05.347306 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:02:05.347306 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:02:05.347306 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:02:05.347306 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:02:05.347306 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:02:05.347306 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:02:05.347306 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 15:02:05.347306 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:05.347848 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 425/853] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:02:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:05.354671 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b313cc5-2417-4a0f-9beb-b12cfa2efe3f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:05.459962 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b313cc5-2417-4a0f-9beb-b12cfa2efe3f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:05.499041 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a5473-9e6d-44cc-9108-1a3ad008227a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:05.499771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a5473-9e6d-44cc-9108-1a3ad008227a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:05.500056 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a5473-9e6d-44cc-9108-1a3ad008227a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:05.500331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a5473-9e6d-44cc-9108-1a3ad008227a None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:05.501184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a5473-9e6d-44cc-9108-1a3ad008227a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:05.501491 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a5473-9e6d-44cc-9108-1a3ad008227a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:05.503238 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a5473-9e6d-44cc-9108-1a3ad008227a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:05.523791 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 429/854] 10.222.0.76 () {56 vars in 1135 bytes} [Mon May 16 15:02:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:05.528812 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48000ae2-6dfe-43da-a5ca-74df499d5a6c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:05.640014 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48000ae2-6dfe-43da-a5ca-74df499d5a6c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:05.651109 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3039fa-7b1f-4e67-81ed-fd33827c36e5 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:05.651450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3039fa-7b1f-4e67-81ed-fd33827c36e5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:05.651650 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3039fa-7b1f-4e67-81ed-fd33827c36e5 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:05.653401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 430/855] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:02:05.658517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f4f23-8efa-4d7a-9f85-e8becd82a0fc None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:05.658801 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f4f23-8efa-4d7a-9f85-e8becd82a0fc None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:05.659079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f4f23-8efa-4d7a-9f85-e8becd82a0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:05.674543 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2704e-33d7-42f8-b9bb-2902d3d5d5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:05.675269 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2704e-33d7-42f8-b9bb-2902d3d5d5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:05.675564 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2704e-33d7-42f8-b9bb-2902d3d5d5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:05.675838 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2704e-33d7-42f8-b9bb-2902d3d5d5d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:05.676166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f58f4f23-8efa-4d7a-9f85-e8becd82a0fc None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:05.677399 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f58f4f23-8efa-4d7a-9f85-e8becd82a0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:05.746408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2704e-33d7-42f8-b9bb-2902d3d5d5d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:05.748015 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2704e-33d7-42f8-b9bb-2902d3d5d5d6 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:05.758281 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 431/856] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 15:02:05.772140 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f4f23-8efa-4d7a-9f85-e8becd82a0fc None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:05.871517 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 426/857] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:02:05 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 15:02:05.876457 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f4f23-8efa-4d7a-9f85-e8becd82a0fc None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:05.882160 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2704e-33d7-42f8-b9bb-2902d3d5d5d6 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:05.910802 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb67a85-a8d3-4430-9e76-df0514daacf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:05.911603 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb67a85-a8d3-4430-9e76-df0514daacf8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:05.911885 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb67a85-a8d3-4430-9e76-df0514daacf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:05.912156 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb67a85-a8d3-4430-9e76-df0514daacf8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:05.912801 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb67a85-a8d3-4430-9e76-df0514daacf8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:05.914225 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb67a85-a8d3-4430-9e76-df0514daacf8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:05.926075 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-0eb67a85-a8d3-4430-9e76-df0514daacf8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 15:02:05.926075 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:05.926075 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 15:02:05.926075 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 15:02:05.926075 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 15:02:05.926075 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 15:02:05.926075 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 15:02:05.926075 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:05.926075 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 15:02:05.926075 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:05.926075 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:02:05.926075 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:05.926075 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:05.926075 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:05.926075 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:05.926075 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:05.927084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:05.927084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:05.927084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:05.927084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:05.927084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:05.927084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:05.927084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:05.927084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 15:02:05.927084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 15:02:05.927084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 15:02:05.927084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 15:02:05.927084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:05.927084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:05.927084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:05.927084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:05.927084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:05.927951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:05.927951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:05.927951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:05.927951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:05.927951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:05.927951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:05.927951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:05.927951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:05.927951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:05.927951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:05.927951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:05.927951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 15:02:05.927951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:05.927951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 15:02:05.927951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:05.927951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 432/858] 10.222.0.76 () {56 vars in 1132 bytes} [Mon May 16 15:02:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:05.928800 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76717696-4fc7-4c8e-93a4-07d9e01df1da None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:05.929905 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76717696-4fc7-4c8e-93a4-07d9e01df1da None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:05.929905 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76717696-4fc7-4c8e-93a4-07d9e01df1da None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:05.931215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 433/859] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:05.933722 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76717696-4fc7-4c8e-93a4-07d9e01df1da None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:05.985373 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2704e-33d7-42f8-b9bb-2902d3d5d5d6 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:06.018817 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d0e62-350d-4866-b7c0-9cea3c097efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:06.019527 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d0e62-350d-4866-b7c0-9cea3c097efb None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:06.019804 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d0e62-350d-4866-b7c0-9cea3c097efb None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:06.020078 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d0e62-350d-4866-b7c0-9cea3c097efb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:06.029793 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d0e62-350d-4866-b7c0-9cea3c097efb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:06.031270 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d0e62-350d-4866-b7c0-9cea3c097efb None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:06.037039 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76717696-4fc7-4c8e-93a4-07d9e01df1da None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:06.049753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-ba6d0e62-350d-4866-b7c0-9cea3c097efb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:06.049753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:06.049753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:06.049753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:06.049753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:06.049753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:06.049753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:06.049753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:06.049753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:06.049753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:06.049753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:06.049753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:06.049753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:02:06.049753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:02:06.049753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:02:06.050957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:02:06.050957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:06.050957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:06.050957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:06.050957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:06.050957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:06.050957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:06.050957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:06.050957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:06.050957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:06.050957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:06.050957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:06.050957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:06.050957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:06.050957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:06.050957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:06.050957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:06.057132 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:02:06.057132 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:02:06.057132 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:06.057132 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:06.057132 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 427/860] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:02:06.057132 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa922d6-dce1-48a4-a2f9-a6cbbcff0a5d None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:06.057132 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa922d6-dce1-48a4-a2f9-a6cbbcff0a5d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:06.057132 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa922d6-dce1-48a4-a2f9-a6cbbcff0a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:06.070467 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-8fa922d6-dce1-48a4-a2f9-a6cbbcff0a5d None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:06.071629 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8fa922d6-dce1-48a4-a2f9-a6cbbcff0a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:06.080316 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3282ab-f799-4cdd-b532-a9dfa30e425a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:06.080971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3282ab-f799-4cdd-b532-a9dfa30e425a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:06.081247 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3282ab-f799-4cdd-b532-a9dfa30e425a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:06.081519 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3282ab-f799-4cdd-b532-a9dfa30e425a None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:06.082250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3282ab-f799-4cdd-b532-a9dfa30e425a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:06.082556 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3282ab-f799-4cdd-b532-a9dfa30e425a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:06.083908 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3282ab-f799-4cdd-b532-a9dfa30e425a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:06.088275 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 434/861] 10.222.0.76 () {56 vars in 1126 bytes} [Mon May 16 15:02:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:06.089041 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3282ab-f799-4cdd-b532-a9dfa30e425a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:06.148759 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 428/862] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:06.149985 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa922d6-dce1-48a4-a2f9-a6cbbcff0a5d None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:06.193802 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3282ab-f799-4cdd-b532-a9dfa30e425a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:06.228423 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85543f-769a-4e35-b245-35b9d4f306b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:06.229090 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85543f-769a-4e35-b245-35b9d4f306b1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:06.229375 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85543f-769a-4e35-b245-35b9d4f306b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:06.229651 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85543f-769a-4e35-b245-35b9d4f306b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:06.230407 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85543f-769a-4e35-b245-35b9d4f306b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:06.230715 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85543f-769a-4e35-b245-35b9d4f306b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:06.232088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85543f-769a-4e35-b245-35b9d4f306b1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:06.243429 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 435/863] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:06.244218 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85543f-769a-4e35-b245-35b9d4f306b1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:06.244538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa922d6-dce1-48a4-a2f9-a6cbbcff0a5d None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:06.278958 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ba3be-764a-41bf-95ba-23047cecfc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:06.279540 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ba3be-764a-41bf-95ba-23047cecfc3f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:06.279816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ba3be-764a-41bf-95ba-23047cecfc3f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:06.280086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ba3be-764a-41bf-95ba-23047cecfc3f None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:06.280778 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ba3be-764a-41bf-95ba-23047cecfc3f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:06.281083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ba3be-764a-41bf-95ba-23047cecfc3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:06.282466 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ba3be-764a-41bf-95ba-23047cecfc3f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:06.287007 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 429/864] 10.222.0.76 () {56 vars in 1126 bytes} [Mon May 16 15:02:06 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:06.287780 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ba3be-764a-41bf-95ba-23047cecfc3f None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:06.381719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85543f-769a-4e35-b245-35b9d4f306b1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:06.399470 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ba3be-764a-41bf-95ba-23047cecfc3f None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:06.426037 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25062e3a-05f4-45f6-8303-fa1db9559c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:06.427070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25062e3a-05f4-45f6-8303-fa1db9559c47 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:06.427354 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25062e3a-05f4-45f6-8303-fa1db9559c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:06.428036 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25062e3a-05f4-45f6-8303-fa1db9559c47 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:06.429445 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25062e3a-05f4-45f6-8303-fa1db9559c47 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:06.430572 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25062e3a-05f4-45f6-8303-fa1db9559c47 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:06.440464 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267bcf5-2b4c-43d4-9d68-0912e25f2baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:06.441803 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267bcf5-2b4c-43d4-9d68-0912e25f2baa None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:06.442310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267bcf5-2b4c-43d4-9d68-0912e25f2baa None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:06.442816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267bcf5-2b4c-43d4-9d68-0912e25f2baa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:06.444673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-25062e3a-05f4-45f6-8303-fa1db9559c47 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 15:02:06.444673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:06.444673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 15:02:06.444673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 15:02:06.444673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 15:02:06.444673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 15:02:06.444673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 15:02:06.444673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:06.444673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 15:02:06.444673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:06.444673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:02:06.444673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:06.444673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:06.444673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:06.444673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:06.444673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:06.444673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:06.445689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:06.445689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:06.445689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:06.445689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:06.445689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:06.445689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:06.445689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 15:02:06.445689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 15:02:06.445689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 15:02:06.445689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 15:02:06.445689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:06.445689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:06.445689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:06.445689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:06.445689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:06.445689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:06.446562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:06.446562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:06.446562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:06.446562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:06.446562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:06.446562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:06.446562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:06.446562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:06.446562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:06.446562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:06.446562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 15:02:06.446562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:06.446562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 15:02:06.446562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:06.450300 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 436/865] 10.222.0.76 () {56 vars in 1114 bytes} [Mon May 16 15:02:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:06.452864 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25062e3a-05f4-45f6-8303-fa1db9559c47 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:06.457994 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267bcf5-2b4c-43d4-9d68-0912e25f2baa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:06.459787 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267bcf5-2b4c-43d4-9d68-0912e25f2baa None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:06.477411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-d267bcf5-2b4c-43d4-9d68-0912e25f2baa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:02:06.477411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:06.477411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:06.477411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:06.477411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:06.477411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:06.477411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:06.477411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:06.477411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:06.477411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:06.477411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:06.477411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:06.477411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:02:06.477411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:02:06.477411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:02:06.478407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:02:06.478407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:06.478407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:06.478407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:06.478407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:06.478407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:06.478407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:06.478407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:06.478407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:06.478407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:06.478407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:06.478407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:06.478407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:06.478407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:06.478407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:06.478407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:06.478407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:06.479297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:02:06.479297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:02:06.479297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:02:06.479297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:02:06.479297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:02:06.479297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:02:06.479297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:02:06.479297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:06.484031 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 430/866] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:02:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:06.485286 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267bcf5-2b4c-43d4-9d68-0912e25f2baa None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:06.593697 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267bcf5-2b4c-43d4-9d68-0912e25f2baa None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:06.596051 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25062e3a-05f4-45f6-8303-fa1db9559c47 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:06.628497 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852e349-1fc0-4355-b8b5-fa663647c52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:06.629166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852e349-1fc0-4355-b8b5-fa663647c52a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:06.629450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852e349-1fc0-4355-b8b5-fa663647c52a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:06.629729 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852e349-1fc0-4355-b8b5-fa663647c52a None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:06.630599 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852e349-1fc0-4355-b8b5-fa663647c52a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:06.630910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852e349-1fc0-4355-b8b5-fa663647c52a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:06.632376 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852e349-1fc0-4355-b8b5-fa663647c52a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:06.636965 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e7351-a40e-47d4-a47f-000b83cb35f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:06.637800 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e7351-a40e-47d4-a47f-000b83cb35f1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:06.638258 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e7351-a40e-47d4-a47f-000b83cb35f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:06.638674 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e7351-a40e-47d4-a47f-000b83cb35f1 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:06.639522 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e7351-a40e-47d4-a47f-000b83cb35f1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:06.640032 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e7351-a40e-47d4-a47f-000b83cb35f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:06.641589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e7351-a40e-47d4-a47f-000b83cb35f1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:06.650253 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 437/868] 10.222.0.76 () {56 vars in 1114 bytes} [Mon May 16 15:02:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:06.651893 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 431/868] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:02:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:06.652798 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852e349-1fc0-4355-b8b5-fa663647c52a None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:06.654056 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e7351-a40e-47d4-a47f-000b83cb35f1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:06.754893 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852e349-1fc0-4355-b8b5-fa663647c52a None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:06.759849 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e7351-a40e-47d4-a47f-000b83cb35f1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:06.789538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47982d60-7694-405f-bb53-34ee02c8eaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:06.790043 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47982d60-7694-405f-bb53-34ee02c8eaf0 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:06.790350 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47982d60-7694-405f-bb53-34ee02c8eaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:06.790718 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47982d60-7694-405f-bb53-34ee02c8eaf0 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:06.791457 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47982d60-7694-405f-bb53-34ee02c8eaf0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:06.791765 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47982d60-7694-405f-bb53-34ee02c8eaf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:06.793437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47982d60-7694-405f-bb53-34ee02c8eaf0 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:06.796035 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba5c5e-0b52-4051-adbd-380157234307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:06.796919 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba5c5e-0b52-4051-adbd-380157234307 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:06.797423 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba5c5e-0b52-4051-adbd-380157234307 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:06.797915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba5c5e-0b52-4051-adbd-380157234307 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:06.798629 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 432/869] 10.222.0.76 () {56 vars in 1114 bytes} [Mon May 16 15:02:06 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:06.799482 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba5c5e-0b52-4051-adbd-380157234307 None admin] RBAC: Adding query filter params (role.id=f6c8fc0dc0f24de3907b0960a1201901, scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9, user.id=33470e30760842ca9e96bb7f0cf9f07d) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:06.799997 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba5c5e-0b52-4051-adbd-380157234307 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:06.801711 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba5c5e-0b52-4051-adbd-380157234307 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:06.809874 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 438/870] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:02:06 2022] GET /identity/v3/role_assignments?user.id=33470e30760842ca9e96bb7f0cf9f07d&scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9&role.id=f6c8fc0dc0f24de3907b0960a1201901 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:07.184966 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb964480-6766-4e8d-b3ac-3944df6e6232 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:07.185354 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb964480-6766-4e8d-b3ac-3944df6e6232 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:07.185531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb964480-6766-4e8d-b3ac-3944df6e6232 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:07.186944 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 433/871] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:07.192657 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ce66c-2cf1-48f8-93f5-62427e210d41 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:07.193116 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ce66c-2cf1-48f8-93f5-62427e210d41 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:07.193223 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ce66c-2cf1-48f8-93f5-62427e210d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:07.211405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c63ce66c-2cf1-48f8-93f5-62427e210d41 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:07.212603 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c63ce66c-2cf1-48f8-93f5-62427e210d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:07.279515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 439/872] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:07.303083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb964480-6766-4e8d-b3ac-3944df6e6232 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:07.405397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb964480-6766-4e8d-b3ac-3944df6e6232 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:07.443512 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1f1b9-67ef-4960-a29a-7d62b8ac7ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:07.444248 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1f1b9-67ef-4960-a29a-7d62b8ac7ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:07.444528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1f1b9-67ef-4960-a29a-7d62b8ac7ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:07.444826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1f1b9-67ef-4960-a29a-7d62b8ac7ee5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:07.455402 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1f1b9-67ef-4960-a29a-7d62b8ac7ee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:02:07.464364 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-45f1f1b9-67ef-4960-a29a-7d62b8ac7ee5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 15:02:07.464364 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:07.464364 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:07.464364 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:07.464364 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:07.464364 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:07.464364 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:07.464364 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:07.464364 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:07.464364 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:07.464364 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:07.464364 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:07.464364 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:02:07.464364 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:02:07.464364 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:02:07.464364 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:02:07.465374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:02:07.465374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:02:07.465374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:02:07.465374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:02:07.465374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:07.465374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:07.465374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:07.465374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:07.465374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:07.465374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:07.465374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:07.465374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:07.465374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:07.465374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:07.465374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:07.465374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:07.466263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:07.466263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:07.466263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:07.466263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:07.466263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:02:07.466263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:02:07.466263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:02:07.466263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:02:07.466263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:02:07.466263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:02:07.466263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 15:02:07.466263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:07.466263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 434/873] 10.222.0.76 () {56 vars in 1120 bytes} [Mon May 16 15:02:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:07.472047 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ce66c-2cf1-48f8-93f5-62427e210d41 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:07.574273 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ce66c-2cf1-48f8-93f5-62427e210d41 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:07.609568 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c88b8-d7e4-4f83-b9c9-f96a4f648bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:07.610273 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c88b8-d7e4-4f83-b9c9-f96a4f648bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:07.610558 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c88b8-d7e4-4f83-b9c9-f96a4f648bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:07.610835 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c88b8-d7e4-4f83-b9c9-f96a4f648bb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:07.611586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c88b8-d7e4-4f83-b9c9-f96a4f648bb5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:07.611897 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c88b8-d7e4-4f83-b9c9-f96a4f648bb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:07.613273 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c88b8-d7e4-4f83-b9c9-f96a4f648bb5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:07.621838 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 440/874] 10.222.0.76 () {56 vars in 1115 bytes} [Mon May 16 15:02:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:07.627116 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1f1b9-67ef-4960-a29a-7d62b8ac7ee5 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:07.731861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1f1b9-67ef-4960-a29a-7d62b8ac7ee5 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:07.766561 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd9ff3-9426-46f7-94de-2a83c377d168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:07.767349 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd9ff3-9426-46f7-94de-2a83c377d168 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:07.767630 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd9ff3-9426-46f7-94de-2a83c377d168 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:07.767903 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd9ff3-9426-46f7-94de-2a83c377d168 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:07.779544 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd9ff3-9426-46f7-94de-2a83c377d168 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:07.780988 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd9ff3-9426-46f7-94de-2a83c377d168 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:07.797994 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-39cd9ff3-9426-46f7-94de-2a83c377d168 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:07.797994 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:07.797994 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:07.797994 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:07.797994 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:07.797994 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:07.797994 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:07.797994 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:07.797994 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:07.797994 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:07.797994 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:07.797994 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:07.797994 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:02:07.797994 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:02:07.797994 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:02:07.798895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:02:07.798895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:07.798895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:07.798895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:07.798895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:07.798895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:07.798895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:07.798895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:07.798895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:07.798895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:07.798895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:07.798895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:07.798895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:07.798895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:07.798895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:07.798895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:07.798895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:07.799788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:02:07.799788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:02:07.799788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:07.799788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:07.799788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 435/875] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:07.805282 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c88b8-d7e4-4f83-b9c9-f96a4f648bb5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:07.901915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c88b8-d7e4-4f83-b9c9-f96a4f648bb5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:07.935396 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb545cc-5a47-4828-b012-e0f86da1394c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:07.936051 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb545cc-5a47-4828-b012-e0f86da1394c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:07.936326 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb545cc-5a47-4828-b012-e0f86da1394c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:07.936635 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb545cc-5a47-4828-b012-e0f86da1394c None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:07.937503 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb545cc-5a47-4828-b012-e0f86da1394c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:07.937821 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb545cc-5a47-4828-b012-e0f86da1394c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:07.939211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb545cc-5a47-4828-b012-e0f86da1394c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:07.951629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 441/876] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:07.956991 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd9ff3-9426-46f7-94de-2a83c377d168 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:08.058002 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd9ff3-9426-46f7-94de-2a83c377d168 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:08.094075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad3a49-ebdb-416f-9fc5-cc45f3dc4519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:08.094916 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad3a49-ebdb-416f-9fc5-cc45f3dc4519 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:08.095197 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad3a49-ebdb-416f-9fc5-cc45f3dc4519 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:08.095470 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad3a49-ebdb-416f-9fc5-cc45f3dc4519 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:08.103166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad3a49-ebdb-416f-9fc5-cc45f3dc4519 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:08.104613 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad3a49-ebdb-416f-9fc5-cc45f3dc4519 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:08.119776 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-57ad3a49-ebdb-416f-9fc5-cc45f3dc4519 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 15:02:08.119776 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:08.119776 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:08.119776 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:08.119776 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:08.119776 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:08.119776 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:08.119776 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:08.119776 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:08.119776 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:08.119776 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:08.119776 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:08.119776 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:02:08.119776 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:02:08.119776 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:02:08.119776 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:02:08.121836 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:08.121836 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:08.121836 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:02:08.121836 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:02:08.121836 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:02:08.121836 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:02:08.121836 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:08.121836 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:08.121836 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:08.121836 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:08.121836 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:08.121836 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:08.121836 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:08.121836 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:08.121836 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:08.121836 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:08.121836 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:08.121836 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:08.123548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:08.123548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:08.123548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:02:08.123548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:02:08.123548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:02:08.123548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:02:08.123548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:02:08.123548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:02:08.123548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 15:02:08.123548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:08.123548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 436/877] 10.222.0.76 () {56 vars in 1117 bytes} [Mon May 16 15:02:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:08.126799 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb545cc-5a47-4828-b012-e0f86da1394c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:08.227502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb545cc-5a47-4828-b012-e0f86da1394c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:08.266816 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ebc9b-5a96-4bd7-851f-ffdf492aa779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:08.267489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ebc9b-5a96-4bd7-851f-ffdf492aa779 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:08.267771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ebc9b-5a96-4bd7-851f-ffdf492aa779 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:08.268109 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ebc9b-5a96-4bd7-851f-ffdf492aa779 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:08.268955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ebc9b-5a96-4bd7-851f-ffdf492aa779 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:08.269266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ebc9b-5a96-4bd7-851f-ffdf492aa779 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:08.270734 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ebc9b-5a96-4bd7-851f-ffdf492aa779 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:08.289104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 442/878] 10.222.0.76 () {56 vars in 1149 bytes} [Mon May 16 15:02:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:08.294203 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad3a49-ebdb-416f-9fc5-cc45f3dc4519 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:08.396780 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad3a49-ebdb-416f-9fc5-cc45f3dc4519 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:08.429825 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ebe94-409a-48bb-b0c8-6d016b509f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:08.430526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ebe94-409a-48bb-b0c8-6d016b509f95 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:08.430811 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ebe94-409a-48bb-b0c8-6d016b509f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:08.431082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ebe94-409a-48bb-b0c8-6d016b509f95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:08.504263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ebe94-409a-48bb-b0c8-6d016b509f95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:08.505712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ebe94-409a-48bb-b0c8-6d016b509f95 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:08.610595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 437/879] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:02:08 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 15:02:08.615774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ebc9b-5a96-4bd7-851f-ffdf492aa779 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:08.633332 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c056b4-8d4e-4254-bcc5-6e485aecf01f None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:08.633652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c056b4-8d4e-4254-bcc5-6e485aecf01f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:08.633876 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c056b4-8d4e-4254-bcc5-6e485aecf01f None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:08.635659 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 438/880] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:08.641089 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c969b1-c665-4736-ab44-e1ac13327435 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:08.641375 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c969b1-c665-4736-ab44-e1ac13327435 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:08.641653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c969b1-c665-4736-ab44-e1ac13327435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:08.658880 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-74c969b1-c665-4736-ab44-e1ac13327435 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:08.659977 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-74c969b1-c665-4736-ab44-e1ac13327435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:08.721207 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ebc9b-5a96-4bd7-851f-ffdf492aa779 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:08.729120 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 439/881] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 15:02:08.751433 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c969b1-c665-4736-ab44-e1ac13327435 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:08.771131 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662d1b7-d231-494b-a131-9b093fde687f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:08.772548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662d1b7-d231-494b-a131-9b093fde687f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:08.773642 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662d1b7-d231-494b-a131-9b093fde687f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:08.774177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662d1b7-d231-494b-a131-9b093fde687f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:08.787552 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662d1b7-d231-494b-a131-9b093fde687f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:08.790875 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662d1b7-d231-494b-a131-9b093fde687f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:08.813865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-1662d1b7-d231-494b-a131-9b093fde687f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:08.813865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:08.813865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:08.813865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:08.813865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:08.813865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:08.813865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:08.813865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:08.813865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:08.813865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:08.813865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:08.813865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:08.813865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:02:08.813865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:02:08.813865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:02:08.814844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:02:08.814844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:08.814844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:08.814844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:08.814844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:08.814844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:08.814844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:08.814844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:08.814844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:08.814844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:08.814844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:08.814844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:08.814844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:08.814844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:08.814844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:08.814844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:08.814844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:08.815730 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:02:08.815730 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:02:08.815730 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:08.815730 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:08.818476 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 443/882] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:08.823214 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662d1b7-d231-494b-a131-9b093fde687f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:08.864771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c969b1-c665-4736-ab44-e1ac13327435 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:08.904303 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64860c09-fb56-4826-87ad-b3099e58cbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:08.905243 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64860c09-fb56-4826-87ad-b3099e58cbb1 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:08.905678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64860c09-fb56-4826-87ad-b3099e58cbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:08.906092 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64860c09-fb56-4826-87ad-b3099e58cbb1 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:08.907070 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64860c09-fb56-4826-87ad-b3099e58cbb1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:08.908725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64860c09-fb56-4826-87ad-b3099e58cbb1 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:08.940603 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662d1b7-d231-494b-a131-9b093fde687f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:08.973530 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfeb3b-c371-41e5-9a19-cda6242c1841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:08.974227 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfeb3b-c371-41e5-9a19-cda6242c1841 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:08.974513 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfeb3b-c371-41e5-9a19-cda6242c1841 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:08.974791 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfeb3b-c371-41e5-9a19-cda6242c1841 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:08.980452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dfeb3b-c371-41e5-9a19-cda6242c1841 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:08.980452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dfeb3b-c371-41e5-9a19-cda6242c1841 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:08.980452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dfeb3b-c371-41e5-9a19-cda6242c1841 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:08.988252 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 444/883] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:08.993883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfeb3b-c371-41e5-9a19-cda6242c1841 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:09.016554 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 440/884] 10.222.0.76 () {60 vars in 1141 bytes} [Mon May 16 15:02:08 2022] POST /identity/v3/services => generated 269 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:02:09.120023 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfeb3b-c371-41e5-9a19-cda6242c1841 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:09.162733 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bff1fb-fd84-4752-bfa3-59916bf60b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:09.164462 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bff1fb-fd84-4752-bfa3-59916bf60b2a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:09.164906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bff1fb-fd84-4752-bfa3-59916bf60b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:09.165345 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bff1fb-fd84-4752-bfa3-59916bf60b2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:09.173115 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bff1fb-fd84-4752-bfa3-59916bf60b2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:09.174964 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bff1fb-fd84-4752-bfa3-59916bf60b2a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:09.191266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-b0bff1fb-fd84-4752-bfa3-59916bf60b2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:02:09.191266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:09.191266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:09.191266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:09.191266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:09.191266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:09.191266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:09.191266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:09.191266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:09.191266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:09.191266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:09.191266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:09.191266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:02:09.191266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:02:09.191266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:02:09.192398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:02:09.192398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:09.192398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:09.192398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:09.192398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:09.192398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:09.192398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:09.192398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:09.192398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:09.192398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:09.192398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:09.192398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:09.192398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:09.192398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:09.192398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:09.192398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:09.192398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:09.193467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:02:09.193467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:02:09.193467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:02:09.193467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:02:09.193467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:02:09.193467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:02:09.193467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:02:09.193467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:09.196283 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 445/885] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:02:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:02:09.202087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64860c09-fb56-4826-87ad-b3099e58cbb1 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:09.223062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf5ab6-1b3b-44a3-8042-c6e77ef7dc19 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:09.223352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf5ab6-1b3b-44a3-8042-c6e77ef7dc19 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:09.223665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf5ab6-1b3b-44a3-8042-c6e77ef7dc19 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:09.225283 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 446/886] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:02:09.230693 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9258aaf-6faa-4992-8937-7586e1c34328 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:09.231282 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9258aaf-6faa-4992-8937-7586e1c34328 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:09.231282 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9258aaf-6faa-4992-8937-7586e1c34328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:09.248278 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e9258aaf-6faa-4992-8937-7586e1c34328 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:09.249018 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e9258aaf-6faa-4992-8937-7586e1c34328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:09.313985 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64860c09-fb56-4826-87ad-b3099e58cbb1 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:09.326722 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 447/887] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:09 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 15:02:09.328592 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77614910-d0fd-4ceb-b2c5-7dc5ead3d429 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:09.328942 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77614910-d0fd-4ceb-b2c5-7dc5ead3d429 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:09.329217 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77614910-d0fd-4ceb-b2c5-7dc5ead3d429 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:09.334225 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 448/888] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:09.337379 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ab619-8995-417d-8b03-7f3fa43f1a67 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:09.337839 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ab619-8995-417d-8b03-7f3fa43f1a67 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:09.340876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ab619-8995-417d-8b03-7f3fa43f1a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:09.357839 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8095edf-888b-48e2-8d15-41672b788a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:09.358037 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-302ab619-8995-417d-8b03-7f3fa43f1a67 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:09.358539 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8095edf-888b-48e2-8d15-41672b788a60 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:09.358818 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8095edf-888b-48e2-8d15-41672b788a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:09.359091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8095edf-888b-48e2-8d15-41672b788a60 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:09.359358 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-302ab619-8995-417d-8b03-7f3fa43f1a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:09.359875 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8095edf-888b-48e2-8d15-41672b788a60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:09.360182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8095edf-888b-48e2-8d15-41672b788a60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:09.361596 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8095edf-888b-48e2-8d15-41672b788a60 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:09.374103 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 441/889] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:02:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:09.374936 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8095edf-888b-48e2-8d15-41672b788a60 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:09.435227 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 449/890] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:09 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:09.436221 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ab619-8995-417d-8b03-7f3fa43f1a67 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:09.485140 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8095edf-888b-48e2-8d15-41672b788a60 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:09.522401 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434e58a-7b59-44f3-8051-7cd88c5136f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:09.523916 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434e58a-7b59-44f3-8051-7cd88c5136f9 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:09.524300 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434e58a-7b59-44f3-8051-7cd88c5136f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:09.524666 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434e58a-7b59-44f3-8051-7cd88c5136f9 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:09.525386 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434e58a-7b59-44f3-8051-7cd88c5136f9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:09.526835 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434e58a-7b59-44f3-8051-7cd88c5136f9 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:09.544703 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ab619-8995-417d-8b03-7f3fa43f1a67 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:09.578872 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6be6c-cad1-455f-8140-e748b43675d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:09.579524 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6be6c-cad1-455f-8140-e748b43675d6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:09.579799 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6be6c-cad1-455f-8140-e748b43675d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:09.580069 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6be6c-cad1-455f-8140-e748b43675d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:09.580891 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6be6c-cad1-455f-8140-e748b43675d6 None admin] RBAC: Adding query filter params (role.id=ab71625c5e074cf3b9b93b50548182f2, scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9, user.id=1a7181297bf14a57b3bf1f3c8b178d3c) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:09.581194 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6be6c-cad1-455f-8140-e748b43675d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:09.582708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6be6c-cad1-455f-8140-e748b43675d6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:09.588999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 450/891] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:02:09 2022] GET /identity/v3/role_assignments?user.id=1a7181297bf14a57b3bf1f3c8b178d3c&scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9&role.id=ab71625c5e074cf3b9b93b50548182f2 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:09.589808 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6be6c-cad1-455f-8140-e748b43675d6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:09.659290 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 442/892] 10.222.0.76 () {60 vars in 1141 bytes} [Mon May 16 15:02:09 2022] POST /identity/v3/services => generated 251 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:02:09.716993 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6be6c-cad1-455f-8140-e748b43675d6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:09.766192 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992a615-b819-4a2d-a0e8-49e44885d7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:09.767342 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992a615-b819-4a2d-a0e8-49e44885d7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:09.767820 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992a615-b819-4a2d-a0e8-49e44885d7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:09.768271 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992a615-b819-4a2d-a0e8-49e44885d7e2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:09.769206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992a615-b819-4a2d-a0e8-49e44885d7e2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:09.770891 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992a615-b819-4a2d-a0e8-49e44885d7e2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:09.784621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-0992a615-b819-4a2d-a0e8-49e44885d7e2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 15:02:09.784621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:09.784621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 15:02:09.784621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 15:02:09.784621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 15:02:09.784621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 15:02:09.784621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 15:02:09.784621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:09.784621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 15:02:09.784621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:09.784621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:02:09.784621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:09.784621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:09.784621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:09.784621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:09.784621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:09.784621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:09.785727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:09.785727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:09.785727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:09.785727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:09.785727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:09.785727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:09.785727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 15:02:09.785727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 15:02:09.785727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 15:02:09.785727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 15:02:09.785727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:09.785727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:09.785727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:09.785727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:09.785727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:09.785727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:09.786595 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:09.786595 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:09.786595 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:09.786595 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:09.786595 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:09.786595 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:09.786595 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:09.786595 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:09.786595 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:09.786595 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:09.786595 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 15:02:09.786595 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:09.786595 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 15:02:09.786595 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:09.789790 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 451/893] 10.222.0.76 () {56 vars in 1126 bytes} [Mon May 16 15:02:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:09.795605 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434e58a-7b59-44f3-8051-7cd88c5136f9 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:09.903966 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434e58a-7b59-44f3-8051-7cd88c5136f9 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:09.941236 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbd96f-091a-4122-99ec-6867a6f70176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:09.941896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbd96f-091a-4122-99ec-6867a6f70176 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:09.942211 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbd96f-091a-4122-99ec-6867a6f70176 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:09.942538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbd96f-091a-4122-99ec-6867a6f70176 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:09.943241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbd96f-091a-4122-99ec-6867a6f70176 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:09.943590 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbd96f-091a-4122-99ec-6867a6f70176 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:09.945516 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbd96f-091a-4122-99ec-6867a6f70176 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:09.950565 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 443/894] 10.222.0.76 () {56 vars in 1122 bytes} [Mon May 16 15:02:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:09.958935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992a615-b819-4a2d-a0e8-49e44885d7e2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:10.063104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992a615-b819-4a2d-a0e8-49e44885d7e2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:10.096697 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164cfa7-b1ba-4a42-97fc-6b4087a8a888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:10.097367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164cfa7-b1ba-4a42-97fc-6b4087a8a888 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:10.097649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164cfa7-b1ba-4a42-97fc-6b4087a8a888 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:10.097928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164cfa7-b1ba-4a42-97fc-6b4087a8a888 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:10.098666 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164cfa7-b1ba-4a42-97fc-6b4087a8a888 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:10.098973 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164cfa7-b1ba-4a42-97fc-6b4087a8a888 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:10.100350 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164cfa7-b1ba-4a42-97fc-6b4087a8a888 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:10.105819 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 452/895] 10.222.0.76 () {56 vars in 1122 bytes} [Mon May 16 15:02:09 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:11.368637 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84e87c-d20a-4459-995c-c2705215541c None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:11.369652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84e87c-d20a-4459-995c-c2705215541c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:11.370174 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84e87c-d20a-4459-995c-c2705215541c None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:11.372012 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 444/896] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:11.378025 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0071183-4264-4cce-8c33-827c3479ff55 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:11.378911 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0071183-4264-4cce-8c33-827c3479ff55 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:11.379381 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0071183-4264-4cce-8c33-827c3479ff55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:11.396792 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b0071183-4264-4cce-8c33-827c3479ff55 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:11.399048 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b0071183-4264-4cce-8c33-827c3479ff55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:11.467167 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 453/897] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:11.489453 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84e87c-d20a-4459-995c-c2705215541c None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:11.592807 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84e87c-d20a-4459-995c-c2705215541c None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:11.628244 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0f974-da84-47cb-abf3-3cc59fcc84d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:11.628979 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0f974-da84-47cb-abf3-3cc59fcc84d7 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:11.629260 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0f974-da84-47cb-abf3-3cc59fcc84d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:11.629533 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0f974-da84-47cb-abf3-3cc59fcc84d7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:11.630206 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0f974-da84-47cb-abf3-3cc59fcc84d7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:11.631577 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0f974-da84-47cb-abf3-3cc59fcc84d7 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:11.644058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-80f0f974-da84-47cb-abf3-3cc59fcc84d7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 15:02:11.644058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:11.644058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 15:02:11.644058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 15:02:11.644058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 15:02:11.644058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 15:02:11.644058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 15:02:11.644058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:11.644058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 15:02:11.644058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:11.644058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:02:11.644058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:11.644058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:11.644058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:11.644058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:11.644058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:11.644974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:11.644974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:11.644974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:11.644974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:11.644974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:11.644974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:11.644974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:11.644974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 15:02:11.644974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 15:02:11.644974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 15:02:11.644974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 15:02:11.644974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:11.644974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:11.644974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:11.644974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:11.644974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:11.645805 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:11.645805 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:11.645805 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:11.645805 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:11.645805 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:11.645805 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:11.645805 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:11.645805 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:11.645805 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:11.645805 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:11.645805 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:11.645805 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 15:02:11.645805 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:11.645805 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 15:02:11.645805 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:11.645805 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 445/898] 10.222.0.76 () {56 vars in 1132 bytes} [Mon May 16 15:02:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:11.653661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0071183-4264-4cce-8c33-827c3479ff55 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:11.759815 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0071183-4264-4cce-8c33-827c3479ff55 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:11.794327 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103b200-9575-41d8-8ced-fdd3fec80d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:11.795403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103b200-9575-41d8-8ced-fdd3fec80d6c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:11.795881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103b200-9575-41d8-8ced-fdd3fec80d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:11.796365 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103b200-9575-41d8-8ced-fdd3fec80d6c None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:11.797267 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103b200-9575-41d8-8ced-fdd3fec80d6c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:11.797763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103b200-9575-41d8-8ced-fdd3fec80d6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:11.799349 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103b200-9575-41d8-8ced-fdd3fec80d6c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:11.805226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 454/899] 10.222.0.76 () {56 vars in 1126 bytes} [Mon May 16 15:02:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:11.811074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0f974-da84-47cb-abf3-3cc59fcc84d7 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:11.902989 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc448da-2a39-4d23-af0b-28ef8066b931 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:11.903590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc448da-2a39-4d23-af0b-28ef8066b931 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:11.904062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc448da-2a39-4d23-af0b-28ef8066b931 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:11.905872 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 455/900] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:11.911279 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a76657-1b32-4736-a8d5-0a9a6dfc7701 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:11.911838 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a76657-1b32-4736-a8d5-0a9a6dfc7701 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:11.912309 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a76657-1b32-4736-a8d5-0a9a6dfc7701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:11.927040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0f974-da84-47cb-abf3-3cc59fcc84d7 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:11.930421 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-18a76657-1b32-4736-a8d5-0a9a6dfc7701 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:11.931837 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-18a76657-1b32-4736-a8d5-0a9a6dfc7701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:11.962530 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d34c0-6b6d-47fe-b96b-5cc2a456caba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:11.963203 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d34c0-6b6d-47fe-b96b-5cc2a456caba None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:11.963474 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d34c0-6b6d-47fe-b96b-5cc2a456caba None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:11.963751 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d34c0-6b6d-47fe-b96b-5cc2a456caba None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:11.964478 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d34c0-6b6d-47fe-b96b-5cc2a456caba None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:11.964909 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d34c0-6b6d-47fe-b96b-5cc2a456caba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:11.966156 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d34c0-6b6d-47fe-b96b-5cc2a456caba None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:11.976528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 446/901] 10.222.0.76 () {56 vars in 1126 bytes} [Mon May 16 15:02:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:11.979089 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d34c0-6b6d-47fe-b96b-5cc2a456caba None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:12.018161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 456/902] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 15:02:12.036372 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59b905-f43b-43fc-9c1e-57966c5822d7 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:12.036660 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59b905-f43b-43fc-9c1e-57966c5822d7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:12.036931 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59b905-f43b-43fc-9c1e-57966c5822d7 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:12.039101 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 457/903] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:02:12.043217 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59b905-f43b-43fc-9c1e-57966c5822d7 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:12.081016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d34c0-6b6d-47fe-b96b-5cc2a456caba None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:12.113916 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71e487-f3a1-4d7a-a453-12065a261ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:12.114927 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71e487-f3a1-4d7a-a453-12065a261ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:12.115435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71e487-f3a1-4d7a-a453-12065a261ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:12.115949 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71e487-f3a1-4d7a-a453-12065a261ea1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:12.118466 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71e487-f3a1-4d7a-a453-12065a261ea1 None admin] RBAC: Adding query filter params (interface=public, service_id=05fb6bd8cf024dde8edc65a39255286e, region_id=RegionOne) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:12.118927 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71e487-f3a1-4d7a-a453-12065a261ea1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:12.120470 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71e487-f3a1-4d7a-a453-12065a261ea1 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:12.126056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 447/904] 10.222.0.76 () {56 vars in 1251 bytes} [Mon May 16 15:02:11 2022] GET /identity/v3/endpoints?service_id=05fb6bd8cf024dde8edc65a39255286e&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:12.127777 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10e1a8-66f3-4d93-9642-350af1c17f65 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:12.128077 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10e1a8-66f3-4d93-9642-350af1c17f65 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:12.128355 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10e1a8-66f3-4d93-9642-350af1c17f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:12.145101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-1d10e1a8-66f3-4d93-9642-350af1c17f65 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:12.146332 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1d10e1a8-66f3-4d93-9642-350af1c17f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:12.147764 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59b905-f43b-43fc-9c1e-57966c5822d7 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:12.185460 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace571d-bbff-4491-944f-94331ae548ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:12.186208 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace571d-bbff-4491-944f-94331ae548ec None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:12.186489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace571d-bbff-4491-944f-94331ae548ec None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:12.186764 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace571d-bbff-4491-944f-94331ae548ec None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:12.197932 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace571d-bbff-4491-944f-94331ae548ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:02:12.205979 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-7ace571d-bbff-4491-944f-94331ae548ec None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 15:02:12.205979 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:12.205979 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:12.205979 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:12.205979 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:12.205979 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:12.205979 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:12.205979 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:12.205979 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:12.205979 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:12.205979 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:12.205979 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:12.205979 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:02:12.205979 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:02:12.205979 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:02:12.205979 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:02:12.207096 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:02:12.207096 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:02:12.207096 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:02:12.207096 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:02:12.207096 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:12.207096 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:12.207096 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:12.207096 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:12.207096 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:12.207096 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:12.207096 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:12.207096 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:12.207096 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:12.207096 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:12.207096 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:12.207096 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:12.207987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:12.207987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:12.207987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:12.207987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:12.207987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:02:12.207987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:02:12.207987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:02:12.207987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:02:12.207987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:02:12.207987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:02:12.207987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 15:02:12.207987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:12.207987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 458/905] 10.222.0.76 () {56 vars in 1120 bytes} [Mon May 16 15:02:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:12.208677 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace571d-bbff-4491-944f-94331ae548ec None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:12.223236 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 448/906] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:12.224323 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10e1a8-66f3-4d93-9642-350af1c17f65 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:12.319034 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace571d-bbff-4491-944f-94331ae548ec None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:12.333511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10e1a8-66f3-4d93-9642-350af1c17f65 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:12.352274 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f854a-1a12-4466-8b3e-8d30d3ac84c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:12.352937 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f854a-1a12-4466-8b3e-8d30d3ac84c1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:12.353485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f854a-1a12-4466-8b3e-8d30d3ac84c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:12.353485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f854a-1a12-4466-8b3e-8d30d3ac84c1 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:12.354178 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f854a-1a12-4466-8b3e-8d30d3ac84c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:12.355543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f854a-1a12-4466-8b3e-8d30d3ac84c1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:12.370366 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 459/907] 10.222.0.76 () {56 vars in 1087 bytes} [Mon May 16 15:02:12 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:02:12.370366 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f854a-1a12-4466-8b3e-8d30d3ac84c1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:12.375159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f17806-0b5e-4490-960b-c995375b5898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:12.375935 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f17806-0b5e-4490-960b-c995375b5898 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:12.376281 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f17806-0b5e-4490-960b-c995375b5898 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:12.376623 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f17806-0b5e-4490-960b-c995375b5898 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:12.377753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f17806-0b5e-4490-960b-c995375b5898 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:12.378165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f17806-0b5e-4490-960b-c995375b5898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:12.379660 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f17806-0b5e-4490-960b-c995375b5898 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:12.389183 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 449/908] 10.222.0.76 () {56 vars in 1115 bytes} [Mon May 16 15:02:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:12.397423 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f17806-0b5e-4490-960b-c995375b5898 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:12.485220 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f854a-1a12-4466-8b3e-8d30d3ac84c1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:12.510273 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f17806-0b5e-4490-960b-c995375b5898 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:12.521915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552eee6-2bae-4103-ba22-4a3a7f96686e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:12.522797 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552eee6-2bae-4103-ba22-4a3a7f96686e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:12.523079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552eee6-2bae-4103-ba22-4a3a7f96686e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:12.523351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552eee6-2bae-4103-ba22-4a3a7f96686e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:12.524020 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552eee6-2bae-4103-ba22-4a3a7f96686e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:12.525426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552eee6-2bae-4103-ba22-4a3a7f96686e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:12.537719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-7552eee6-2bae-4103-ba22-4a3a7f96686e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 15:02:12.537719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:12.537719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 15:02:12.537719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 15:02:12.537719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 15:02:12.537719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 15:02:12.537719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 15:02:12.537719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:12.537719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 15:02:12.537719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:12.537719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:02:12.537719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:12.537719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:12.537719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:12.537719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:12.537719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:12.537719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:12.538850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:12.538850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:12.538850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:12.538850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:12.538850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:12.538850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:12.538850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 15:02:12.538850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 15:02:12.538850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 15:02:12.538850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 15:02:12.538850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:12.538850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:12.538850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:12.538850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:12.538850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:12.538850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:12.539774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:12.539774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:12.539774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:12.539774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:12.539774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:12.539774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:12.539774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:12.539774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:12.539774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:12.539774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:12.539774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 15:02:12.539774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:12.539774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 15:02:12.539774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:12.539774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 460/909] 10.222.0.76 () {56 vars in 1114 bytes} [Mon May 16 15:02:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:12.541108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d5a86-c473-401f-ad95-eee089c1baa4 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:12.541108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d5a86-c473-401f-ad95-eee089c1baa4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:12.541108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d5a86-c473-401f-ad95-eee089c1baa4 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:12.542400 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 461/910] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:12.547191 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d5a86-c473-401f-ad95-eee089c1baa4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:12.552325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2ec06-4bf4-4554-97d8-80eaf75ce7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:12.553135 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2ec06-4bf4-4554-97d8-80eaf75ce7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:12.553436 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2ec06-4bf4-4554-97d8-80eaf75ce7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:12.555491 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2ec06-4bf4-4554-97d8-80eaf75ce7e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:12.567447 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2ec06-4bf4-4554-97d8-80eaf75ce7e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:12.568943 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2ec06-4bf4-4554-97d8-80eaf75ce7e7 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:12.588020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-9de2ec06-4bf4-4554-97d8-80eaf75ce7e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:12.588020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:12.588020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:12.588020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:12.588020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:12.588020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:12.588020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:12.588020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:12.588020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:12.588020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:12.588020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:12.588020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:12.588020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:02:12.588020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:02:12.588020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:02:12.589039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:02:12.589039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:12.589039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:12.589039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:12.589039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:12.589039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:12.589039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:12.589039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:12.589039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:12.589039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:12.589039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:12.589039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:12.589039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:12.589039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:12.589039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:12.589039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:12.589039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:12.598619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:02:12.598619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:02:12.598619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:12.598619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:12.598619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 450/911] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:12.598619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0509b-82c7-49e6-bb87-53f8ed2cf641 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:12.598619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0509b-82c7-49e6-bb87-53f8ed2cf641 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:12.598619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0509b-82c7-49e6-bb87-53f8ed2cf641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:12.615781 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-09f0509b-82c7-49e6-bb87-53f8ed2cf641 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:12.618404 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-09f0509b-82c7-49e6-bb87-53f8ed2cf641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:12.665217 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d5a86-c473-401f-ad95-eee089c1baa4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:12.688658 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 451/912] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:12.689497 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0509b-82c7-49e6-bb87-53f8ed2cf641 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:12.705589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896520f-7d0c-45c0-8e66-66613cf010db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:12.706714 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896520f-7d0c-45c0-8e66-66613cf010db None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:12.707182 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896520f-7d0c-45c0-8e66-66613cf010db None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:12.707795 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896520f-7d0c-45c0-8e66-66613cf010db None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:12.709113 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896520f-7d0c-45c0-8e66-66613cf010db None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:12.709874 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896520f-7d0c-45c0-8e66-66613cf010db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:12.712505 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896520f-7d0c-45c0-8e66-66613cf010db None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:12.719192 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 462/913] 10.222.0.76 () {56 vars in 1114 bytes} [Mon May 16 15:02:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:12.720307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896520f-7d0c-45c0-8e66-66613cf010db None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:12.795601 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0509b-82c7-49e6-bb87-53f8ed2cf641 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:12.820429 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896520f-7d0c-45c0-8e66-66613cf010db None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:12.838076 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea863eb7-bcd6-4d81-9694-5204e4167a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:12.838772 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea863eb7-bcd6-4d81-9694-5204e4167a11 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:12.839046 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea863eb7-bcd6-4d81-9694-5204e4167a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:12.839311 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea863eb7-bcd6-4d81-9694-5204e4167a11 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:12.840027 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea863eb7-bcd6-4d81-9694-5204e4167a11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:12.840320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea863eb7-bcd6-4d81-9694-5204e4167a11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:12.841681 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea863eb7-bcd6-4d81-9694-5204e4167a11 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:12.853186 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 452/914] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:12.853912 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea863eb7-bcd6-4d81-9694-5204e4167a11 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:12.860776 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6791de9-1c48-446f-bd0a-385abcf73a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:12.861444 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6791de9-1c48-446f-bd0a-385abcf73a2b None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:12.861722 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6791de9-1c48-446f-bd0a-385abcf73a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:12.861995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6791de9-1c48-446f-bd0a-385abcf73a2b None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:12.862743 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6791de9-1c48-446f-bd0a-385abcf73a2b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:12.864112 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6791de9-1c48-446f-bd0a-385abcf73a2b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:12.948510 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea863eb7-bcd6-4d81-9694-5204e4167a11 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:12.962395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 463/915] 10.222.0.76 () {60 vars in 1141 bytes} [Mon May 16 15:02:12 2022] POST /identity/v3/services => generated 241 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:02:12.962395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6791de9-1c48-446f-bd0a-385abcf73a2b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:13.017244 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee59db7-a5c8-4c97-888c-cc9a9025856a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:13.018081 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee59db7-a5c8-4c97-888c-cc9a9025856a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:13.018393 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee59db7-a5c8-4c97-888c-cc9a9025856a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:13.019041 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee59db7-a5c8-4c97-888c-cc9a9025856a None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:13.020041 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee59db7-a5c8-4c97-888c-cc9a9025856a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:13.020347 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee59db7-a5c8-4c97-888c-cc9a9025856a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:13.022339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee59db7-a5c8-4c97-888c-cc9a9025856a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:13.030305 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 453/916] 10.222.0.76 () {56 vars in 1114 bytes} [Mon May 16 15:02:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:13.036325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee59db7-a5c8-4c97-888c-cc9a9025856a None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:13.081526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6791de9-1c48-446f-bd0a-385abcf73a2b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:13.124326 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799de5d-79d6-41c9-ae97-b9c563bccb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:13.125159 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799de5d-79d6-41c9-ae97-b9c563bccb51 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:13.125448 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799de5d-79d6-41c9-ae97-b9c563bccb51 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:13.125716 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799de5d-79d6-41c9-ae97-b9c563bccb51 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:13.135848 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799de5d-79d6-41c9-ae97-b9c563bccb51 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:13.137387 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799de5d-79d6-41c9-ae97-b9c563bccb51 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:13.154640 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e799de5d-79d6-41c9-ae97-b9c563bccb51 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 15:02:13.154640 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:13.154640 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:13.154640 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:13.154640 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:13.154640 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:13.154640 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:13.154640 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:13.154640 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:13.154640 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:13.154640 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:13.154640 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:13.154640 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:02:13.154640 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:02:13.154640 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:02:13.154640 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:02:13.155635 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:13.155635 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:13.155635 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:02:13.155635 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:02:13.155635 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:02:13.155635 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:02:13.155635 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:13.155635 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:13.155635 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:13.155635 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:13.155635 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:13.155635 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:13.155635 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:13.155635 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:13.155635 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:13.155635 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:13.155635 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:13.155635 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:13.156553 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:13.156553 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:13.156553 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:02:13.156553 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:02:13.156553 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:02:13.156553 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:02:13.156553 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:02:13.156553 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:02:13.156553 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 15:02:13.156553 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:13.156553 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 464/917] 10.222.0.76 () {56 vars in 1117 bytes} [Mon May 16 15:02:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:13.162637 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799de5d-79d6-41c9-ae97-b9c563bccb51 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:13.163785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee59db7-a5c8-4c97-888c-cc9a9025856a None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:13.198070 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f659bfb-ec82-4788-a411-b8a456f804f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:13.198755 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f659bfb-ec82-4788-a411-b8a456f804f3 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:13.199035 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f659bfb-ec82-4788-a411-b8a456f804f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:13.199304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f659bfb-ec82-4788-a411-b8a456f804f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:13.200382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f659bfb-ec82-4788-a411-b8a456f804f3 None admin] RBAC: Adding query filter params (interface=public, service_id=5b7037219d834947a4b0d353f0859e51, region_id=RegionOne) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:13.200382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f659bfb-ec82-4788-a411-b8a456f804f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:13.202230 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f659bfb-ec82-4788-a411-b8a456f804f3 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:13.207077 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 454/918] 10.222.0.76 () {56 vars in 1251 bytes} [Mon May 16 15:02:13 2022] GET /identity/v3/endpoints?service_id=5b7037219d834947a4b0d353f0859e51&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:13.213518 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f659bfb-ec82-4788-a411-b8a456f804f3 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:13.298291 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799de5d-79d6-41c9-ae97-b9c563bccb51 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:13.315320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f659bfb-ec82-4788-a411-b8a456f804f3 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:13.342352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff5265-a857-41f0-af0b-abd0405bda77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:13.343803 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff5265-a857-41f0-af0b-abd0405bda77 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:13.344430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff5265-a857-41f0-af0b-abd0405bda77 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:13.344987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff5265-a857-41f0-af0b-abd0405bda77 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:13.346234 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff5265-a857-41f0-af0b-abd0405bda77 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:13.346828 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff5265-a857-41f0-af0b-abd0405bda77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:13.348572 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff5265-a857-41f0-af0b-abd0405bda77 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:13.348692 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161de436-36be-451c-b37e-04c2a1db1553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:13.349308 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161de436-36be-451c-b37e-04c2a1db1553 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:13.349656 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161de436-36be-451c-b37e-04c2a1db1553 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:13.349998 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161de436-36be-451c-b37e-04c2a1db1553 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:13.350884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161de436-36be-451c-b37e-04c2a1db1553 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:13.353352 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161de436-36be-451c-b37e-04c2a1db1553 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:13.366666 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 455/919] 10.222.0.76 () {56 vars in 1087 bytes} [Mon May 16 15:02:13 2022] GET /identity/v3/services => generated 1497 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:02:13.378439 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 465/920] 10.222.0.76 () {56 vars in 1149 bytes} [Mon May 16 15:02:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:13.385072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161de436-36be-451c-b37e-04c2a1db1553 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:13.497443 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161de436-36be-451c-b37e-04c2a1db1553 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:13.536419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4767c7a-eac3-43d4-8001-4575f7378ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:13.537304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4767c7a-eac3-43d4-8001-4575f7378ace None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:13.537726 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4767c7a-eac3-43d4-8001-4575f7378ace None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:13.538660 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4767c7a-eac3-43d4-8001-4575f7378ace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:13.552884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4767c7a-eac3-43d4-8001-4575f7378ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:13.553410 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4767c7a-eac3-43d4-8001-4575f7378ace None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:13.572353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-b4767c7a-eac3-43d4-8001-4575f7378ace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:13.572353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:13.572353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:13.572353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:13.572353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:13.572353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:13.572353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:13.572353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:13.572353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:13.572353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:13.572353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:13.572353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:13.572353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:02:13.572353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:02:13.572353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:02:13.574526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:02:13.574526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:13.574526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:13.574526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:13.574526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:13.574526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:13.574526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:13.574526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:13.574526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:13.574526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:13.574526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:13.574526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:13.574526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:13.574526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:13.574526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:13.574526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:13.574526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:13.576633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:02:13.576633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:02:13.576633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:13.576633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:13.576633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 456/921] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:13.580382 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff5265-a857-41f0-af0b-abd0405bda77 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:13.682786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff5265-a857-41f0-af0b-abd0405bda77 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:13.716583 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cd0b5-80de-40e0-b0e9-728f800e1343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:13.717246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cd0b5-80de-40e0-b0e9-728f800e1343 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:13.717521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cd0b5-80de-40e0-b0e9-728f800e1343 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:13.717792 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cd0b5-80de-40e0-b0e9-728f800e1343 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:13.718535 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88cd0b5-80de-40e0-b0e9-728f800e1343 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:13.718834 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88cd0b5-80de-40e0-b0e9-728f800e1343 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:13.720185 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88cd0b5-80de-40e0-b0e9-728f800e1343 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:13.732663 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 466/922] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:13.738056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4767c7a-eac3-43d4-8001-4575f7378ace None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:13.840320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4767c7a-eac3-43d4-8001-4575f7378ace None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:13.877343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4188376-6e31-4235-beb0-7ca96afa5f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:13.878459 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4188376-6e31-4235-beb0-7ca96afa5f52 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:13.878736 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4188376-6e31-4235-beb0-7ca96afa5f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:13.879007 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4188376-6e31-4235-beb0-7ca96afa5f52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:13.886447 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4188376-6e31-4235-beb0-7ca96afa5f52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:13.887900 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4188376-6e31-4235-beb0-7ca96afa5f52 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:13.903182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-d4188376-6e31-4235-beb0-7ca96afa5f52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:02:13.903182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:13.903182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:13.903182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:13.903182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:13.903182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:13.903182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:13.903182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:13.903182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:13.903182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:13.903182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:13.903182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:13.903182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:02:13.903182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:02:13.903182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:02:13.904075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:02:13.904075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:13.904075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:13.904075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:13.904075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:13.904075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:13.904075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:13.904075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:13.904075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:13.904075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:13.904075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:13.904075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:13.904075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:13.904075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:13.904075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:13.904075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:13.904075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:13.905502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:02:13.905502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:02:13.905502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:02:13.905502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:02:13.905502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:02:13.905502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:02:13.905502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:02:13.905502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:13.905502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 457/923] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:02:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:13.910343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cd0b5-80de-40e0-b0e9-728f800e1343 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:14.010087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cd0b5-80de-40e0-b0e9-728f800e1343 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:14.043983 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ef24c-a9bb-4143-9ab6-df05e121776c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:14.044634 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ef24c-a9bb-4143-9ab6-df05e121776c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:14.044913 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ef24c-a9bb-4143-9ab6-df05e121776c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:14.045180 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ef24c-a9bb-4143-9ab6-df05e121776c None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:14.045959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ef24c-a9bb-4143-9ab6-df05e121776c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:14.046297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ef24c-a9bb-4143-9ab6-df05e121776c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:14.047713 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ef24c-a9bb-4143-9ab6-df05e121776c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:14.059974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 467/924] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:02:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:14.067338 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4188376-6e31-4235-beb0-7ca96afa5f52 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:14.167667 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4188376-6e31-4235-beb0-7ca96afa5f52 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:14.202628 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fc2c6-cde2-42a8-b12d-f79c0db1a697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:14.203884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fc2c6-cde2-42a8-b12d-f79c0db1a697 None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:14.204392 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fc2c6-cde2-42a8-b12d-f79c0db1a697 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:14.204857 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fc2c6-cde2-42a8-b12d-f79c0db1a697 None admin] PATH_INFO: `/v3/projects/681a6490f3c04f9fa2830cfde3deb2e9/users/1a7181297bf14a57b3bf1f3c8b178d3c/roles/ab71625c5e074cf3b9b93b50548182f2` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:14.207286 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fc2c6-cde2-42a8-b12d-f79c0db1a697 None admin] RBAC: Authorizing `identity:create_grant(project_id=681a6490f3c04f9fa2830cfde3deb2e9, user_id=1a7181297bf14a57b3bf1f3c8b178d3c, role_id=ab71625c5e074cf3b9b93b50548182f2)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:14.208998 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fc2c6-cde2-42a8-b12d-f79c0db1a697 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:14.337734 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 458/925] 10.222.0.76 () {58 vars in 1439 bytes} [Mon May 16 15:02:14 2022] PUT /identity/v3/projects/681a6490f3c04f9fa2830cfde3deb2e9/users/1a7181297bf14a57b3bf1f3c8b178d3c/roles/ab71625c5e074cf3b9b93b50548182f2 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:02:14.688814 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac263a2b-a380-485a-a814-43141aeefdf5 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:14.689341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac263a2b-a380-485a-a814-43141aeefdf5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:14.689341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac263a2b-a380-485a-a814-43141aeefdf5 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:14.690983 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 468/926] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:14.696942 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc96a6e-4e5f-47fd-a199-db89f3ed78ec None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:14.697785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc96a6e-4e5f-47fd-a199-db89f3ed78ec None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:14.698320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc96a6e-4e5f-47fd-a199-db89f3ed78ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:14.715076 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5cc96a6e-4e5f-47fd-a199-db89f3ed78ec None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:14.716591 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5cc96a6e-4e5f-47fd-a199-db89f3ed78ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:14.783968 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 459/927] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:14.807483 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac263a2b-a380-485a-a814-43141aeefdf5 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:14.922272 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac263a2b-a380-485a-a814-43141aeefdf5 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:14.972512 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef559a-ca3a-4f4d-93d2-02b173149a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:14.973665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef559a-ca3a-4f4d-93d2-02b173149a8d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:14.974194 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef559a-ca3a-4f4d-93d2-02b173149a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:14.974703 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef559a-ca3a-4f4d-93d2-02b173149a8d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:14.975722 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef559a-ca3a-4f4d-93d2-02b173149a8d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:14.977336 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef559a-ca3a-4f4d-93d2-02b173149a8d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:14.989975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-7cef559a-ca3a-4f4d-93d2-02b173149a8d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 15:02:14.989975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:14.989975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 15:02:14.989975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 15:02:14.989975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 15:02:14.989975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 15:02:14.989975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 15:02:14.989975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:14.989975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 15:02:14.989975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:14.989975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:02:14.989975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:14.989975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:14.989975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:14.989975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:14.989975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:14.991470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:14.991470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:14.991470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:14.991470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:14.991470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:14.991470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:14.991470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:14.991470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 15:02:14.991470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 15:02:14.991470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 15:02:14.991470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 15:02:14.991470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:14.991470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:14.991470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:14.991470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:14.991470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:14.992344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:14.992344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:14.992344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:14.992344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:14.992344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:14.992344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:14.992344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:14.992344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:14.992344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:14.992344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:14.992344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:14.992344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 15:02:14.992344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:14.992344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 15:02:14.992344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:14.995279 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 469/928] 10.222.0.76 () {56 vars in 1132 bytes} [Mon May 16 15:02:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:15.001429 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc96a6e-4e5f-47fd-a199-db89f3ed78ec None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:15.098262 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc96a6e-4e5f-47fd-a199-db89f3ed78ec None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:15.139489 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fef025-4be3-4302-b0ad-dd3502af6ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:15.140169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fef025-4be3-4302-b0ad-dd3502af6ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:15.140455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fef025-4be3-4302-b0ad-dd3502af6ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:15.140736 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fef025-4be3-4302-b0ad-dd3502af6ce9 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:15.141457 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fef025-4be3-4302-b0ad-dd3502af6ce9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:15.141768 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fef025-4be3-4302-b0ad-dd3502af6ce9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:15.143246 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fef025-4be3-4302-b0ad-dd3502af6ce9 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:15.149353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 460/929] 10.222.0.76 () {56 vars in 1126 bytes} [Mon May 16 15:02:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:15.154873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef559a-ca3a-4f4d-93d2-02b173149a8d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:15.274217 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef559a-ca3a-4f4d-93d2-02b173149a8d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:15.306519 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc446e7-1ff3-4f26-8dd7-3cdeb3c894ad None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:15.306844 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc446e7-1ff3-4f26-8dd7-3cdeb3c894ad None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:15.307164 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc446e7-1ff3-4f26-8dd7-3cdeb3c894ad None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:15.308700 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 461/930] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:02:15.313686 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90567df9-63f0-45dd-a232-86d68cd35d57 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:15.313978 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90567df9-63f0-45dd-a232-86d68cd35d57 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:15.314299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90567df9-63f0-45dd-a232-86d68cd35d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:15.316791 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372864d2-84bd-4b0e-9395-2411e0bc486d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:15.317707 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372864d2-84bd-4b0e-9395-2411e0bc486d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:15.318242 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372864d2-84bd-4b0e-9395-2411e0bc486d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:15.318716 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372864d2-84bd-4b0e-9395-2411e0bc486d None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:15.320187 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372864d2-84bd-4b0e-9395-2411e0bc486d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:15.320696 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372864d2-84bd-4b0e-9395-2411e0bc486d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:15.322318 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372864d2-84bd-4b0e-9395-2411e0bc486d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:15.327919 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 470/931] 10.222.0.76 () {56 vars in 1126 bytes} [Mon May 16 15:02:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:15.332528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-90567df9-63f0-45dd-a232-86d68cd35d57 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:15.332651 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-90567df9-63f0-45dd-a232-86d68cd35d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:15.333665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372864d2-84bd-4b0e-9395-2411e0bc486d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:15.400548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 462/932] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 15:02:15.423187 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90567df9-63f0-45dd-a232-86d68cd35d57 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:15.436684 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372864d2-84bd-4b0e-9395-2411e0bc486d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:15.471924 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904056b-a7f4-441e-898c-dfefe755806e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:15.472599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904056b-a7f4-441e-898c-dfefe755806e None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:15.472872 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904056b-a7f4-441e-898c-dfefe755806e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:15.473149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904056b-a7f4-441e-898c-dfefe755806e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:15.473950 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904056b-a7f4-441e-898c-dfefe755806e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:15.475421 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904056b-a7f4-441e-898c-dfefe755806e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:15.530335 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90567df9-63f0-45dd-a232-86d68cd35d57 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:15.576400 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284efce-e544-4d36-b136-4afa9c8258ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:15.579756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284efce-e544-4d36-b136-4afa9c8258ee None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:15.579968 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284efce-e544-4d36-b136-4afa9c8258ee None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:15.580432 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284efce-e544-4d36-b136-4afa9c8258ee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:15.581281 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284efce-e544-4d36-b136-4afa9c8258ee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:15.583857 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284efce-e544-4d36-b136-4afa9c8258ee None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:15.598387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-e284efce-e544-4d36-b136-4afa9c8258ee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 15:02:15.598387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:15.598387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 15:02:15.598387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 15:02:15.598387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 15:02:15.598387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 15:02:15.598387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 15:02:15.598387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:15.598387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 15:02:15.598387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:15.598387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:02:15.598387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:15.598387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:15.598387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:15.598387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:15.598387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:15.598387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:15.599463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:15.599463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:15.599463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:15.599463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:15.599463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:15.599463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:15.599463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 15:02:15.599463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 15:02:15.599463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 15:02:15.599463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 15:02:15.599463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:15.599463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:15.599463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:15.599463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:15.599463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:15.599463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:15.600331 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:15.600331 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:15.600331 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:15.600331 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:15.600331 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:15.600331 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:15.600331 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:15.600331 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:15.600331 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:15.600331 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:15.600331 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 15:02:15.600331 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:15.600331 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 15:02:15.600331 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:15.602337 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 463/933] 10.222.0.76 () {56 vars in 1126 bytes} [Mon May 16 15:02:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:02:15.608344 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284efce-e544-4d36-b136-4afa9c8258ee None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:15.622413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 471/934] 10.222.0.76 () {60 vars in 1144 bytes} [Mon May 16 15:02:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:02:15.721479 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284efce-e544-4d36-b136-4afa9c8258ee None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:15.737888 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37a83b-34fb-47ea-bdbc-5a8be1b148ea None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:15.738441 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37a83b-34fb-47ea-bdbc-5a8be1b148ea None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:15.738441 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37a83b-34fb-47ea-bdbc-5a8be1b148ea None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:15.740017 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 472/935] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:15.747317 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a71531-4be7-4c8e-8f03-c3f4646c64e0 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:15.747685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a71531-4be7-4c8e-8f03-c3f4646c64e0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:15.748034 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a71531-4be7-4c8e-8f03-c3f4646c64e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:15.770386 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-62a71531-4be7-4c8e-8f03-c3f4646c64e0 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:15.771997 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-62a71531-4be7-4c8e-8f03-c3f4646c64e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:15.773729 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a210f32-4183-4ed4-894c-51ad7873bfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:15.774659 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a210f32-4183-4ed4-894c-51ad7873bfc4 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:15.775118 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a210f32-4183-4ed4-894c-51ad7873bfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:15.775590 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a210f32-4183-4ed4-894c-51ad7873bfc4 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:15.776508 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a210f32-4183-4ed4-894c-51ad7873bfc4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:15.777047 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a210f32-4183-4ed4-894c-51ad7873bfc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:15.778722 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a210f32-4183-4ed4-894c-51ad7873bfc4 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:15.784717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 464/936] 10.222.0.76 () {56 vars in 1122 bytes} [Mon May 16 15:02:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:15.791179 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a210f32-4183-4ed4-894c-51ad7873bfc4 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:15.858009 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 473/937] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 15:02:15.882337 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a71531-4be7-4c8e-8f03-c3f4646c64e0 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:15.903019 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a210f32-4183-4ed4-894c-51ad7873bfc4 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:15.937560 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1239ba-1cad-4b18-98e6-583435f9411b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:15.938289 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1239ba-1cad-4b18-98e6-583435f9411b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:15.938576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1239ba-1cad-4b18-98e6-583435f9411b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:15.938852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1239ba-1cad-4b18-98e6-583435f9411b None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:15.939560 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1239ba-1cad-4b18-98e6-583435f9411b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:15.939863 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1239ba-1cad-4b18-98e6-583435f9411b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:15.941236 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1239ba-1cad-4b18-98e6-583435f9411b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:15.946904 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 465/938] 10.222.0.76 () {56 vars in 1122 bytes} [Mon May 16 15:02:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:15.955050 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1239ba-1cad-4b18-98e6-583435f9411b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:16.001993 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a71531-4be7-4c8e-8f03-c3f4646c64e0 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:16.045893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084e07a-0774-41db-8dd6-09a9da31db2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:16.047062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084e07a-0774-41db-8dd6-09a9da31db2a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:16.047536 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084e07a-0774-41db-8dd6-09a9da31db2a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:16.047998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084e07a-0774-41db-8dd6-09a9da31db2a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:16.048857 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084e07a-0774-41db-8dd6-09a9da31db2a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:16.050513 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084e07a-0774-41db-8dd6-09a9da31db2a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:16.061961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1239ba-1cad-4b18-98e6-583435f9411b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:16.062877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-8084e07a-0774-41db-8dd6-09a9da31db2a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 15:02:16.062877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:16.062877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 15:02:16.062877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 15:02:16.062877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 15:02:16.062877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 15:02:16.062877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 15:02:16.062877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:16.062877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 15:02:16.062877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:16.062877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:02:16.062877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:16.062877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:16.062877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:16.062877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:16.062877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:16.062877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:16.063842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:16.063842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:16.063842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:16.063842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:16.063842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:16.063842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:16.063842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 15:02:16.063842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 15:02:16.063842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 15:02:16.063842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 15:02:16.063842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:16.063842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:16.063842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:16.063842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:16.063842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:16.063842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:16.064676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:16.064676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:16.064676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:16.064676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:16.064676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:16.064676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:16.064676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:16.064676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:16.064676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:16.064676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:16.064676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 15:02:16.064676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:16.064676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 15:02:16.064676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:16.067477 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 474/939] 10.222.0.76 () {56 vars in 1114 bytes} [Mon May 16 15:02:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:02:16.079522 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084e07a-0774-41db-8dd6-09a9da31db2a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:16.096667 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48caa23d-8e0e-4261-80b3-e88267f056e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:16.097365 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48caa23d-8e0e-4261-80b3-e88267f056e3 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:16.097732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48caa23d-8e0e-4261-80b3-e88267f056e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:16.097920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48caa23d-8e0e-4261-80b3-e88267f056e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:16.098767 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48caa23d-8e0e-4261-80b3-e88267f056e3 None admin] RBAC: Adding query filter params (interface=public, service_id=3c4282cdddfd4e97a1d8cf5e407fa8c0, region_id=RegionOne) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:16.099051 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48caa23d-8e0e-4261-80b3-e88267f056e3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:16.100976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48caa23d-8e0e-4261-80b3-e88267f056e3 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:16.106363 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 466/940] 10.222.0.76 () {56 vars in 1251 bytes} [Mon May 16 15:02:15 2022] GET /identity/v3/endpoints?service_id=3c4282cdddfd4e97a1d8cf5e407fa8c0&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:16.111572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48caa23d-8e0e-4261-80b3-e88267f056e3 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:16.199415 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084e07a-0774-41db-8dd6-09a9da31db2a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:16.234460 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2a271-87cd-495e-b4e3-b47a1456fe21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:16.235543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2a271-87cd-495e-b4e3-b47a1456fe21 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:16.235652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48caa23d-8e0e-4261-80b3-e88267f056e3 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:16.236136 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2a271-87cd-495e-b4e3-b47a1456fe21 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:16.236606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2a271-87cd-495e-b4e3-b47a1456fe21 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:16.237530 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2a271-87cd-495e-b4e3-b47a1456fe21 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:16.238030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2a271-87cd-495e-b4e3-b47a1456fe21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:16.239704 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2a271-87cd-495e-b4e3-b47a1456fe21 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:16.245262 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 475/941] 10.222.0.76 () {56 vars in 1114 bytes} [Mon May 16 15:02:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:16.250393 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2a271-87cd-495e-b4e3-b47a1456fe21 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:16.281061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba8159-5893-4ca3-9148-6267e6524535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:16.281898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba8159-5893-4ca3-9148-6267e6524535 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:16.282204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba8159-5893-4ca3-9148-6267e6524535 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:16.282482 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba8159-5893-4ca3-9148-6267e6524535 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:16.283476 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba8159-5893-4ca3-9148-6267e6524535 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:16.285108 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba8159-5893-4ca3-9148-6267e6524535 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:16.294182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 467/942] 10.222.0.76 () {56 vars in 1087 bytes} [Mon May 16 15:02:16 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:02:16.366745 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2a271-87cd-495e-b4e3-b47a1456fe21 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:16.404450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765f7fd-cf84-4a4f-b624-18bed1004ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:16.405120 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765f7fd-cf84-4a4f-b624-18bed1004ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:16.405395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765f7fd-cf84-4a4f-b624-18bed1004ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:16.405665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765f7fd-cf84-4a4f-b624-18bed1004ca0 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:16.406412 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765f7fd-cf84-4a4f-b624-18bed1004ca0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:16.406713 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765f7fd-cf84-4a4f-b624-18bed1004ca0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:16.408199 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765f7fd-cf84-4a4f-b624-18bed1004ca0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:16.418553 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 476/943] 10.222.0.76 () {56 vars in 1114 bytes} [Mon May 16 15:02:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:16.420023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba8159-5893-4ca3-9148-6267e6524535 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:16.526223 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba8159-5893-4ca3-9148-6267e6524535 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:16.568990 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386a49c-6d45-4bf4-9930-d2ae1a48e432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:16.569683 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386a49c-6d45-4bf4-9930-d2ae1a48e432 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:16.569964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386a49c-6d45-4bf4-9930-d2ae1a48e432 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:16.570273 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386a49c-6d45-4bf4-9930-d2ae1a48e432 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:16.571036 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386a49c-6d45-4bf4-9930-d2ae1a48e432 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:16.572525 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386a49c-6d45-4bf4-9930-d2ae1a48e432 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:16.699756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 468/944] 10.222.0.76 () {60 vars in 1144 bytes} [Mon May 16 15:02:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:02:16.759373 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56ffa1-4ec0-4733-8cbb-21355709a855 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:16.760376 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56ffa1-4ec0-4733-8cbb-21355709a855 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:16.760853 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56ffa1-4ec0-4733-8cbb-21355709a855 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:16.762589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 477/945] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:02:16.768609 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9bc5f-7edf-4b70-a0e5-9066d8d53e30 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:16.769604 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9bc5f-7edf-4b70-a0e5-9066d8d53e30 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:16.770089 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9bc5f-7edf-4b70-a0e5-9066d8d53e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:16.788769 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-84e9bc5f-7edf-4b70-a0e5-9066d8d53e30 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:16.790343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-84e9bc5f-7edf-4b70-a0e5-9066d8d53e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:16.874355 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 469/946] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:16.898035 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56ffa1-4ec0-4733-8cbb-21355709a855 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:17.000032 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56ffa1-4ec0-4733-8cbb-21355709a855 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:17.033492 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4454dc-4b76-4152-bd9c-50361a8461d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:17.034326 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4454dc-4b76-4152-bd9c-50361a8461d6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:17.034604 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4454dc-4b76-4152-bd9c-50361a8461d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:17.034876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4454dc-4b76-4152-bd9c-50361a8461d6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:17.045322 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4454dc-4b76-4152-bd9c-50361a8461d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:02:17.053958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-8b4454dc-4b76-4152-bd9c-50361a8461d6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 15:02:17.053958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:17.053958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:17.053958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:17.053958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:17.053958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:17.053958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:17.053958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:17.053958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:17.053958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:17.053958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:17.053958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:17.053958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:02:17.053958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:02:17.053958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:02:17.053958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:02:17.054995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:02:17.054995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:02:17.054995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:02:17.054995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:02:17.054995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:17.054995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:17.054995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:17.054995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:17.054995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:17.054995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:17.054995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:17.054995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:17.054995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:17.054995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:17.054995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:17.054995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:17.055840 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:17.055840 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:17.055840 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:17.055840 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:17.055840 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:02:17.055840 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:02:17.055840 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:02:17.055840 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:02:17.055840 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:02:17.055840 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:02:17.055840 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 15:02:17.055840 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:17.055840 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 478/947] 10.222.0.76 () {56 vars in 1120 bytes} [Mon May 16 15:02:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:17.061253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9bc5f-7edf-4b70-a0e5-9066d8d53e30 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:17.162050 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9bc5f-7edf-4b70-a0e5-9066d8d53e30 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:17.197196 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36822c10-29d2-41c6-98a6-2566f1ea8eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:17.197875 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36822c10-29d2-41c6-98a6-2566f1ea8eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:17.198178 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36822c10-29d2-41c6-98a6-2566f1ea8eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:17.198460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36822c10-29d2-41c6-98a6-2566f1ea8eb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:17.199208 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36822c10-29d2-41c6-98a6-2566f1ea8eb1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:17.199512 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36822c10-29d2-41c6-98a6-2566f1ea8eb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:17.200880 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36822c10-29d2-41c6-98a6-2566f1ea8eb1 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:17.209118 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 470/948] 10.222.0.76 () {56 vars in 1115 bytes} [Mon May 16 15:02:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:17.214834 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4454dc-4b76-4152-bd9c-50361a8461d6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:17.313039 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4454dc-4b76-4152-bd9c-50361a8461d6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:17.346857 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d2f9f-3b6f-4369-8873-a7351a94838b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:17.347646 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d2f9f-3b6f-4369-8873-a7351a94838b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:17.347921 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d2f9f-3b6f-4369-8873-a7351a94838b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:17.348190 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d2f9f-3b6f-4369-8873-a7351a94838b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:17.358117 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d2f9f-3b6f-4369-8873-a7351a94838b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:17.359585 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d2f9f-3b6f-4369-8873-a7351a94838b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:17.376728 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-2e9d2f9f-3b6f-4369-8873-a7351a94838b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:17.376728 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:17.376728 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:17.376728 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:17.376728 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:17.376728 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:17.376728 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:17.376728 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:17.376728 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:17.376728 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:17.376728 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:17.376728 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:17.376728 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:02:17.376728 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:02:17.376728 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:02:17.378111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:02:17.378111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:17.378111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:17.378111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:17.378111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:17.378111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:17.378111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:17.378111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:17.378111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:17.378111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:17.378111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:17.378111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:17.378111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:17.378111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:17.378111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:17.378111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:17.378111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:17.379171 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:02:17.379171 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:02:17.379171 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:17.379171 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:17.379171 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 479/949] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:17.384740 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36822c10-29d2-41c6-98a6-2566f1ea8eb1 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:17.490472 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36822c10-29d2-41c6-98a6-2566f1ea8eb1 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:17.526474 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34de37-a82b-4b79-a64b-3e8facc714da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:17.527143 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34de37-a82b-4b79-a64b-3e8facc714da None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:17.527428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34de37-a82b-4b79-a64b-3e8facc714da None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:17.527705 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34de37-a82b-4b79-a64b-3e8facc714da None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:17.528434 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34de37-a82b-4b79-a64b-3e8facc714da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:17.528740 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34de37-a82b-4b79-a64b-3e8facc714da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:17.530118 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34de37-a82b-4b79-a64b-3e8facc714da None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:17.542808 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 471/950] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:17.547920 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d2f9f-3b6f-4369-8873-a7351a94838b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:17.659828 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d2f9f-3b6f-4369-8873-a7351a94838b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:17.694352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b961c9-ee34-42a0-9a17-20aeb282a6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:17.695165 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b961c9-ee34-42a0-9a17-20aeb282a6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:17.695445 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b961c9-ee34-42a0-9a17-20aeb282a6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:17.695726 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b961c9-ee34-42a0-9a17-20aeb282a6d3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:17.703306 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b961c9-ee34-42a0-9a17-20aeb282a6d3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:17.704774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b961c9-ee34-42a0-9a17-20aeb282a6d3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:17.726150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-17b961c9-ee34-42a0-9a17-20aeb282a6d3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 15:02:17.726150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:17.726150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:17.726150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:17.726150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:17.726150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:17.726150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:17.726150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:17.726150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:17.726150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:17.726150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:17.726150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:17.726150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:02:17.726150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:02:17.726150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:02:17.726150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:02:17.727154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:17.727154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:17.727154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:02:17.727154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:02:17.727154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:02:17.727154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:02:17.727154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:17.727154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:17.727154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:17.727154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:17.727154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:17.727154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:17.727154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:17.727154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:17.727154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:17.727154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:17.727154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:17.727154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:17.728082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:17.728082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:17.728082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:02:17.728082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:02:17.728082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:02:17.728082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:02:17.728082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:02:17.728082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:02:17.728082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 15:02:17.728082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:17.728082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 480/951] 10.222.0.76 () {56 vars in 1117 bytes} [Mon May 16 15:02:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:17.733362 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34de37-a82b-4b79-a64b-3e8facc714da None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:17.831094 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34de37-a82b-4b79-a64b-3e8facc714da None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:17.869278 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74f9ae-1dcf-4f48-b1d2-4515ff73661b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:17.869958 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74f9ae-1dcf-4f48-b1d2-4515ff73661b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:17.870278 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74f9ae-1dcf-4f48-b1d2-4515ff73661b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:17.870559 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74f9ae-1dcf-4f48-b1d2-4515ff73661b None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:17.871406 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74f9ae-1dcf-4f48-b1d2-4515ff73661b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:17.871715 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74f9ae-1dcf-4f48-b1d2-4515ff73661b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:17.873141 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74f9ae-1dcf-4f48-b1d2-4515ff73661b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:17.892211 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 472/952] 10.222.0.76 () {56 vars in 1149 bytes} [Mon May 16 15:02:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:17.897466 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b961c9-ee34-42a0-9a17-20aeb282a6d3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:18.011274 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b961c9-ee34-42a0-9a17-20aeb282a6d3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:18.040306 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b46dfd-18bf-497d-9423-97d33b967df5 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:18.040663 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b46dfd-18bf-497d-9423-97d33b967df5 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:18.040874 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b46dfd-18bf-497d-9423-97d33b967df5 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:18.042729 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 473/953] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:02:18.048191 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63853f6d-220a-4ad6-b192-00c45833fdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:18.048624 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a337490-1659-4745-a6a8-6a58f76c5159 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:18.048856 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63853f6d-220a-4ad6-b192-00c45833fdbd None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:18.048976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a337490-1659-4745-a6a8-6a58f76c5159 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:18.049161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63853f6d-220a-4ad6-b192-00c45833fdbd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:18.049256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a337490-1659-4745-a6a8-6a58f76c5159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:18.049401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63853f6d-220a-4ad6-b192-00c45833fdbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:18.066063 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-1a337490-1659-4745-a6a8-6a58f76c5159 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:18.067283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1a337490-1659-4745-a6a8-6a58f76c5159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:18.118985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63853f6d-220a-4ad6-b192-00c45833fdbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:18.120492 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63853f6d-220a-4ad6-b192-00c45833fdbd None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:18.142467 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 474/954] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:18.159259 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a337490-1659-4745-a6a8-6a58f76c5159 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:18.223937 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 481/955] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:02:17 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 15:02:18.229444 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63853f6d-220a-4ad6-b192-00c45833fdbd None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:18.259255 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a337490-1659-4745-a6a8-6a58f76c5159 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:18.293696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31cab3-9c85-4876-ae61-d92620819ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:18.294526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31cab3-9c85-4876-ae61-d92620819ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:18.294809 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31cab3-9c85-4876-ae61-d92620819ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:18.295081 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31cab3-9c85-4876-ae61-d92620819ed3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:18.295737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31cab3-9c85-4876-ae61-d92620819ed3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:18.297240 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31cab3-9c85-4876-ae61-d92620819ed3 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:18.309097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-6c31cab3-9c85-4876-ae61-d92620819ed3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 15:02:18.309097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:18.309097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 15:02:18.309097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 15:02:18.309097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 15:02:18.309097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 15:02:18.309097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 15:02:18.309097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:18.309097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 15:02:18.309097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:18.309097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:02:18.309097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:18.309097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:18.309097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:18.309097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:18.309097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:18.309097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:18.310150 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:18.310150 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:18.310150 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:18.310150 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:18.310150 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:18.310150 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:18.310150 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 15:02:18.310150 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 15:02:18.310150 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 15:02:18.310150 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 15:02:18.310150 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:18.310150 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:18.310150 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:18.310150 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:18.310150 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:18.310150 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:18.311988 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:18.311988 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:18.311988 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:18.311988 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:18.311988 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:18.311988 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:18.311988 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:18.311988 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:18.311988 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:18.311988 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:18.311988 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 15:02:18.311988 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:18.311988 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 15:02:18.311988 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:18.318166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 475/956] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:02:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:02:18.318166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31cab3-9c85-4876-ae61-d92620819ed3 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:18.329395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63853f6d-220a-4ad6-b192-00c45833fdbd None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:18.369230 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44601c-a7ce-4dc1-925a-582345017552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:18.370023 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44601c-a7ce-4dc1-925a-582345017552 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:18.370347 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44601c-a7ce-4dc1-925a-582345017552 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:18.370676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44601c-a7ce-4dc1-925a-582345017552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:18.380867 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44601c-a7ce-4dc1-925a-582345017552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:18.382959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44601c-a7ce-4dc1-925a-582345017552 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:18.400763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-3c44601c-a7ce-4dc1-925a-582345017552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:18.400763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:18.400763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:18.400763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:18.400763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:18.400763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:18.400763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:18.400763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:18.400763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:18.400763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:18.400763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:18.400763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:18.400763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:02:18.400763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:02:18.400763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:02:18.402952 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:02:18.402952 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:18.402952 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:18.402952 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:18.402952 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:18.402952 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:18.402952 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:18.402952 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:18.402952 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:18.402952 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:18.402952 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:18.402952 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:18.402952 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:18.402952 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:18.402952 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:18.402952 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:18.402952 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:18.405175 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:02:18.405175 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:02:18.405175 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:18.405175 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:18.410152 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 482/957] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:02:18.410152 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44601c-a7ce-4dc1-925a-582345017552 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:18.419773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31cab3-9c85-4876-ae61-d92620819ed3 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:18.457048 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae98df-8a2a-475c-b38d-d533e068af92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:18.457785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae98df-8a2a-475c-b38d-d533e068af92 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:18.458193 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae98df-8a2a-475c-b38d-d533e068af92 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:18.458474 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae98df-8a2a-475c-b38d-d533e068af92 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:18.459194 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae98df-8a2a-475c-b38d-d533e068af92 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:18.460035 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae98df-8a2a-475c-b38d-d533e068af92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:18.461434 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae98df-8a2a-475c-b38d-d533e068af92 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:18.470228 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 476/958] 10.222.0.76 () {56 vars in 1112 bytes} [Mon May 16 15:02:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:18.472572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae98df-8a2a-475c-b38d-d533e068af92 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:18.511493 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44601c-a7ce-4dc1-925a-582345017552 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:18.546574 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd41f2-75b7-4268-8b11-79303d41afc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:18.547236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd41f2-75b7-4268-8b11-79303d41afc1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:18.547519 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd41f2-75b7-4268-8b11-79303d41afc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:18.547788 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd41f2-75b7-4268-8b11-79303d41afc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:18.548508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd41f2-75b7-4268-8b11-79303d41afc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:18.548809 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd41f2-75b7-4268-8b11-79303d41afc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:18.550254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd41f2-75b7-4268-8b11-79303d41afc1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:18.571800 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 483/959] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:18.572778 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd41f2-75b7-4268-8b11-79303d41afc1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:18.574857 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae98df-8a2a-475c-b38d-d533e068af92 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:18.612804 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d13cf-84f0-448a-b056-586595ed4b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:18.613809 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d13cf-84f0-448a-b056-586595ed4b87 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:18.614312 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d13cf-84f0-448a-b056-586595ed4b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:18.614808 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d13cf-84f0-448a-b056-586595ed4b87 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:18.616248 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d13cf-84f0-448a-b056-586595ed4b87 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:18.616705 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d13cf-84f0-448a-b056-586595ed4b87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:18.618330 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d13cf-84f0-448a-b056-586595ed4b87 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:18.630337 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 477/960] 10.222.0.76 () {56 vars in 1112 bytes} [Mon May 16 15:02:18 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:18.632450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b12ffd-5eb7-4359-90be-de017d60db3e None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:18.632742 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b12ffd-5eb7-4359-90be-de017d60db3e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:18.633022 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b12ffd-5eb7-4359-90be-de017d60db3e None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:18.638281 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 478/961] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:18.640824 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43170adf-006e-4aae-9ed3-4915189e7174 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:18.641114 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43170adf-006e-4aae-9ed3-4915189e7174 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:18.641415 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43170adf-006e-4aae-9ed3-4915189e7174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:18.666033 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-43170adf-006e-4aae-9ed3-4915189e7174 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:18.669795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-43170adf-006e-4aae-9ed3-4915189e7174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:18.688336 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd41f2-75b7-4268-8b11-79303d41afc1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:18.726634 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1e966-37ba-4835-a4e2-9eebe09186c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:18.727451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1e966-37ba-4835-a4e2-9eebe09186c1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:18.727731 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1e966-37ba-4835-a4e2-9eebe09186c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:18.728007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1e966-37ba-4835-a4e2-9eebe09186c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:18.737772 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe1e966-37ba-4835-a4e2-9eebe09186c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:18.739527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe1e966-37ba-4835-a4e2-9eebe09186c1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:18.760929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-abe1e966-37ba-4835-a4e2-9eebe09186c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:02:18.760929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:18.760929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:18.760929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:18.760929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:18.760929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:18.760929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:18.760929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:18.760929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:18.760929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:18.760929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:18.760929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:18.760929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:02:18.760929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:02:18.760929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:02:18.761901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:02:18.761901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:18.761901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:18.761901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:18.761901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:18.761901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:18.761901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:18.761901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:18.761901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:18.761901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:18.761901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:18.761901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:18.761901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:18.761901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:18.761901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:18.761901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:18.761901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:18.762846 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:02:18.762846 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:02:18.762846 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:02:18.762846 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:02:18.762846 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:02:18.762846 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:02:18.762846 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:02:18.762846 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:18.765841 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 479/962] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 15:02:18.767276 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 484/963] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:02:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:18.768165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43170adf-006e-4aae-9ed3-4915189e7174 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:18.789470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1e966-37ba-4835-a4e2-9eebe09186c1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:18.890791 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43170adf-006e-4aae-9ed3-4915189e7174 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:18.906426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1e966-37ba-4835-a4e2-9eebe09186c1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:18.930682 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58144825-9e02-4d23-9b7c-a048ef080f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:18.931509 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58144825-9e02-4d23-9b7c-a048ef080f06 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:18.932110 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58144825-9e02-4d23-9b7c-a048ef080f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:18.932397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58144825-9e02-4d23-9b7c-a048ef080f06 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:18.933476 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58144825-9e02-4d23-9b7c-a048ef080f06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:18.933929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58144825-9e02-4d23-9b7c-a048ef080f06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:18.936000 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58144825-9e02-4d23-9b7c-a048ef080f06 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:18.949813 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 480/964] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:02:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:18.955279 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58144825-9e02-4d23-9b7c-a048ef080f06 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:18.956160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d26c3-8db9-40b8-b19f-6caf5819c4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:18.957003 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d26c3-8db9-40b8-b19f-6caf5819c4eb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:18.957282 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d26c3-8db9-40b8-b19f-6caf5819c4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:18.957555 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d26c3-8db9-40b8-b19f-6caf5819c4eb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:18.958275 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d26c3-8db9-40b8-b19f-6caf5819c4eb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:18.960211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d26c3-8db9-40b8-b19f-6caf5819c4eb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:18.975679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-698d26c3-8db9-40b8-b19f-6caf5819c4eb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 15:02:18.975679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:18.975679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 15:02:18.975679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 15:02:18.975679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 15:02:18.975679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 15:02:18.975679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 15:02:18.975679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:18.975679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 15:02:18.975679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:18.975679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:02:18.975679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:18.975679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:18.975679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:18.975679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:18.975679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:18.975679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:18.976708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:18.976708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:18.976708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:18.976708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:18.976708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:18.976708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:18.976708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 15:02:18.976708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 15:02:18.976708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 15:02:18.976708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 15:02:18.976708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:18.976708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:18.976708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:18.976708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:18.976708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:18.976708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:18.977531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:18.977531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:18.977531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:18.977531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:18.977531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:18.977531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:18.977531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:18.977531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:18.977531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:18.977531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:18.977531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 15:02:18.977531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:18.977531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 15:02:18.977531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:18.977531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 485/965] 10.222.0.76 () {56 vars in 1126 bytes} [Mon May 16 15:02:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:02:18.983499 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d26c3-8db9-40b8-b19f-6caf5819c4eb None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:19.070299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58144825-9e02-4d23-9b7c-a048ef080f06 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:19.111007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d26c3-8db9-40b8-b19f-6caf5819c4eb None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:19.114388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1426917-760d-4980-a98f-0f36dbd6b840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:19.115301 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1426917-760d-4980-a98f-0f36dbd6b840 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:19.116315 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1426917-760d-4980-a98f-0f36dbd6b840 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:19.116784 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1426917-760d-4980-a98f-0f36dbd6b840 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:19.117804 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1426917-760d-4980-a98f-0f36dbd6b840 None admin] RBAC: Adding query filter params (role.id=ab71625c5e074cf3b9b93b50548182f2, scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9, user.id=1a7181297bf14a57b3bf1f3c8b178d3c) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:19.118352 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1426917-760d-4980-a98f-0f36dbd6b840 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:19.120335 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1426917-760d-4980-a98f-0f36dbd6b840 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:19.134683 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 481/966] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:02:18 2022] GET /identity/v3/role_assignments?user.id=1a7181297bf14a57b3bf1f3c8b178d3c&scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9&role.id=ab71625c5e074cf3b9b93b50548182f2 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:19.151041 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319f424-0a08-4a64-bc65-3560b1788b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:19.151643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319f424-0a08-4a64-bc65-3560b1788b20 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:19.151928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319f424-0a08-4a64-bc65-3560b1788b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:19.152205 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319f424-0a08-4a64-bc65-3560b1788b20 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:19.152933 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319f424-0a08-4a64-bc65-3560b1788b20 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:19.153241 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319f424-0a08-4a64-bc65-3560b1788b20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:19.154803 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319f424-0a08-4a64-bc65-3560b1788b20 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:19.165333 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 486/967] 10.222.0.76 () {56 vars in 1122 bytes} [Mon May 16 15:02:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:19.166975 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1426917-760d-4980-a98f-0f36dbd6b840 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:19.195344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc71fe1-37fa-4cf8-acf7-9c0bdaaaad8d None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:19.195344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc71fe1-37fa-4cf8-acf7-9c0bdaaaad8d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:19.195607 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc71fe1-37fa-4cf8-acf7-9c0bdaaaad8d None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:19.197161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 487/968] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:02:19.203123 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf9c5b-b16f-4c73-9476-745c4d89a266 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:19.203559 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf9c5b-b16f-4c73-9476-745c4d89a266 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:19.203943 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf9c5b-b16f-4c73-9476-745c4d89a266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:19.222445 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-babf9c5b-b16f-4c73-9476-745c4d89a266 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:19.223843 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-babf9c5b-b16f-4c73-9476-745c4d89a266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:19.305934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 488/969] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:19.306162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1426917-760d-4980-a98f-0f36dbd6b840 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:19.321517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf9c5b-b16f-4c73-9476-745c4d89a266 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:19.344579 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035c27f-fcd9-4360-9d95-0a6989e2bd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:19.345249 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035c27f-fcd9-4360-9d95-0a6989e2bd7c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:19.345544 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035c27f-fcd9-4360-9d95-0a6989e2bd7c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:19.345809 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035c27f-fcd9-4360-9d95-0a6989e2bd7c None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:19.346548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035c27f-fcd9-4360-9d95-0a6989e2bd7c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:19.346858 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035c27f-fcd9-4360-9d95-0a6989e2bd7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:19.348224 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035c27f-fcd9-4360-9d95-0a6989e2bd7c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:19.353740 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 482/970] 10.222.0.76 () {56 vars in 1122 bytes} [Mon May 16 15:02:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:19.359422 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035c27f-fcd9-4360-9d95-0a6989e2bd7c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:19.443446 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf9c5b-b16f-4c73-9476-745c4d89a266 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:19.479267 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fdaa6-f488-4e70-812a-d4d3cc2558f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:19.480046 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fdaa6-f488-4e70-812a-d4d3cc2558f4 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:19.480046 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fdaa6-f488-4e70-812a-d4d3cc2558f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:19.480189 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fdaa6-f488-4e70-812a-d4d3cc2558f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:19.486155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fdaa6-f488-4e70-812a-d4d3cc2558f4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:19.486308 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035c27f-fcd9-4360-9d95-0a6989e2bd7c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:19.486414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fdaa6-f488-4e70-812a-d4d3cc2558f4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:19.486810 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: WARNING keystone.server.flask.common [None req-4d7fdaa6-f488-4e70-812a-d4d3cc2558f4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 16 15:02:19.521401 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627373fe-4d0f-46e5-ad18-1dcb8fd7afc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:19.522089 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627373fe-4d0f-46e5-ad18-1dcb8fd7afc0 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:19.522405 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627373fe-4d0f-46e5-ad18-1dcb8fd7afc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:19.522682 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627373fe-4d0f-46e5-ad18-1dcb8fd7afc0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:19.523425 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627373fe-4d0f-46e5-ad18-1dcb8fd7afc0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:19.524804 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627373fe-4d0f-46e5-ad18-1dcb8fd7afc0 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:19.563298 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.sql.core [None req-4d7fdaa6-f488-4e70-812a-d4d3cc2558f4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 15:02:19.563298 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 16 15:02:19.563298 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [parameters: {'id': '82b0853d9db5476db89b84dcdf532d35', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 16 15:02:19.563298 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80319) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 15:02:19.582395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-4d7fdaa6-f488-4e70-812a-d4d3cc2558f4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 82b0853d9db5476db89b84dcdf532d35.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 82b0853d9db5476db89b84dcdf532d35. May 16 15:02:19.582395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:19.582395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 15:02:19.582395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 15:02:19.582395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 15:02:19.582395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 15:02:19.582395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 15:02:19.582395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result = self._query(query) May 16 15:02:19.582395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 15:02:19.582395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application conn.query(q) May 16 15:02:19.582395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 15:02:19.582395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 15:02:19.582395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 15:02:19.584164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result.read() May 16 15:02:19.584164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 15:02:19.584164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 15:02:19.584164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 15:02:19.584164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 15:02:19.584164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 15:02:19.584164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 15:02:19.584164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 15:02:19.584164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 15:02:19.584164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 15:02:19.584164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:19.584164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 15:02:19.584164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:19.584164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:19.584164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 15:02:19.584164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 15:02:19.584164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 16 15:02:19.584164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return project_ref.to_dict() May 16 15:02:19.586526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 15:02:19.586526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application next(self.gen) May 16 15:02:19.586526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 15:02:19.586526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application yield resource May 16 15:02:19.586526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 15:02:19.586526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application next(self.gen) May 16 15:02:19.586526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 15:02:19.586526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.session.rollback() May 16 15:02:19.586526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 15:02:19.586526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.force_reraise() May 16 15:02:19.586526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 15:02:19.586526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise self.value May 16 15:02:19.586526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 15:02:19.586526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 15:02:19.586526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 15:02:19.586526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application session.commit() May 16 15:02:19.586526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 15:02:19.588995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 15:02:19.588995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 15:02:19.588995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._prepare_impl() May 16 15:02:19.588995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 15:02:19.588995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.session.flush() May 16 15:02:19.588995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 15:02:19.588995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._flush(objects) May 16 15:02:19.588995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 15:02:19.588995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 15:02:19.588995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 15:02:19.588995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application compat.raise_( May 16 15:02:19.588995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 15:02:19.588995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception May 16 15:02:19.588995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 15:02:19.588995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application flush_context.execute() May 16 15:02:19.588995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 15:02:19.588995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rec.execute(self) May 16 15:02:19.591697 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 15:02:19.591697 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 15:02:19.591697 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 15:02:19.591697 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 15:02:19.591697 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 16 15:02:19.591697 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application c = connection._execute_20( May 16 15:02:19.591697 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 15:02:19.591697 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 15:02:19.591697 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 15:02:19.591697 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 15:02:19.591697 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 15:02:19.591697 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 15:02:19.591697 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 15:02:19.591697 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 15:02:19.591697 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 15:02:19.593624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 15:02:19.593624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 15:02:19.593624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception May 16 15:02:19.593624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 15:02:19.593624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 15:02:19.593624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 15:02:19.593624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 15:02:19.593624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 15:02:19.593624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result = self._query(query) May 16 15:02:19.593624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 15:02:19.593624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application conn.query(q) May 16 15:02:19.593624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 15:02:19.593624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 15:02:19.593624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 15:02:19.593624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result.read() May 16 15:02:19.593624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 15:02:19.593624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 15:02:19.595606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 15:02:19.595606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 15:02:19.595606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 15:02:19.595606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 15:02:19.595606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 15:02:19.595606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 15:02:19.595606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 15:02:19.595606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 16 15:02:19.595606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [parameters: {'id': '82b0853d9db5476db89b84dcdf532d35', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 16 15:02:19.595606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 15:02:19.595606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:19.595606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:02:19.595606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:19.595606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:19.595606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 16 15:02:19.597517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 16 15:02:19.597517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 15:02:19.597517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 15:02:19.597517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 16 15:02:19.597517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:19.597517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:02:19.597517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:19.597517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:19.597517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:19.597517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:19.597517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:19.597517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:19.597517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:19.597517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:19.597517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:19.597517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:19.597517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:19.599693 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:19.599693 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 16 15:02:19.599693 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 16 15:02:19.599693 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:19.599693 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:19.599693 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 16 15:02:19.599693 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.Conflict( May 16 15:02:19.599693 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 82b0853d9db5476db89b84dcdf532d35. May 16 15:02:19.599693 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:19.599693 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 489/971] 10.222.0.76 () {60 vars in 1140 bytes} [Mon May 16 15:02:19 2022] POST /identity/v3/projects => generated 262 bytes in 263 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 16 15:02:19.599693 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fdaa6-f488-4e70-812a-d4d3cc2558f4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:19.662154 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 483/972] 10.222.0.76 () {60 vars in 1144 bytes} [Mon May 16 15:02:19 2022] POST /identity/v3/endpoints => generated 349 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:02:19.710467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fdaa6-f488-4e70-812a-d4d3cc2558f4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:19.757712 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ec6c9-cf6f-4801-82d2-63b98f42d93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:19.758551 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ec6c9-cf6f-4801-82d2-63b98f42d93d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:19.758826 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ec6c9-cf6f-4801-82d2-63b98f42d93d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:19.759092 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ec6c9-cf6f-4801-82d2-63b98f42d93d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:19.766784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ec6c9-cf6f-4801-82d2-63b98f42d93d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:19.768494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ec6c9-cf6f-4801-82d2-63b98f42d93d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:19.783967 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-4a7ec6c9-cf6f-4801-82d2-63b98f42d93d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:02:19.783967 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:19.783967 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:19.783967 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:19.783967 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:19.783967 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:19.783967 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:19.783967 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:19.783967 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:19.783967 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:19.783967 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:19.783967 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:19.783967 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:02:19.783967 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:02:19.783967 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:02:19.784934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:02:19.784934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:19.784934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:19.784934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:19.784934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:19.784934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:19.784934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:19.784934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:19.784934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:19.784934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:19.784934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:19.784934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:19.784934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:19.784934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:19.784934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:19.784934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:19.784934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:19.785875 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:02:19.785875 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:02:19.785875 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:02:19.785875 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:02:19.785875 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:02:19.785875 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:02:19.785875 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:02:19.785875 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:19.785875 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 490/973] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:02:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:02:19.791513 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627373fe-4d0f-46e5-ad18-1dcb8fd7afc0 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:19.897844 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627373fe-4d0f-46e5-ad18-1dcb8fd7afc0 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:19.931508 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5d13c-5c57-4800-90bb-5d2b99acd874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:19.932172 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5d13c-5c57-4800-90bb-5d2b99acd874 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:19.932451 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5d13c-5c57-4800-90bb-5d2b99acd874 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:19.932725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5d13c-5c57-4800-90bb-5d2b99acd874 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:19.933477 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5d13c-5c57-4800-90bb-5d2b99acd874 None admin] RBAC: Adding query filter params (name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:19.933775 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5d13c-5c57-4800-90bb-5d2b99acd874 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:19.936531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5d13c-5c57-4800-90bb-5d2b99acd874 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:19.954823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 484/974] 10.222.0.76 () {56 vars in 1112 bytes} [Mon May 16 15:02:19 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:20.915546 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44342d78-f484-408d-a340-8b9dcf7855ab None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:20.916065 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44342d78-f484-408d-a340-8b9dcf7855ab None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:20.916143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44342d78-f484-408d-a340-8b9dcf7855ab None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:20.917716 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 491/975] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:20.923180 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa22fa-9980-408a-9e6d-88f170fff4d6 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:20.924030 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa22fa-9980-408a-9e6d-88f170fff4d6 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:20.924513 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa22fa-9980-408a-9e6d-88f170fff4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:20.941888 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-e9aa22fa-9980-408a-9e6d-88f170fff4d6 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:20.943391 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e9aa22fa-9980-408a-9e6d-88f170fff4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:21.013441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 485/976] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 15:02:21.035704 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44342d78-f484-408d-a340-8b9dcf7855ab None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:21.142018 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44342d78-f484-408d-a340-8b9dcf7855ab None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:21.177111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3735f-2ba9-4465-93cf-d1d3c17bb4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:21.178043 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3735f-2ba9-4465-93cf-d1d3c17bb4a9 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:21.178502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3735f-2ba9-4465-93cf-d1d3c17bb4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:21.178953 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3735f-2ba9-4465-93cf-d1d3c17bb4a9 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:21.179839 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3735f-2ba9-4465-93cf-d1d3c17bb4a9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:21.181367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3735f-2ba9-4465-93cf-d1d3c17bb4a9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:21.266868 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 492/977] 10.222.0.76 () {60 vars in 1141 bytes} [Mon May 16 15:02:21 2022] POST /identity/v3/services => generated 242 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:02:21.475751 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737c91b-14a5-4569-8a46-cba69c3ea0fb None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:21.476408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737c91b-14a5-4569-8a46-cba69c3ea0fb None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:21.476927 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737c91b-14a5-4569-8a46-cba69c3ea0fb None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:21.478980 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 486/978] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:02:21.485067 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000b8f6-e115-4937-863a-1f62a7b70f70 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:21.485646 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000b8f6-e115-4937-863a-1f62a7b70f70 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:21.486188 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000b8f6-e115-4937-863a-1f62a7b70f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:21.513929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1000b8f6-e115-4937-863a-1f62a7b70f70 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:21.515894 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1000b8f6-e115-4937-863a-1f62a7b70f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:21.594266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 493/979] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:21.625332 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737c91b-14a5-4569-8a46-cba69c3ea0fb None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:21.732693 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737c91b-14a5-4569-8a46-cba69c3ea0fb None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:21.767059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109984d-a13f-4d10-a0e0-828cc68ec245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:21.767856 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109984d-a13f-4d10-a0e0-828cc68ec245 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:21.768134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109984d-a13f-4d10-a0e0-828cc68ec245 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:21.768404 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109984d-a13f-4d10-a0e0-828cc68ec245 None admin] PATH_INFO: `/v3/services/image` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:21.769057 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109984d-a13f-4d10-a0e0-828cc68ec245 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:21.770455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109984d-a13f-4d10-a0e0-828cc68ec245 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:21.782584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-0109984d-a13f-4d10-a0e0-828cc68ec245 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 15:02:21.782584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:21.782584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 15:02:21.782584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 15:02:21.782584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 15:02:21.782584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 15:02:21.782584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 15:02:21.782584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:21.782584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 15:02:21.782584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:21.782584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:02:21.782584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:21.782584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:21.782584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:21.782584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:21.782584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:21.782584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:21.783681 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:21.783681 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:21.783681 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:21.783681 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:21.783681 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:21.783681 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:21.783681 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 15:02:21.783681 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 15:02:21.783681 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 15:02:21.783681 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 15:02:21.783681 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:21.783681 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:21.783681 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:21.783681 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:21.783681 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:21.783681 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:21.784823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:21.784823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:21.784823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:21.784823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:21.784823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:21.784823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:21.784823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:21.784823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:21.784823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:21.784823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:21.784823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 15:02:21.784823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:21.784823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 15:02:21.784823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:21.784823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 487/980] 10.222.0.76 () {56 vars in 1105 bytes} [Mon May 16 15:02:21 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:21.792756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000b8f6-e115-4937-863a-1f62a7b70f70 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:21.896942 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000b8f6-e115-4937-863a-1f62a7b70f70 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:21.935734 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306baa9-1219-434e-ad78-a5fa77899712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:21.937325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306baa9-1219-434e-ad78-a5fa77899712 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:21.937881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306baa9-1219-434e-ad78-a5fa77899712 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:21.938410 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306baa9-1219-434e-ad78-a5fa77899712 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:21.939425 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306baa9-1219-434e-ad78-a5fa77899712 None admin] RBAC: Adding query filter params (name=image) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:21.939977 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306baa9-1219-434e-ad78-a5fa77899712 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:21.941623 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306baa9-1219-434e-ad78-a5fa77899712 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:21.952386 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 494/981] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:21.954036 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109984d-a13f-4d10-a0e0-828cc68ec245 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:22.058981 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109984d-a13f-4d10-a0e0-828cc68ec245 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:22.095684 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f918761-1e37-44ec-8174-10ac5edc9eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:22.096783 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f918761-1e37-44ec-8174-10ac5edc9eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:22.097277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f918761-1e37-44ec-8174-10ac5edc9eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:22.097760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f918761-1e37-44ec-8174-10ac5edc9eb8 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:22.098929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f918761-1e37-44ec-8174-10ac5edc9eb8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:22.099556 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f918761-1e37-44ec-8174-10ac5edc9eb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:22.101777 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f918761-1e37-44ec-8174-10ac5edc9eb8 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:22.112442 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 488/982] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:21 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:22.114470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b135e4e-68dc-4381-9967-1897b36915b0 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:22.115015 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b135e4e-68dc-4381-9967-1897b36915b0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:22.116075 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b135e4e-68dc-4381-9967-1897b36915b0 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:22.117916 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 495/983] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:22.123842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d5808-312d-4311-beb5-8fd9a30ece21 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:22.124125 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d5808-312d-4311-beb5-8fd9a30ece21 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:22.124582 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d5808-312d-4311-beb5-8fd9a30ece21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:22.144493 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-dc7d5808-312d-4311-beb5-8fd9a30ece21 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:22.146021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-dc7d5808-312d-4311-beb5-8fd9a30ece21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:22.221219 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 496/984] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 15:02:22.244611 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f918761-1e37-44ec-8174-10ac5edc9eb8 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:22.286176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1053d0-a781-4c5b-988c-155674cc732c None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:22.286176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1053d0-a781-4c5b-988c-155674cc732c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:22.286176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1053d0-a781-4c5b-988c-155674cc732c None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:22.288037 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 497/985] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:02:22.293310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fd766-8696-4df0-91ee-b259a0725365 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:22.293814 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fd766-8696-4df0-91ee-b259a0725365 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:22.294277 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fd766-8696-4df0-91ee-b259a0725365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:22.311872 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7c6fd766-8696-4df0-91ee-b259a0725365 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:22.312997 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7c6fd766-8696-4df0-91ee-b259a0725365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:22.358726 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f918761-1e37-44ec-8174-10ac5edc9eb8 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:22.392924 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 498/986] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 15:02:22.393319 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc9f99-356d-4996-87cd-729581d73e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:22.394447 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc9f99-356d-4996-87cd-729581d73e74 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:22.394931 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc9f99-356d-4996-87cd-729581d73e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:22.395437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc9f99-356d-4996-87cd-729581d73e74 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:22.396304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc9f99-356d-4996-87cd-729581d73e74 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:22.398486 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc9f99-356d-4996-87cd-729581d73e74 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:22.410727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-88dc9f99-356d-4996-87cd-729581d73e74 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 15:02:22.410727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:22.410727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 15:02:22.410727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 15:02:22.410727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 15:02:22.410727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 15:02:22.410727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 15:02:22.410727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:22.410727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 15:02:22.410727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:22.410727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:02:22.410727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:22.410727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:22.410727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:22.410727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:22.410727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:22.410727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:22.411732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:22.411732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:22.411732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:22.411732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:22.411732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:22.411732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:22.411732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 15:02:22.411732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 15:02:22.411732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 15:02:22.411732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 15:02:22.411732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:22.411732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:22.411732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:22.411732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:22.411732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:22.411732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:22.413189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:22.413189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:22.413189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:22.413189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:22.413189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:22.413189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:22.413189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:22.413189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:22.413189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:22.413189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:22.413189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 15:02:22.413189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:22.413189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 15:02:22.413189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:22.415987 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 489/987] 10.222.0.76 () {56 vars in 1126 bytes} [Mon May 16 15:02:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:22.420638 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fd766-8696-4df0-91ee-b259a0725365 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:22.422191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc9f99-356d-4996-87cd-729581d73e74 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:22.527514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc9f99-356d-4996-87cd-729581d73e74 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:22.545824 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fd766-8696-4df0-91ee-b259a0725365 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:22.561481 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e93d1-821b-44ee-920f-b4b9e7153219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:22.562676 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e93d1-821b-44ee-920f-b4b9e7153219 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:22.563184 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e93d1-821b-44ee-920f-b4b9e7153219 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:22.563678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e93d1-821b-44ee-920f-b4b9e7153219 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:22.564618 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e93d1-821b-44ee-920f-b4b9e7153219 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:22.565126 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e93d1-821b-44ee-920f-b4b9e7153219 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:22.566742 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e93d1-821b-44ee-920f-b4b9e7153219 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:22.577295 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 490/988] 10.222.0.76 () {56 vars in 1122 bytes} [Mon May 16 15:02:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:22.578441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e93d1-821b-44ee-920f-b4b9e7153219 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:22.596279 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3edab4-cd5c-4bb5-b8a7-dc8565bb1d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:22.596964 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3edab4-cd5c-4bb5-b8a7-dc8565bb1d55 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:22.597253 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3edab4-cd5c-4bb5-b8a7-dc8565bb1d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:22.597508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3edab4-cd5c-4bb5-b8a7-dc8565bb1d55 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:22.598256 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3edab4-cd5c-4bb5-b8a7-dc8565bb1d55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:22.599910 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3edab4-cd5c-4bb5-b8a7-dc8565bb1d55 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:22.663609 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.sql.core [None req-df3edab4-cd5c-4bb5-b8a7-dc8565bb1d55 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 15:02:22.663609 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 16 15:02:22.663609 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [parameters: {'user_id': '237fbe02808243fbb4c478276ca1c920', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 16 15:02:22.663609 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80319) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 15:02:22.673170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-df3edab4-cd5c-4bb5-b8a7-dc8565bb1d55 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 16 15:02:22.673170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:22.673170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 15:02:22.673170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 15:02:22.673170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 15:02:22.673170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 15:02:22.673170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 15:02:22.673170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result = self._query(query) May 16 15:02:22.673170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 15:02:22.673170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application conn.query(q) May 16 15:02:22.673170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 15:02:22.673170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 15:02:22.673170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 15:02:22.673170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result.read() May 16 15:02:22.673170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 15:02:22.676086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 15:02:22.676086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 15:02:22.676086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 15:02:22.676086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 15:02:22.676086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 15:02:22.676086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 15:02:22.676086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 15:02:22.676086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 15:02:22.676086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:22.676086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 15:02:22.676086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:22.676086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:22.676086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 15:02:22.676086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 15:02:22.676086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 16 15:02:22.676086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 16 15:02:22.676086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 15:02:22.676086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application next(self.gen) May 16 15:02:22.677082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 15:02:22.677082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application yield resource May 16 15:02:22.677082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 15:02:22.677082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application next(self.gen) May 16 15:02:22.677082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 15:02:22.677082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.session.rollback() May 16 15:02:22.677082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 15:02:22.677082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.force_reraise() May 16 15:02:22.677082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 15:02:22.677082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise self.value May 16 15:02:22.677082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 15:02:22.677082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 15:02:22.677082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 15:02:22.677082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application session.commit() May 16 15:02:22.677082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 15:02:22.677082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 15:02:22.677082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 15:02:22.678044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._prepare_impl() May 16 15:02:22.678044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 15:02:22.678044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.session.flush() May 16 15:02:22.678044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 15:02:22.678044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._flush(objects) May 16 15:02:22.678044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 15:02:22.678044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 15:02:22.678044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 15:02:22.678044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application compat.raise_( May 16 15:02:22.678044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 15:02:22.678044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception May 16 15:02:22.678044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 15:02:22.678044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application flush_context.execute() May 16 15:02:22.678044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 15:02:22.678044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rec.execute(self) May 16 15:02:22.678044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 15:02:22.678044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 15:02:22.680987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 15:02:22.680987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 15:02:22.680987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 16 15:02:22.680987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result = connection._execute_20( May 16 15:02:22.680987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 15:02:22.680987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 15:02:22.680987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 15:02:22.680987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 15:02:22.680987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 15:02:22.680987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 15:02:22.680987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 15:02:22.680987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 15:02:22.680987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 15:02:22.680987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 15:02:22.680987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 15:02:22.680987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception May 16 15:02:22.683030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 15:02:22.683030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 15:02:22.683030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 15:02:22.683030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 15:02:22.683030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 15:02:22.683030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result = self._query(query) May 16 15:02:22.683030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 15:02:22.683030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application conn.query(q) May 16 15:02:22.683030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 15:02:22.683030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 15:02:22.683030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 15:02:22.683030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result.read() May 16 15:02:22.683030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 15:02:22.683030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 15:02:22.683030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 15:02:22.683030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 15:02:22.685155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 15:02:22.685155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 15:02:22.685155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 15:02:22.685155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 15:02:22.685155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 15:02:22.685155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 16 15:02:22.685155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [parameters: {'user_id': '237fbe02808243fbb4c478276ca1c920', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 16 15:02:22.685155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 15:02:22.685155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:22.685155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:02:22.685155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:22.685155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:22.685155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:22.685155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:22.685155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:22.687437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:22.687437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:22.687437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:22.687437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:22.687437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:22.687437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:22.687437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:22.687437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 16 15:02:22.687437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 16 15:02:22.687437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:22.687437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:22.687437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:02:22.687437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:02:22.687437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:02:22.687437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:02:22.687437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 16 15:02:22.687437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 16 15:02:22.691408 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 16 15:02:22.691408 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 16 15:02:22.691408 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 15:02:22.691408 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 15:02:22.691408 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 16 15:02:22.691408 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:22.691408 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 499/989] 10.222.0.76 () {60 vars in 1131 bytes} [Mon May 16 15:02:22 2022] POST /identity/v3/users => generated 160 bytes in 256 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 16 15:02:22.692459 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e93d1-821b-44ee-920f-b4b9e7153219 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:22.692609 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3edab4-cd5c-4bb5-b8a7-dc8565bb1d55 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:22.736946 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c183d-b267-460f-9d65-0f692fce96ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:22.738093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c183d-b267-460f-9d65-0f692fce96ef None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:22.738636 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c183d-b267-460f-9d65-0f692fce96ef None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:22.738958 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c183d-b267-460f-9d65-0f692fce96ef None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:22.740169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c183d-b267-460f-9d65-0f692fce96ef None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:22.741035 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c183d-b267-460f-9d65-0f692fce96ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:22.742791 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c183d-b267-460f-9d65-0f692fce96ef None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:22.749171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 491/990] 10.222.0.76 () {56 vars in 1122 bytes} [Mon May 16 15:02:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:22.755288 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c183d-b267-460f-9d65-0f692fce96ef None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:22.805998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3edab4-cd5c-4bb5-b8a7-dc8565bb1d55 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:22.840022 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295678f-9569-4bbb-8a71-755a02f59227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:22.841133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295678f-9569-4bbb-8a71-755a02f59227 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:22.841625 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295678f-9569-4bbb-8a71-755a02f59227 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:22.842165 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295678f-9569-4bbb-8a71-755a02f59227 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:22.851198 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295678f-9569-4bbb-8a71-755a02f59227 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:22.853154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295678f-9569-4bbb-8a71-755a02f59227 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:22.865514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c183d-b267-460f-9d65-0f692fce96ef None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:22.868744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-5295678f-9569-4bbb-8a71-755a02f59227 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 15:02:22.868744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:22.868744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:22.868744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:22.868744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:22.868744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:22.868744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:22.868744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:22.868744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:22.868744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:22.868744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:22.868744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:22.868744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:02:22.868744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:02:22.868744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:02:22.868744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:02:22.869689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:22.869689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:22.869689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:02:22.869689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:02:22.869689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:02:22.869689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:02:22.869689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:22.869689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:22.869689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:22.869689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:22.869689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:22.869689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:22.869689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:22.869689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:22.869689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:22.869689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:22.869689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:22.869689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:22.870668 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:22.870668 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:22.870668 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:02:22.870668 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:02:22.870668 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:02:22.870668 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:02:22.870668 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:02:22.870668 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:02:22.870668 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 15:02:22.870668 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:22.873316 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 500/991] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:02:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:22.879916 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295678f-9569-4bbb-8a71-755a02f59227 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:22.911190 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ab273-9d9a-4379-af5a-124528988ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:22.912941 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ab273-9d9a-4379-af5a-124528988ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:22.913388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ab273-9d9a-4379-af5a-124528988ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:22.913768 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ab273-9d9a-4379-af5a-124528988ca2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:22.914902 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ab273-9d9a-4379-af5a-124528988ca2 None admin] RBAC: Adding query filter params (interface=admin, service_id=3c4282cdddfd4e97a1d8cf5e407fa8c0, region_id=RegionOne) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:22.915645 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ab273-9d9a-4379-af5a-124528988ca2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:22.917653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ab273-9d9a-4379-af5a-124528988ca2 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:22.929514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 492/992] 10.222.0.76 () {56 vars in 1249 bytes} [Mon May 16 15:02:22 2022] GET /identity/v3/endpoints?service_id=3c4282cdddfd4e97a1d8cf5e407fa8c0&interface=admin®ion_id=RegionOne => generated 193 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:22.931076 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ab273-9d9a-4379-af5a-124528988ca2 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:23.000845 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295678f-9569-4bbb-8a71-755a02f59227 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:23.041932 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e385703-0742-4460-b31b-f79f1b7c65df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:23.043217 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385703-0742-4460-b31b-f79f1b7c65df None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:23.043879 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385703-0742-4460-b31b-f79f1b7c65df None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:23.044299 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385703-0742-4460-b31b-f79f1b7c65df None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:23.045431 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e385703-0742-4460-b31b-f79f1b7c65df None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:23.046201 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e385703-0742-4460-b31b-f79f1b7c65df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:23.048243 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e385703-0742-4460-b31b-f79f1b7c65df None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:23.051662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ab273-9d9a-4379-af5a-124528988ca2 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:23.088087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4d968-2a7b-4b12-b18e-6b9700a31892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:23.088993 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4d968-2a7b-4b12-b18e-6b9700a31892 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:23.089374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4d968-2a7b-4b12-b18e-6b9700a31892 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:23.089756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4d968-2a7b-4b12-b18e-6b9700a31892 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:23.090694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4d968-2a7b-4b12-b18e-6b9700a31892 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:23.092113 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4d968-2a7b-4b12-b18e-6b9700a31892 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:23.106161 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 493/993] 10.222.0.76 () {56 vars in 1087 bytes} [Mon May 16 15:02:22 2022] GET /identity/v3/services => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:02:23.106365 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 501/994] 10.222.0.76 () {56 vars in 1101 bytes} [Mon May 16 15:02:22 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:23.618822 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af40ae-9f52-4b77-86ec-8674e6b6ccd4 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:23.619113 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af40ae-9f52-4b77-86ec-8674e6b6ccd4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:23.619392 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af40ae-9f52-4b77-86ec-8674e6b6ccd4 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:23.620907 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 494/995] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:23.625946 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cae628-9f09-4b97-9bfd-5750cfa58a86 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:23.626267 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cae628-9f09-4b97-9bfd-5750cfa58a86 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:23.626552 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cae628-9f09-4b97-9bfd-5750cfa58a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:23.643370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-35cae628-9f09-4b97-9bfd-5750cfa58a86 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:23.644858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-35cae628-9f09-4b97-9bfd-5750cfa58a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:23.710313 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 502/996] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:23.732768 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af40ae-9f52-4b77-86ec-8674e6b6ccd4 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:23.829726 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af40ae-9f52-4b77-86ec-8674e6b6ccd4 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:23.862892 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f1a11-ff32-415e-93b2-853e300aa700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:23.863683 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f1a11-ff32-415e-93b2-853e300aa700 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:23.863961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f1a11-ff32-415e-93b2-853e300aa700 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:23.864232 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f1a11-ff32-415e-93b2-853e300aa700 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:23.864878 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f1a11-ff32-415e-93b2-853e300aa700 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:23.866934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f1a11-ff32-415e-93b2-853e300aa700 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:23.878965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-665f1a11-ff32-415e-93b2-853e300aa700 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 15:02:23.878965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:23.878965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 15:02:23.878965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 15:02:23.878965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 15:02:23.878965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 15:02:23.878965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 15:02:23.878965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:23.878965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 15:02:23.878965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:23.878965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:02:23.878965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:23.878965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:23.878965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:23.878965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:23.878965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:23.878965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:23.879971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:23.879971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:23.879971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:23.879971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:23.879971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:23.879971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:23.879971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 15:02:23.879971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 15:02:23.879971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 15:02:23.879971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 15:02:23.879971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:23.879971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:23.879971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:23.879971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:23.879971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:23.879971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:23.880823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:23.880823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:23.880823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:23.880823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:23.880823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:23.880823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:23.880823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:23.880823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:23.880823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:23.880823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:23.880823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 15:02:23.880823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:23.880823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 15:02:23.880823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:23.888924 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 495/997] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:02:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:23.889462 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cae628-9f09-4b97-9bfd-5750cfa58a86 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:23.985035 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cae628-9f09-4b97-9bfd-5750cfa58a86 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:24.018772 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed77f8-b642-4c39-8156-ea3998a4ea10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:24.019529 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed77f8-b642-4c39-8156-ea3998a4ea10 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:24.019714 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed77f8-b642-4c39-8156-ea3998a4ea10 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:24.019992 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed77f8-b642-4c39-8156-ea3998a4ea10 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:24.020700 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed77f8-b642-4c39-8156-ea3998a4ea10 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:24.021008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed77f8-b642-4c39-8156-ea3998a4ea10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:24.022445 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed77f8-b642-4c39-8156-ea3998a4ea10 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:24.031968 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 503/998] 10.222.0.76 () {56 vars in 1112 bytes} [Mon May 16 15:02:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:24.032919 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f1a11-ff32-415e-93b2-853e300aa700 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:24.129664 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f1a11-ff32-415e-93b2-853e300aa700 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:24.161123 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ad81a-1587-47ff-8330-415e654f31bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:24.161780 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ad81a-1587-47ff-8330-415e654f31bf None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:24.162605 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ad81a-1587-47ff-8330-415e654f31bf None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:24.162895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ad81a-1587-47ff-8330-415e654f31bf None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:24.163597 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ad81a-1587-47ff-8330-415e654f31bf None admin] RBAC: Adding query filter params (type=compute) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:24.163901 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ad81a-1587-47ff-8330-415e654f31bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:24.165266 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ad81a-1587-47ff-8330-415e654f31bf None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:24.174564 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 496/999] 10.222.0.76 () {56 vars in 1112 bytes} [Mon May 16 15:02:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:24.175629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed77f8-b642-4c39-8156-ea3998a4ea10 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:24.280253 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed77f8-b642-4c39-8156-ea3998a4ea10 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:24.314716 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d27a8c-6c25-409e-a373-024b52ad81ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:24.315376 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d27a8c-6c25-409e-a373-024b52ad81ee None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:24.315658 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d27a8c-6c25-409e-a373-024b52ad81ee None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:24.315935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d27a8c-6c25-409e-a373-024b52ad81ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:24.316720 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d27a8c-6c25-409e-a373-024b52ad81ee None admin] RBAC: Adding query filter params (interface=public, service_id=6ebb2060996648e1bb63b6b05564d038, region_id=RegionOne) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:24.317031 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d27a8c-6c25-409e-a373-024b52ad81ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:24.318972 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d27a8c-6c25-409e-a373-024b52ad81ee None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:24.328397 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 504/1000] 10.222.0.76 () {56 vars in 1251 bytes} [Mon May 16 15:02:24 2022] GET /identity/v3/endpoints?service_id=6ebb2060996648e1bb63b6b05564d038&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:24.329646 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ad81a-1587-47ff-8330-415e654f31bf None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:24.435654 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ad81a-1587-47ff-8330-415e654f31bf None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:24.436306 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc9693-345e-43fa-8547-ac2870fc0783 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:24.436596 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc9693-345e-43fa-8547-ac2870fc0783 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:24.436868 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc9693-345e-43fa-8547-ac2870fc0783 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:24.438446 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 505/1001] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:24.443205 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419e0cf-0a97-4bd6-8f68-4c6e5fe4bd57 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:24.444054 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419e0cf-0a97-4bd6-8f68-4c6e5fe4bd57 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:24.444368 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419e0cf-0a97-4bd6-8f68-4c6e5fe4bd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:24.460502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e419e0cf-0a97-4bd6-8f68-4c6e5fe4bd57 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:24.461528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baccbff-6446-4ed4-9074-150db7401fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:24.461737 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e419e0cf-0a97-4bd6-8f68-4c6e5fe4bd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:24.462258 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baccbff-6446-4ed4-9074-150db7401fec None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:24.462517 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baccbff-6446-4ed4-9074-150db7401fec None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:24.462791 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baccbff-6446-4ed4-9074-150db7401fec None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:24.463465 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baccbff-6446-4ed4-9074-150db7401fec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:24.464832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baccbff-6446-4ed4-9074-150db7401fec None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:24.471007 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 497/1002] 10.222.0.76 () {56 vars in 1087 bytes} [Mon May 16 15:02:24 2022] GET /identity/v3/services => generated 1727 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:02:24.534595 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 506/1003] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:24 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 15:02:24.558163 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baccbff-6446-4ed4-9074-150db7401fec None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:24.670713 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baccbff-6446-4ed4-9074-150db7401fec None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:24.703718 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29d3f1-7c67-4ffc-a5aa-b0b1bbfa4269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:24.704608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29d3f1-7c67-4ffc-a5aa-b0b1bbfa4269 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:24.705036 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29d3f1-7c67-4ffc-a5aa-b0b1bbfa4269 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:24.705481 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29d3f1-7c67-4ffc-a5aa-b0b1bbfa4269 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:24.706389 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29d3f1-7c67-4ffc-a5aa-b0b1bbfa4269 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:24.707904 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29d3f1-7c67-4ffc-a5aa-b0b1bbfa4269 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:24.820153 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 498/1004] 10.222.0.76 () {60 vars in 1141 bytes} [Mon May 16 15:02:24 2022] POST /identity/v3/services => generated 242 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:02:25.421896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828930c2-e57e-40ac-ae71-e2774cf3b04b None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:25.426344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828930c2-e57e-40ac-ae71-e2774cf3b04b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:25.426344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828930c2-e57e-40ac-ae71-e2774cf3b04b None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:25.426344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 507/1005] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:25.429152 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f856bd4-707a-4801-bf33-88911cfc06de None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:25.429533 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f856bd4-707a-4801-bf33-88911cfc06de None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:25.429704 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f856bd4-707a-4801-bf33-88911cfc06de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:25.446096 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0f856bd4-707a-4801-bf33-88911cfc06de None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:25.447335 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0f856bd4-707a-4801-bf33-88911cfc06de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:25.516304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 499/1006] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:25 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:25.539207 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828930c2-e57e-40ac-ae71-e2774cf3b04b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:25.652207 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828930c2-e57e-40ac-ae71-e2774cf3b04b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:25.684757 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1f18b-c268-4a69-a143-dfe779289af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:25.685472 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1f18b-c268-4a69-a143-dfe779289af6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:25.685749 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1f18b-c268-4a69-a143-dfe779289af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:25.686018 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1f18b-c268-4a69-a143-dfe779289af6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:25.686706 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1f18b-c268-4a69-a143-dfe779289af6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:25.688062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1f18b-c268-4a69-a143-dfe779289af6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:25.700088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-5ab1f18b-c268-4a69-a143-dfe779289af6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 15:02:25.700088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:25.700088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 15:02:25.700088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 15:02:25.700088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 15:02:25.700088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 15:02:25.700088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 15:02:25.700088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:25.700088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 15:02:25.700088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:25.700088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:02:25.700088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:25.700088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:25.700088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:25.700088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:25.700088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:25.700088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:25.701087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:25.701087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:25.701087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:25.701087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:25.701087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:25.701087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:25.701087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 15:02:25.701087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 15:02:25.701087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 15:02:25.701087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 15:02:25.701087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:25.701087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:25.701087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:25.701087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:25.701087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:25.701087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:25.701955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:25.701955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:25.701955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:25.701955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:25.701955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:25.701955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:25.701955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:25.701955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:25.701955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:25.701955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:25.701955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 15:02:25.701955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:25.701955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 15:02:25.701955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:25.701955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 508/1007] 10.222.0.76 () {56 vars in 1126 bytes} [Mon May 16 15:02:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:25.707335 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f856bd4-707a-4801-bf33-88911cfc06de None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:25.801638 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f856bd4-707a-4801-bf33-88911cfc06de None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:25.833553 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b16e24-5aa3-401a-8608-4e3546ab29a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:25.834796 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b16e24-5aa3-401a-8608-4e3546ab29a2 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:25.835078 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b16e24-5aa3-401a-8608-4e3546ab29a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:25.835347 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b16e24-5aa3-401a-8608-4e3546ab29a2 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:25.836043 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b16e24-5aa3-401a-8608-4e3546ab29a2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:25.836346 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b16e24-5aa3-401a-8608-4e3546ab29a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:25.837706 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b16e24-5aa3-401a-8608-4e3546ab29a2 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:25.842513 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 500/1008] 10.222.0.76 () {56 vars in 1122 bytes} [Mon May 16 15:02:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:25.847944 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1f18b-c268-4a69-a143-dfe779289af6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:25.944628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1f18b-c268-4a69-a143-dfe779289af6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:25.987891 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1682fc0-c9ed-4935-bf0b-9bfb22bb367a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:25.988566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1682fc0-c9ed-4935-bf0b-9bfb22bb367a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:25.988850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1682fc0-c9ed-4935-bf0b-9bfb22bb367a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:25.989127 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1682fc0-c9ed-4935-bf0b-9bfb22bb367a None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:25.989835 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1682fc0-c9ed-4935-bf0b-9bfb22bb367a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:25.990179 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1682fc0-c9ed-4935-bf0b-9bfb22bb367a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:25.991558 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1682fc0-c9ed-4935-bf0b-9bfb22bb367a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:26.001032 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 509/1009] 10.222.0.76 () {56 vars in 1122 bytes} [Mon May 16 15:02:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:26.002525 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b16e24-5aa3-401a-8608-4e3546ab29a2 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:26.098030 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b16e24-5aa3-401a-8608-4e3546ab29a2 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:26.130709 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51e4bd-33e9-421d-83aa-f445171b4302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:26.131878 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51e4bd-33e9-421d-83aa-f445171b4302 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:26.132156 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51e4bd-33e9-421d-83aa-f445171b4302 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:26.132425 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51e4bd-33e9-421d-83aa-f445171b4302 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:26.133158 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51e4bd-33e9-421d-83aa-f445171b4302 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:26.134552 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51e4bd-33e9-421d-83aa-f445171b4302 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:26.214241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 501/1010] 10.222.0.76 () {60 vars in 1144 bytes} [Mon May 16 15:02:26 2022] POST /identity/v3/endpoints => generated 325 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:02:26.736469 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f2284-4953-4788-b13a-95d40437b026 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:26.736976 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f2284-4953-4788-b13a-95d40437b026 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:26.737084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f2284-4953-4788-b13a-95d40437b026 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:26.738566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 510/1011] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:26.743671 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec956f-3807-4bd7-8367-c075147e7624 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:26.744050 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec956f-3807-4bd7-8367-c075147e7624 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:26.744212 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec956f-3807-4bd7-8367-c075147e7624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:26.760769 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a8ec956f-3807-4bd7-8367-c075147e7624 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:26.761924 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a8ec956f-3807-4bd7-8367-c075147e7624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:26.833186 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 502/1012] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:26 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:26.856882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f2284-4953-4788-b13a-95d40437b026 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:26.960687 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f2284-4953-4788-b13a-95d40437b026 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:26.993210 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbd481-3d67-496e-aefa-9ff291b03209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:26.994001 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbd481-3d67-496e-aefa-9ff291b03209 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:26.994315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbd481-3d67-496e-aefa-9ff291b03209 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:26.994593 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbd481-3d67-496e-aefa-9ff291b03209 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:26.995249 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbd481-3d67-496e-aefa-9ff291b03209 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:26.996649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbd481-3d67-496e-aefa-9ff291b03209 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:27.009059 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-57cbd481-3d67-496e-aefa-9ff291b03209 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 15:02:27.009059 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:27.009059 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 15:02:27.009059 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 15:02:27.009059 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 15:02:27.009059 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 15:02:27.009059 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 15:02:27.009059 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:27.009059 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 15:02:27.009059 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:27.009059 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:02:27.009059 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:27.009059 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:27.009059 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:27.009059 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:27.009059 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:27.009059 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:27.010068 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:27.010068 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:27.010068 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:27.010068 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:27.010068 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:27.010068 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:27.010068 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 15:02:27.010068 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 15:02:27.010068 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 15:02:27.010068 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 15:02:27.010068 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:27.010068 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:27.010068 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:27.010068 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:27.010068 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:27.010068 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:27.016186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:27.016186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:27.016186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:27.016186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:27.016186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:27.016186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:27.016186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:27.016186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:27.016186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:27.016186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:27.016186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 15:02:27.016186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:27.016186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 15:02:27.016186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:27.016186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 511/1013] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:02:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:02:27.018712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec956f-3807-4bd7-8367-c075147e7624 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:27.066685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9774f-7a5e-4696-a920-293f1c8eadee None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:27.066975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9774f-7a5e-4696-a920-293f1c8eadee None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:27.067257 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9774f-7a5e-4696-a920-293f1c8eadee None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:27.068801 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 512/1014] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:27.073536 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a0f49-4b32-49fc-8ebf-bd18edee89c0 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:27.073825 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a0f49-4b32-49fc-8ebf-bd18edee89c0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:27.074100 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a0f49-4b32-49fc-8ebf-bd18edee89c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:27.090400 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-438a0f49-4b32-49fc-8ebf-bd18edee89c0 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:27.091588 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-438a0f49-4b32-49fc-8ebf-bd18edee89c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:27.117566 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec956f-3807-4bd7-8367-c075147e7624 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:27.150460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f98a0-281c-46e4-8abe-40f4da5bc072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:27.151111 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f98a0-281c-46e4-8abe-40f4da5bc072 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:27.151392 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f98a0-281c-46e4-8abe-40f4da5bc072 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:27.151665 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f98a0-281c-46e4-8abe-40f4da5bc072 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:27.152366 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f98a0-281c-46e4-8abe-40f4da5bc072 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:27.152671 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f98a0-281c-46e4-8abe-40f4da5bc072 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:27.154041 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f98a0-281c-46e4-8abe-40f4da5bc072 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:27.157031 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 513/1015] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:27 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 15:02:27.164236 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 503/1016] 10.222.0.76 () {56 vars in 1112 bytes} [Mon May 16 15:02:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:27.170487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a0f49-4b32-49fc-8ebf-bd18edee89c0 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:27.179824 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f98a0-281c-46e4-8abe-40f4da5bc072 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:27.267938 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a0f49-4b32-49fc-8ebf-bd18edee89c0 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:27.275439 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f98a0-281c-46e4-8abe-40f4da5bc072 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:27.302816 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9024fcc-27ce-4457-b318-0dab3213aa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:27.303610 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9024fcc-27ce-4457-b318-0dab3213aa94 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:27.304020 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9024fcc-27ce-4457-b318-0dab3213aa94 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:27.304306 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9024fcc-27ce-4457-b318-0dab3213aa94 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:27.305033 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9024fcc-27ce-4457-b318-0dab3213aa94 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:27.305327 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9024fcc-27ce-4457-b318-0dab3213aa94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:27.306725 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9024fcc-27ce-4457-b318-0dab3213aa94 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:27.308262 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c62e1-f598-4826-bf36-10f59f5ede08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:27.309051 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c62e1-f598-4826-bf36-10f59f5ede08 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:27.309334 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c62e1-f598-4826-bf36-10f59f5ede08 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:27.309611 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c62e1-f598-4826-bf36-10f59f5ede08 None admin] PATH_INFO: `/v3/services/image` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:27.310341 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c62e1-f598-4826-bf36-10f59f5ede08 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:27.311836 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 514/1017] 10.222.0.76 () {56 vars in 1112 bytes} [Mon May 16 15:02:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:27.311976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c62e1-f598-4826-bf36-10f59f5ede08 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:27.317692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9024fcc-27ce-4457-b318-0dab3213aa94 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:27.324171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-6e8c62e1-f598-4826-bf36-10f59f5ede08 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 15:02:27.324171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:27.324171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 15:02:27.324171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 15:02:27.324171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 15:02:27.324171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 15:02:27.324171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 15:02:27.324171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:27.324171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 15:02:27.324171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:27.324171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:02:27.324171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:27.324171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:27.324171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:27.324171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:27.324171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:27.324171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:27.325452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:27.325452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:27.325452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:27.325452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:27.325452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:27.325452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:27.325452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 15:02:27.325452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 15:02:27.325452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 15:02:27.325452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 15:02:27.325452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:27.325452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:27.325452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:27.325452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:27.325452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:27.325452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:27.326494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:27.326494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:27.326494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:27.326494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:27.326494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:27.326494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:27.326494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:27.326494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:27.326494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:27.326494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:27.326494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 15:02:27.326494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:27.326494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 15:02:27.326494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:27.326494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 504/1018] 10.222.0.76 () {56 vars in 1105 bytes} [Mon May 16 15:02:27 2022] GET /identity/v3/services/image => generated 86 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:02:27.331173 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c62e1-f598-4826-bf36-10f59f5ede08 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:27.427412 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9024fcc-27ce-4457-b318-0dab3213aa94 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:27.432811 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c62e1-f598-4826-bf36-10f59f5ede08 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:27.457555 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b339f4-e19d-4655-b7f5-2342ff51292b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:27.458246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b339f4-e19d-4655-b7f5-2342ff51292b None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:27.458561 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b339f4-e19d-4655-b7f5-2342ff51292b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:27.461941 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b339f4-e19d-4655-b7f5-2342ff51292b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:27.461941 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b339f4-e19d-4655-b7f5-2342ff51292b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:27.461941 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b339f4-e19d-4655-b7f5-2342ff51292b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:27.467111 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e1dba-6acf-456a-95b0-35bdb552b366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:27.467774 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e1dba-6acf-456a-95b0-35bdb552b366 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:27.468054 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e1dba-6acf-456a-95b0-35bdb552b366 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:27.468327 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e1dba-6acf-456a-95b0-35bdb552b366 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:27.469034 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e1dba-6acf-456a-95b0-35bdb552b366 None admin] RBAC: Adding query filter params (name=image) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:27.469338 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e1dba-6acf-456a-95b0-35bdb552b366 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:27.470913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e1dba-6acf-456a-95b0-35bdb552b366 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:27.476030 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 505/1019] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:27.481504 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e1dba-6acf-456a-95b0-35bdb552b366 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:27.576271 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e1dba-6acf-456a-95b0-35bdb552b366 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:27.592226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 515/1020] 10.222.0.76 () {60 vars in 1144 bytes} [Mon May 16 15:02:27 2022] POST /identity/v3/endpoints => generated 334 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:02:27.620991 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f6913-0c5c-4f2c-8f46-614056496c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:27.621731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f6913-0c5c-4f2c-8f46-614056496c57 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:27.622013 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f6913-0c5c-4f2c-8f46-614056496c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:27.622334 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f6913-0c5c-4f2c-8f46-614056496c57 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:27.623089 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f6913-0c5c-4f2c-8f46-614056496c57 None admin] RBAC: Adding query filter params (type=image) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:27.623398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f6913-0c5c-4f2c-8f46-614056496c57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:27.624807 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f6913-0c5c-4f2c-8f46-614056496c57 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:27.634708 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 506/1021] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:27.636644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b339f4-e19d-4655-b7f5-2342ff51292b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:27.742344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b339f4-e19d-4655-b7f5-2342ff51292b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:27.778540 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920ab72-1cef-4280-a1b6-c7e363b5d0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:27.779597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920ab72-1cef-4280-a1b6-c7e363b5d0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:27.779875 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920ab72-1cef-4280-a1b6-c7e363b5d0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:27.780143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920ab72-1cef-4280-a1b6-c7e363b5d0e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:27.780989 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4920ab72-1cef-4280-a1b6-c7e363b5d0e0 None admin] RBAC: Adding query filter params (interface=public, service_id=342fdd87dcac40bd9816c3a056a47a4d, region_id=RegionOne) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:27.781298 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4920ab72-1cef-4280-a1b6-c7e363b5d0e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:27.782687 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4920ab72-1cef-4280-a1b6-c7e363b5d0e0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:27.788243 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 516/1022] 10.222.0.76 () {56 vars in 1251 bytes} [Mon May 16 15:02:27 2022] GET /identity/v3/endpoints?service_id=342fdd87dcac40bd9816c3a056a47a4d&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:27.793617 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f6913-0c5c-4f2c-8f46-614056496c57 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:27.895473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f6913-0c5c-4f2c-8f46-614056496c57 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:27.930171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c15fc-fa7e-4636-91e5-a4c85fdb2ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:27.930840 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c15fc-fa7e-4636-91e5-a4c85fdb2ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:27.931117 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c15fc-fa7e-4636-91e5-a4c85fdb2ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:27.931387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c15fc-fa7e-4636-91e5-a4c85fdb2ec1 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:27.932061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c15fc-fa7e-4636-91e5-a4c85fdb2ec1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:27.933422 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c15fc-fa7e-4636-91e5-a4c85fdb2ec1 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:27.940001 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 507/1023] 10.222.0.76 () {56 vars in 1087 bytes} [Mon May 16 15:02:27 2022] GET /identity/v3/services => generated 1957 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:02:28.573641 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a29a1-aa22-4bf1-945e-72749d1533dd None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:28.574014 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a29a1-aa22-4bf1-945e-72749d1533dd None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:28.574234 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a29a1-aa22-4bf1-945e-72749d1533dd None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:28.575765 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 517/1024] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:28.580712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a130407-d6de-4d96-88fd-64a6ffa5aac2 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:28.581006 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a130407-d6de-4d96-88fd-64a6ffa5aac2 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:28.581291 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a130407-d6de-4d96-88fd-64a6ffa5aac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:28.601236 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-4a130407-d6de-4d96-88fd-64a6ffa5aac2 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:28.602433 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4a130407-d6de-4d96-88fd-64a6ffa5aac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:28.666456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 508/1025] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:28.688806 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a29a1-aa22-4bf1-945e-72749d1533dd None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:28.805073 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a29a1-aa22-4bf1-945e-72749d1533dd None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:28.839030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63ff4e-ad92-4312-ade4-30e4d4b30434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:28.840163 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63ff4e-ad92-4312-ade4-30e4d4b30434 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:28.840651 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63ff4e-ad92-4312-ade4-30e4d4b30434 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:28.841135 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63ff4e-ad92-4312-ade4-30e4d4b30434 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:28.842653 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63ff4e-ad92-4312-ade4-30e4d4b30434 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:28.844396 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63ff4e-ad92-4312-ade4-30e4d4b30434 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:28.846813 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 518/1026] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:28.852928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a130407-d6de-4d96-88fd-64a6ffa5aac2 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:28.948806 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a130407-d6de-4d96-88fd-64a6ffa5aac2 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:28.981709 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20b298-017a-44d5-8ef0-13b8c9de8686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:28.982402 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20b298-017a-44d5-8ef0-13b8c9de8686 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:28.982690 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20b298-017a-44d5-8ef0-13b8c9de8686 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:28.982969 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20b298-017a-44d5-8ef0-13b8c9de8686 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:28.983685 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20b298-017a-44d5-8ef0-13b8c9de8686 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:28.985133 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20b298-017a-44d5-8ef0-13b8c9de8686 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:29.090375 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 509/1027] 10.222.0.76 () {60 vars in 1141 bytes} [Mon May 16 15:02:28 2022] POST /identity/v3/projects => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:02:29.962782 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1421a8-2610-41f2-ba8e-acc60e5262ac None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:29.963367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1421a8-2610-41f2-ba8e-acc60e5262ac None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:29.963367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1421a8-2610-41f2-ba8e-acc60e5262ac None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:29.964729 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 519/1028] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:29.969862 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de1466-c488-440d-99d3-a9e5d41de9a1 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:29.970304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de1466-c488-440d-99d3-a9e5d41de9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:29.970473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de1466-c488-440d-99d3-a9e5d41de9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:29.987808 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-16de1466-c488-440d-99d3-a9e5d41de9a1 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:29.989032 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-16de1466-c488-440d-99d3-a9e5d41de9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:30.058082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 510/1029] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:30.081106 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1421a8-2610-41f2-ba8e-acc60e5262ac None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:30.177314 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1421a8-2610-41f2-ba8e-acc60e5262ac None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:30.179355 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9cd7c-c77c-4dbe-8b90-65bfecc9768f None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:30.179641 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9cd7c-c77c-4dbe-8b90-65bfecc9768f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:30.179906 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9cd7c-c77c-4dbe-8b90-65bfecc9768f None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:30.181398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 511/1030] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:30.186088 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a247f6-a9d9-45fc-9927-22efe994f801 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:30.186413 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a247f6-a9d9-45fc-9927-22efe994f801 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:30.186686 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a247f6-a9d9-45fc-9927-22efe994f801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:30.202676 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-b7a247f6-a9d9-45fc-9927-22efe994f801 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:30.203835 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b7a247f6-a9d9-45fc-9927-22efe994f801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:30.213550 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487dca3d-7bcf-4671-922e-00e490a1210a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:30.214317 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487dca3d-7bcf-4671-922e-00e490a1210a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:30.214597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487dca3d-7bcf-4671-922e-00e490a1210a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:30.214866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487dca3d-7bcf-4671-922e-00e490a1210a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:30.225315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487dca3d-7bcf-4671-922e-00e490a1210a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:02:30.233351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-487dca3d-7bcf-4671-922e-00e490a1210a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 15:02:30.233351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:30.233351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:30.233351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:30.233351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:30.233351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:30.233351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:30.233351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:30.233351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:30.233351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:30.233351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:30.233351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:30.233351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:02:30.233351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:02:30.233351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:02:30.233351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:02:30.234590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:02:30.234590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:02:30.234590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:02:30.234590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:02:30.234590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:30.234590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:30.234590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:30.234590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:30.234590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:30.234590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:30.234590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:30.234590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:30.234590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:30.234590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:30.234590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:30.234590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:30.235511 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:30.235511 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:30.235511 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:30.235511 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:30.235511 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:02:30.235511 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:02:30.235511 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:02:30.235511 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:02:30.235511 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:02:30.235511 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:02:30.235511 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 15:02:30.235511 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:30.235511 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 520/1031] 10.222.0.76 () {56 vars in 1120 bytes} [Mon May 16 15:02:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:30.240875 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487dca3d-7bcf-4671-922e-00e490a1210a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:30.282471 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 512/1032] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 15:02:30.296952 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a247f6-a9d9-45fc-9927-22efe994f801 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:30.340670 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487dca3d-7bcf-4671-922e-00e490a1210a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:30.373732 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084de22-1057-44cb-b970-8d3426235889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:30.374427 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084de22-1057-44cb-b970-8d3426235889 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:30.374709 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084de22-1057-44cb-b970-8d3426235889 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:30.374980 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084de22-1057-44cb-b970-8d3426235889 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:30.375727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084de22-1057-44cb-b970-8d3426235889 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:30.376030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084de22-1057-44cb-b970-8d3426235889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:30.377649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084de22-1057-44cb-b970-8d3426235889 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:30.386223 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 521/1033] 10.222.0.76 () {56 vars in 1115 bytes} [Mon May 16 15:02:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:30.391740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084de22-1057-44cb-b970-8d3426235889 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:30.395505 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a247f6-a9d9-45fc-9927-22efe994f801 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:30.429161 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524998d3-e669-48fe-9b98-800a3fc1176e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:30.430509 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524998d3-e669-48fe-9b98-800a3fc1176e None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:30.431020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524998d3-e669-48fe-9b98-800a3fc1176e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:30.431519 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524998d3-e669-48fe-9b98-800a3fc1176e None admin] PATH_INFO: `/v3/services/image` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:30.432680 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524998d3-e669-48fe-9b98-800a3fc1176e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:30.434910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524998d3-e669-48fe-9b98-800a3fc1176e None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:30.447503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-524998d3-e669-48fe-9b98-800a3fc1176e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 15:02:30.447503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:30.447503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 15:02:30.447503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 15:02:30.447503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 15:02:30.447503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 15:02:30.447503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 15:02:30.447503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:30.447503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 15:02:30.447503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:30.447503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:02:30.447503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:30.447503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:30.447503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:30.447503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:30.447503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:30.447503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:30.448738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:30.448738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:30.448738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:30.448738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:30.448738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:30.448738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:30.448738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 15:02:30.448738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 15:02:30.448738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 15:02:30.448738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 15:02:30.448738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:30.448738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:30.448738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:30.448738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:30.448738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:30.448738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:30.450142 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:30.450142 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:30.450142 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:30.450142 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:30.450142 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:30.450142 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:30.450142 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:30.450142 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:30.450142 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:30.450142 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:30.450142 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 15:02:30.450142 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:02:30.450142 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 15:02:30.450142 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:30.450142 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 513/1034] 10.222.0.76 () {56 vars in 1105 bytes} [Mon May 16 15:02:30 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:02:30.454479 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524998d3-e669-48fe-9b98-800a3fc1176e None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:30.495426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084de22-1057-44cb-b970-8d3426235889 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:30.528971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d54f63-bc1f-44be-92cc-244d4de65f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:30.529751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d54f63-bc1f-44be-92cc-244d4de65f51 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:30.530028 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d54f63-bc1f-44be-92cc-244d4de65f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:30.530321 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d54f63-bc1f-44be-92cc-244d4de65f51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:30.540812 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d54f63-bc1f-44be-92cc-244d4de65f51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:30.542338 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d54f63-bc1f-44be-92cc-244d4de65f51 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:30.550072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524998d3-e669-48fe-9b98-800a3fc1176e None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:30.559845 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e0d54f63-bc1f-44be-92cc-244d4de65f51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:30.559845 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:30.559845 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:30.559845 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:30.559845 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:30.559845 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:30.559845 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:30.559845 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:30.559845 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:30.559845 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:30.559845 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:30.559845 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:30.559845 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:02:30.559845 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:02:30.559845 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:02:30.560763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:02:30.560763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:30.560763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:30.560763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:30.560763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:30.560763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:30.560763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:30.560763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:30.560763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:30.560763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:30.560763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:30.560763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:30.560763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:30.560763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:30.560763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:30.560763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:30.560763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:30.561674 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:02:30.561674 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:02:30.561674 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:30.561674 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:30.561674 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 522/1035] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:30.567045 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d54f63-bc1f-44be-92cc-244d4de65f51 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:30.589041 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a583ca4-be59-4102-b414-3a6c2bcac987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:30.589714 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a583ca4-be59-4102-b414-3a6c2bcac987 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:30.589997 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a583ca4-be59-4102-b414-3a6c2bcac987 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:30.590309 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a583ca4-be59-4102-b414-3a6c2bcac987 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:30.591080 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a583ca4-be59-4102-b414-3a6c2bcac987 None admin] RBAC: Adding query filter params (name=image) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:30.591386 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a583ca4-be59-4102-b414-3a6c2bcac987 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:30.592791 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a583ca4-be59-4102-b414-3a6c2bcac987 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:30.597956 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 514/1036] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:30.603295 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a583ca4-be59-4102-b414-3a6c2bcac987 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:30.668391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d54f63-bc1f-44be-92cc-244d4de65f51 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:30.701007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b528473-532b-41ff-b7ef-d29bb9e13a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:30.701663 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b528473-532b-41ff-b7ef-d29bb9e13a9d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:30.701778 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a583ca4-be59-4102-b414-3a6c2bcac987 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:30.701961 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b528473-532b-41ff-b7ef-d29bb9e13a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:30.702236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b528473-532b-41ff-b7ef-d29bb9e13a9d None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:30.702952 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b528473-532b-41ff-b7ef-d29bb9e13a9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:30.703259 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b528473-532b-41ff-b7ef-d29bb9e13a9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:30.704626 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b528473-532b-41ff-b7ef-d29bb9e13a9d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:30.720676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 523/1037] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:30.721953 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b528473-532b-41ff-b7ef-d29bb9e13a9d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:30.735053 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e27b6-7c6f-4bdf-9c82-006186b84b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:30.735937 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e27b6-7c6f-4bdf-9c82-006186b84b17 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:30.736382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e27b6-7c6f-4bdf-9c82-006186b84b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:30.736663 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e27b6-7c6f-4bdf-9c82-006186b84b17 None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:30.737465 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e27b6-7c6f-4bdf-9c82-006186b84b17 None admin] RBAC: Adding query filter params (type=image) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:30.737815 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e27b6-7c6f-4bdf-9c82-006186b84b17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:30.739215 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e27b6-7c6f-4bdf-9c82-006186b84b17 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:30.749225 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 515/1038] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:30.750232 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e27b6-7c6f-4bdf-9c82-006186b84b17 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:30.828743 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b528473-532b-41ff-b7ef-d29bb9e13a9d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:30.850142 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e27b6-7c6f-4bdf-9c82-006186b84b17 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:30.866293 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff427c-1fa0-4a15-b592-ec0e8efe88a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:30.867666 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff427c-1fa0-4a15-b592-ec0e8efe88a2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:30.868149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff427c-1fa0-4a15-b592-ec0e8efe88a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:30.868607 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff427c-1fa0-4a15-b592-ec0e8efe88a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:30.879081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff427c-1fa0-4a15-b592-ec0e8efe88a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:30.881740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff427c-1fa0-4a15-b592-ec0e8efe88a2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:30.884025 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569d047-b9f9-4188-805b-7c04dfd491bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:30.884680 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569d047-b9f9-4188-805b-7c04dfd491bf None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:30.884957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569d047-b9f9-4188-805b-7c04dfd491bf None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:30.885231 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569d047-b9f9-4188-805b-7c04dfd491bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:30.885963 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569d047-b9f9-4188-805b-7c04dfd491bf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:30.887339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569d047-b9f9-4188-805b-7c04dfd491bf None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:30.900527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-4cff427c-1fa0-4a15-b592-ec0e8efe88a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 15:02:30.900527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:30.900527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:30.900527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:30.900527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:30.900527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:30.900527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:30.900527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:30.900527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:30.900527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:30.900527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:30.900527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:30.900527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:02:30.900527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:02:30.900527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:02:30.900527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:02:30.901752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:30.901752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:30.901752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:02:30.901752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:02:30.901752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:02:30.901752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:02:30.901752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:30.901752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:30.901752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:30.901752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:30.901752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:30.901752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:30.901752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:30.901752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:30.901752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:30.901752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:30.901752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:30.901752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:30.902946 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:30.902946 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:30.902946 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:02:30.902946 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:02:30.902946 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:02:30.902946 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:02:30.902946 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:02:30.902946 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:02:30.902946 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 15:02:30.902946 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:30.905812 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 524/1039] 10.222.0.76 () {56 vars in 1093 bytes} [Mon May 16 15:02:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:02:30.907381 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff427c-1fa0-4a15-b592-ec0e8efe88a2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:30.977987 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 516/1040] 10.222.0.76 () {60 vars in 1144 bytes} [Mon May 16 15:02:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:02:31.006753 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff427c-1fa0-4a15-b592-ec0e8efe88a2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:31.051229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d21f11-5418-4f09-adc7-87eeb99d9ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:31.051911 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d21f11-5418-4f09-adc7-87eeb99d9ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:31.052193 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d21f11-5418-4f09-adc7-87eeb99d9ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:31.053046 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d21f11-5418-4f09-adc7-87eeb99d9ae9 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:31.053895 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d21f11-5418-4f09-adc7-87eeb99d9ae9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:31.054255 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d21f11-5418-4f09-adc7-87eeb99d9ae9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:31.055706 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d21f11-5418-4f09-adc7-87eeb99d9ae9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:31.075005 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 525/1041] 10.222.0.76 () {56 vars in 1133 bytes} [Mon May 16 15:02:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:31.084334 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569d047-b9f9-4188-805b-7c04dfd491bf None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:31.192362 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569d047-b9f9-4188-805b-7c04dfd491bf None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:31.230332 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef01918-06e1-406c-b17b-2194bed15517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:31.231362 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef01918-06e1-406c-b17b-2194bed15517 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:31.231851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef01918-06e1-406c-b17b-2194bed15517 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:31.232345 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef01918-06e1-406c-b17b-2194bed15517 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:31.298661 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef01918-06e1-406c-b17b-2194bed15517 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:31.300453 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef01918-06e1-406c-b17b-2194bed15517 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:31.382011 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cf1a0-f6cf-4225-a1ea-f8190e424245 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:31.382332 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cf1a0-f6cf-4225-a1ea-f8190e424245 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:31.382614 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cf1a0-f6cf-4225-a1ea-f8190e424245 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:31.383988 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 526/1042] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:02:31.389086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53fae3-7e3f-4e73-964d-47eb9a92799c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:31.389426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53fae3-7e3f-4e73-964d-47eb9a92799c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:31.389704 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53fae3-7e3f-4e73-964d-47eb9a92799c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:31.402699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 517/1043] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:02:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 15:02:31.404358 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef01918-06e1-406c-b17b-2194bed15517 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:31.405757 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ac53fae3-7e3f-4e73-964d-47eb9a92799c None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:31.407551 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ac53fae3-7e3f-4e73-964d-47eb9a92799c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:31.485677 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 527/1044] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 15:02:31.511355 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53fae3-7e3f-4e73-964d-47eb9a92799c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:31.512331 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef01918-06e1-406c-b17b-2194bed15517 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:31.546653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da545eb0-13d5-4ec6-a195-b90ec2bdc13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:31.547738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da545eb0-13d5-4ec6-a195-b90ec2bdc13b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:31.548304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da545eb0-13d5-4ec6-a195-b90ec2bdc13b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:31.548831 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da545eb0-13d5-4ec6-a195-b90ec2bdc13b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:31.559602 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da545eb0-13d5-4ec6-a195-b90ec2bdc13b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:31.561271 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da545eb0-13d5-4ec6-a195-b90ec2bdc13b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:31.579166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-da545eb0-13d5-4ec6-a195-b90ec2bdc13b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:31.579166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:31.579166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:31.579166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:31.579166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:31.579166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:31.579166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:31.579166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:31.579166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:31.579166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:31.579166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:31.579166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:31.579166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:02:31.579166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:02:31.579166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:02:31.580138 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:02:31.580138 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:31.580138 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:31.580138 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:31.580138 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:31.580138 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:31.580138 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:31.580138 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:31.580138 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:31.580138 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:31.580138 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:31.580138 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:31.580138 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:31.580138 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:31.580138 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:31.580138 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:31.580138 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:31.581035 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:02:31.581035 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:02:31.581035 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:31.581035 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:31.585889 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 518/1045] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:02:31.586448 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da545eb0-13d5-4ec6-a195-b90ec2bdc13b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:31.609279 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53fae3-7e3f-4e73-964d-47eb9a92799c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:31.644343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3edcb-ef74-40dc-94e9-cdcf2ff2c112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:31.645130 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3edcb-ef74-40dc-94e9-cdcf2ff2c112 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:31.645410 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3edcb-ef74-40dc-94e9-cdcf2ff2c112 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:31.645683 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3edcb-ef74-40dc-94e9-cdcf2ff2c112 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:31.647545 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3edcb-ef74-40dc-94e9-cdcf2ff2c112 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:31.648985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3edcb-ef74-40dc-94e9-cdcf2ff2c112 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:31.650817 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 528/1046] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:31.656182 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3edcb-ef74-40dc-94e9-cdcf2ff2c112 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:31.688047 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da545eb0-13d5-4ec6-a195-b90ec2bdc13b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:31.722069 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974ad8f-7a3e-4dbb-9581-d0193e7c3071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:31.722763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974ad8f-7a3e-4dbb-9581-d0193e7c3071 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:31.723045 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974ad8f-7a3e-4dbb-9581-d0193e7c3071 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:31.723315 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974ad8f-7a3e-4dbb-9581-d0193e7c3071 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:31.724056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974ad8f-7a3e-4dbb-9581-d0193e7c3071 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:31.724359 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974ad8f-7a3e-4dbb-9581-d0193e7c3071 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:31.725752 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974ad8f-7a3e-4dbb-9581-d0193e7c3071 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:31.736723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 519/1047] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:31.742454 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974ad8f-7a3e-4dbb-9581-d0193e7c3071 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:31.754478 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3edcb-ef74-40dc-94e9-cdcf2ff2c112 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:31.789644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e2418-40a5-483a-88f5-397a31608867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:31.790345 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e2418-40a5-483a-88f5-397a31608867 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:31.790632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e2418-40a5-483a-88f5-397a31608867 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:31.790909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e2418-40a5-483a-88f5-397a31608867 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:31.791618 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e2418-40a5-483a-88f5-397a31608867 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:31.793053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e2418-40a5-483a-88f5-397a31608867 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:31.840961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974ad8f-7a3e-4dbb-9581-d0193e7c3071 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:31.874545 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada3fc7-c07d-4646-ad68-df0b0c191f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:31.875338 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada3fc7-c07d-4646-ad68-df0b0c191f9a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:31.875618 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada3fc7-c07d-4646-ad68-df0b0c191f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:31.875892 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada3fc7-c07d-4646-ad68-df0b0c191f9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:31.882738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada3fc7-c07d-4646-ad68-df0b0c191f9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:31.884182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada3fc7-c07d-4646-ad68-df0b0c191f9a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:31.898662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-9ada3fc7-c07d-4646-ad68-df0b0c191f9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:02:31.898662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:31.898662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:31.898662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:31.898662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:31.898662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:31.898662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:31.898662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:31.898662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:31.898662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:31.898662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:31.898662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:31.898662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:02:31.898662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:02:31.898662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:02:31.899603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:02:31.899603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:31.899603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:31.899603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:31.899603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:31.899603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:31.899603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:31.899603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:31.899603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:31.899603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:31.899603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:31.899603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:31.899603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:31.899603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:31.899603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:31.899603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:31.899603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:31.907898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:02:31.907898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:02:31.907898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:02:31.907898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:02:31.907898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:02:31.907898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:02:31.907898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:02:31.907898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:31.907898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 520/1048] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:02:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:02:31.908454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 529/1049] 10.222.0.76 () {60 vars in 1132 bytes} [Mon May 16 15:02:31 2022] POST /identity/v3/users => generated 285 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:02:31.908548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada3fc7-c07d-4646-ad68-df0b0c191f9a None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:32.019492 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada3fc7-c07d-4646-ad68-df0b0c191f9a None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:32.057409 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cafb9b-b5a8-47ff-8679-78edc5260195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:32.058526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cafb9b-b5a8-47ff-8679-78edc5260195 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:32.059044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cafb9b-b5a8-47ff-8679-78edc5260195 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:32.059537 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cafb9b-b5a8-47ff-8679-78edc5260195 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:32.060558 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cafb9b-b5a8-47ff-8679-78edc5260195 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:32.061076 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cafb9b-b5a8-47ff-8679-78edc5260195 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:32.062788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cafb9b-b5a8-47ff-8679-78edc5260195 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:32.076101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 521/1050] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:02:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:32.081338 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e2418-40a5-483a-88f5-397a31608867 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:32.185447 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e2418-40a5-483a-88f5-397a31608867 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:32.217882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac436bcc-d4bd-49db-ad36-6f30648a3eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:32.218566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac436bcc-d4bd-49db-ad36-6f30648a3eae None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:32.218846 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac436bcc-d4bd-49db-ad36-6f30648a3eae None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:32.219119 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac436bcc-d4bd-49db-ad36-6f30648a3eae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:32.219946 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac436bcc-d4bd-49db-ad36-6f30648a3eae None admin] RBAC: Adding query filter params (role.id=ab71625c5e074cf3b9b93b50548182f2, scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9, user.id=9d85024f010c40129d79543b3ec4cfae) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:32.220261 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac436bcc-d4bd-49db-ad36-6f30648a3eae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:32.221685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac436bcc-d4bd-49db-ad36-6f30648a3eae None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:32.227827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 530/1051] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:02:32 2022] GET /identity/v3/role_assignments?user.id=9d85024f010c40129d79543b3ec4cfae&scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9&role.id=ab71625c5e074cf3b9b93b50548182f2 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:33.250712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f17db7-69af-4789-8334-a6a5c8966dc1 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:33.251258 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f17db7-69af-4789-8334-a6a5c8966dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:33.251258 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f17db7-69af-4789-8334-a6a5c8966dc1 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:33.253015 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 522/1052] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:33.258519 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6b015-a803-4863-8957-4c12cd756451 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:33.258936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6b015-a803-4863-8957-4c12cd756451 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:33.259114 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6b015-a803-4863-8957-4c12cd756451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:33.275902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-42c6b015-a803-4863-8957-4c12cd756451 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:33.277074 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-42c6b015-a803-4863-8957-4c12cd756451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:33.343235 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 531/1053] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:33.364435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f17db7-69af-4789-8334-a6a5c8966dc1 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:33.463016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f17db7-69af-4789-8334-a6a5c8966dc1 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:33.494748 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a07d9-ab49-44c2-b6e8-9daf6371a043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:33.495390 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a07d9-ab49-44c2-b6e8-9daf6371a043 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:33.495670 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a07d9-ab49-44c2-b6e8-9daf6371a043 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:33.495942 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a07d9-ab49-44c2-b6e8-9daf6371a043 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:33.561317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a07d9-ab49-44c2-b6e8-9daf6371a043 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:33.565373 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a07d9-ab49-44c2-b6e8-9daf6371a043 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:33.661590 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 523/1054] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:02:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 15:02:33.663824 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6b015-a803-4863-8957-4c12cd756451 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:33.758905 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6b015-a803-4863-8957-4c12cd756451 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:33.791766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b495504-a42e-4101-b747-6c57d95898fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:33.792554 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b495504-a42e-4101-b747-6c57d95898fc None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:33.792835 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b495504-a42e-4101-b747-6c57d95898fc None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:33.793106 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b495504-a42e-4101-b747-6c57d95898fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:33.803037 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b495504-a42e-4101-b747-6c57d95898fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:33.804492 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b495504-a42e-4101-b747-6c57d95898fc None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:33.822201 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-2b495504-a42e-4101-b747-6c57d95898fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:33.822201 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:33.822201 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:33.822201 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:33.822201 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:33.822201 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:33.822201 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:33.822201 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:33.822201 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:33.822201 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:33.822201 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:33.822201 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:33.822201 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:02:33.822201 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:02:33.822201 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:02:33.823104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:02:33.823104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:33.823104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:33.823104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:33.823104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:33.823104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:33.823104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:33.823104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:33.823104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:33.823104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:33.823104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:33.823104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:33.823104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:33.823104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:33.823104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:33.823104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:33.823104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:33.824007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:02:33.824007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:02:33.824007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:33.824007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:33.826206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 532/1055] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:33.829584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a07d9-ab49-44c2-b6e8-9daf6371a043 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:33.935244 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a07d9-ab49-44c2-b6e8-9daf6371a043 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:33.970799 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5395be2-a177-4995-b581-832a1cde2421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:33.971464 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5395be2-a177-4995-b581-832a1cde2421 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:33.971745 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5395be2-a177-4995-b581-832a1cde2421 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:33.972021 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5395be2-a177-4995-b581-832a1cde2421 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:33.972736 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5395be2-a177-4995-b581-832a1cde2421 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:33.973040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5395be2-a177-4995-b581-832a1cde2421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:33.974480 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5395be2-a177-4995-b581-832a1cde2421 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:33.986169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 524/1056] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:34.245357 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e990f8-76c4-40c8-94de-4708d5d15d54 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:34.245726 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e990f8-76c4-40c8-94de-4708d5d15d54 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:34.245915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e990f8-76c4-40c8-94de-4708d5d15d54 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:34.248861 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 533/1057] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:34.254120 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d72da-b14b-4d12-9db4-094fc45a759f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:34.254685 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d72da-b14b-4d12-9db4-094fc45a759f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:34.254808 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d72da-b14b-4d12-9db4-094fc45a759f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:34.274492 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-b27d72da-b14b-4d12-9db4-094fc45a759f None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:34.275717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b27d72da-b14b-4d12-9db4-094fc45a759f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:34.344465 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 525/1058] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:34.368414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e990f8-76c4-40c8-94de-4708d5d15d54 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:34.445314 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28a460-73a7-4f77-80b7-d7db367c7dd4 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:34.445593 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28a460-73a7-4f77-80b7-d7db367c7dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:34.445867 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28a460-73a7-4f77-80b7-d7db367c7dd4 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:34.447295 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 526/1059] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:02:34.452206 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4773d-368c-45bd-8ac0-a6a6ac65de0d None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:34.452489 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4773d-368c-45bd-8ac0-a6a6ac65de0d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:34.452767 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4773d-368c-45bd-8ac0-a6a6ac65de0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:34.465973 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e990f8-76c4-40c8-94de-4708d5d15d54 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:34.468832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-c9d4773d-368c-45bd-8ac0-a6a6ac65de0d None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:34.470020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c9d4773d-368c-45bd-8ac0-a6a6ac65de0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:34.498974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59b158-26ae-475f-a76c-2e94e5937a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:34.499805 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59b158-26ae-475f-a76c-2e94e5937a6c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:34.500088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59b158-26ae-475f-a76c-2e94e5937a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:34.500363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59b158-26ae-475f-a76c-2e94e5937a6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:34.511026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59b158-26ae-475f-a76c-2e94e5937a6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:02:34.518548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-0c59b158-26ae-475f-a76c-2e94e5937a6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:02:34.518548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:34.518548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:34.518548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:34.518548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:34.518548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:34.518548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:34.518548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:34.518548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:34.518548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:34.518548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:34.518548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:34.518548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:02:34.518548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:02:34.518548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:02:34.518548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:02:34.521419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:02:34.521419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:02:34.521419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:02:34.521419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:02:34.521419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:34.521419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:34.521419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:34.521419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:34.521419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:34.521419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:34.521419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:34.521419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:34.521419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:34.521419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:34.521419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:34.521419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:34.522333 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:34.522333 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:34.522333 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:34.522333 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:34.522333 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:02:34.522333 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:02:34.522333 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:02:34.522333 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:02:34.522333 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:02:34.522333 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:02:34.522333 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:02:34.522333 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:34.522333 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 534/1060] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:02:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:34.525671 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59b158-26ae-475f-a76c-2e94e5937a6c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:34.535321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 527/1061] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 15:02:34.559173 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4773d-368c-45bd-8ac0-a6a6ac65de0d None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:34.623895 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59b158-26ae-475f-a76c-2e94e5937a6c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:34.653709 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4773d-368c-45bd-8ac0-a6a6ac65de0d None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:34.655423 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ed812-c4b3-4836-83e2-826df9f0f105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:34.656079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ed812-c4b3-4836-83e2-826df9f0f105 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:34.656359 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ed812-c4b3-4836-83e2-826df9f0f105 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:34.656632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ed812-c4b3-4836-83e2-826df9f0f105 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:34.657382 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ed812-c4b3-4836-83e2-826df9f0f105 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:34.657685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ed812-c4b3-4836-83e2-826df9f0f105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:34.659092 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ed812-c4b3-4836-83e2-826df9f0f105 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:34.667874 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 535/1062] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:02:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:34.673466 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ed812-c4b3-4836-83e2-826df9f0f105 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:34.686695 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cb152-f92a-487b-8175-7785e91056a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:34.687487 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cb152-f92a-487b-8175-7785e91056a6 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:34.687765 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cb152-f92a-487b-8175-7785e91056a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:34.688034 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cb152-f92a-487b-8175-7785e91056a6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:34.697688 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159cb152-f92a-487b-8175-7785e91056a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:02:34.705682 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-159cb152-f92a-487b-8175-7785e91056a6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 15:02:34.705682 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:34.705682 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:34.705682 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:34.705682 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:34.705682 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:34.705682 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:34.705682 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:34.705682 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:34.705682 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:34.705682 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:34.705682 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:34.705682 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:02:34.705682 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:02:34.705682 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:02:34.705682 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:02:34.706699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:02:34.706699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:02:34.706699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:02:34.706699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:02:34.706699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:34.706699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:34.706699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:34.706699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:34.706699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:34.706699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:34.706699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:34.706699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:34.706699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:34.706699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:34.706699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:34.706699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:34.707550 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:34.707550 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:34.707550 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:34.707550 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:34.707550 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:02:34.707550 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:02:34.707550 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:02:34.707550 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:02:34.707550 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:02:34.707550 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:02:34.707550 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 15:02:34.707550 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:34.710276 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 528/1063] 10.222.0.76 () {56 vars in 1120 bytes} [Mon May 16 15:02:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:02:34.712676 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cb152-f92a-487b-8175-7785e91056a6 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:34.767004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ed812-c4b3-4836-83e2-826df9f0f105 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:34.798779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9481aba-12f8-42c8-9ff9-e767c9891f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:34.799628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9481aba-12f8-42c8-9ff9-e767c9891f35 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:34.799910 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9481aba-12f8-42c8-9ff9-e767c9891f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:34.800185 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9481aba-12f8-42c8-9ff9-e767c9891f35 None admin] PATH_INFO: `/v3/users/ef61d2d1219c4b839f80c80e3126fefa` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:34.806723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cb152-f92a-487b-8175-7785e91056a6 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:34.813240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9481aba-12f8-42c8-9ff9-e767c9891f35 None admin] RBAC: Authorizing `identity:get_user(user_id=ef61d2d1219c4b839f80c80e3126fefa)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:34.814709 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9481aba-12f8-42c8-9ff9-e767c9891f35 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:34.816357 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 536/1064] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:02:34 2022] GET /identity/v3/users/ef61d2d1219c4b839f80c80e3126fefa => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:34.821972 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9481aba-12f8-42c8-9ff9-e767c9891f35 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:34.838511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4effb4-8a4b-4c31-b787-8ddaf97c7c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:34.839173 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4effb4-8a4b-4c31-b787-8ddaf97c7c17 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:34.839454 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4effb4-8a4b-4c31-b787-8ddaf97c7c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:34.839726 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4effb4-8a4b-4c31-b787-8ddaf97c7c17 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:34.840467 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4effb4-8a4b-4c31-b787-8ddaf97c7c17 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:34.840766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4effb4-8a4b-4c31-b787-8ddaf97c7c17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:34.842136 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4effb4-8a4b-4c31-b787-8ddaf97c7c17 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:34.850352 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 529/1065] 10.222.0.76 () {56 vars in 1115 bytes} [Mon May 16 15:02:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:34.856174 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4effb4-8a4b-4c31-b787-8ddaf97c7c17 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:34.924973 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9481aba-12f8-42c8-9ff9-e767c9891f35 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:34.949275 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4effb4-8a4b-4c31-b787-8ddaf97c7c17 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:34.956489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96894b9-49d9-493f-85d2-b548b8230bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:34.957124 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96894b9-49d9-493f-85d2-b548b8230bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:34.957399 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96894b9-49d9-493f-85d2-b548b8230bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:34.957670 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96894b9-49d9-493f-85d2-b548b8230bd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:34.982265 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168681d-c9f5-4561-a4fe-caebb8da1b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:34.983051 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168681d-c9f5-4561-a4fe-caebb8da1b2d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:34.983335 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168681d-c9f5-4561-a4fe-caebb8da1b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:34.983607 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168681d-c9f5-4561-a4fe-caebb8da1b2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:34.993708 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168681d-c9f5-4561-a4fe-caebb8da1b2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:34.995197 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168681d-c9f5-4561-a4fe-caebb8da1b2d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:35.011855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-f168681d-c9f5-4561-a4fe-caebb8da1b2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:35.011855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:35.011855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:35.011855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:35.011855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:35.011855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:35.011855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:35.011855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:35.011855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:35.011855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:35.011855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:35.011855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:35.011855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:02:35.011855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:02:35.011855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:02:35.012929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:02:35.012929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:35.012929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:35.012929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:35.012929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:35.012929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:35.012929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:35.012929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:35.012929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:35.012929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:35.012929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:35.012929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:35.012929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:35.012929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:35.012929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:35.012929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:35.012929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:35.014149 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:02:35.014149 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:02:35.014149 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:35.014149 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:35.017909 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 530/1066] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:02:35.018612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168681d-c9f5-4561-a4fe-caebb8da1b2d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:35.021708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96894b9-49d9-493f-85d2-b548b8230bd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:35.023197 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96894b9-49d9-493f-85d2-b548b8230bd0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:35.112947 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168681d-c9f5-4561-a4fe-caebb8da1b2d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:35.114470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 537/1067] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:02:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 15:02:35.120214 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96894b9-49d9-493f-85d2-b548b8230bd0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:35.145156 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2783fa0-756c-489a-9f96-2493359c726a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:35.146371 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2783fa0-756c-489a-9f96-2493359c726a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:35.146653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2783fa0-756c-489a-9f96-2493359c726a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:35.146924 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2783fa0-756c-489a-9f96-2493359c726a None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:35.147645 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2783fa0-756c-489a-9f96-2493359c726a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:35.147947 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2783fa0-756c-489a-9f96-2493359c726a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:35.149311 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2783fa0-756c-489a-9f96-2493359c726a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:35.160517 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 531/1068] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:35.166496 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2783fa0-756c-489a-9f96-2493359c726a None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:35.211486 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96894b9-49d9-493f-85d2-b548b8230bd0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:35.243275 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa8b89-7186-4fe5-9d2c-6b7422f43c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:35.244109 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa8b89-7186-4fe5-9d2c-6b7422f43c5b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:35.244382 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa8b89-7186-4fe5-9d2c-6b7422f43c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:35.244651 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa8b89-7186-4fe5-9d2c-6b7422f43c5b None admin] PATH_INFO: `/v3/projects/b66f4b53bbc24536a888dad02ece0dcc` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:35.245801 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa8b89-7186-4fe5-9d2c-6b7422f43c5b None admin] RBAC: Authorizing `identity:get_project(project_id=b66f4b53bbc24536a888dad02ece0dcc)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:35.247264 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa8b89-7186-4fe5-9d2c-6b7422f43c5b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:35.248940 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 538/1069] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:02:35 2022] GET /identity/v3/projects/b66f4b53bbc24536a888dad02ece0dcc => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:35.255706 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa8b89-7186-4fe5-9d2c-6b7422f43c5b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:35.259612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2783fa0-756c-489a-9f96-2493359c726a None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:35.292207 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595fd38-baff-4d73-a623-01cd28ad08f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:35.292923 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595fd38-baff-4d73-a623-01cd28ad08f7 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:35.293207 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595fd38-baff-4d73-a623-01cd28ad08f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:35.293482 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595fd38-baff-4d73-a623-01cd28ad08f7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:35.301402 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595fd38-baff-4d73-a623-01cd28ad08f7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:35.302914 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595fd38-baff-4d73-a623-01cd28ad08f7 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:35.316766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-0595fd38-baff-4d73-a623-01cd28ad08f7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 15:02:35.316766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:35.316766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:35.316766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:35.316766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:35.316766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:35.316766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:35.316766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:35.316766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:35.316766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:35.316766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:35.316766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:35.316766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:02:35.316766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:02:35.316766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:02:35.316766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:02:35.318412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:35.318412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:35.318412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:02:35.318412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:02:35.318412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:02:35.318412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:02:35.318412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:35.318412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:35.318412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:35.318412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:35.318412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:35.318412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:35.318412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:35.318412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:35.318412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:35.318412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:35.318412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:35.318412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:35.319924 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:35.319924 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:35.319924 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:02:35.319924 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:02:35.319924 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:02:35.319924 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:02:35.319924 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:02:35.319924 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:02:35.319924 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 15:02:35.319924 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:35.319924 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 532/1070] 10.222.0.76 () {56 vars in 1093 bytes} [Mon May 16 15:02:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:02:35.324047 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595fd38-baff-4d73-a623-01cd28ad08f7 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:35.349933 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa8b89-7186-4fe5-9d2c-6b7422f43c5b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:35.382818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee0363-fee0-4b20-90ae-5eea290cdfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:35.383458 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee0363-fee0-4b20-90ae-5eea290cdfe4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:35.383742 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee0363-fee0-4b20-90ae-5eea290cdfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:35.384015 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee0363-fee0-4b20-90ae-5eea290cdfe4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:35.384848 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee0363-fee0-4b20-90ae-5eea290cdfe4 None admin] RBAC: Adding query filter params (role.id=f6c8fc0dc0f24de3907b0960a1201901, scope.project.id=b66f4b53bbc24536a888dad02ece0dcc, user.id=ef61d2d1219c4b839f80c80e3126fefa) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:35.385157 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee0363-fee0-4b20-90ae-5eea290cdfe4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:35.386631 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee0363-fee0-4b20-90ae-5eea290cdfe4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:35.391906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 539/1071] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:02:35 2022] GET /identity/v3/role_assignments?user.id=ef61d2d1219c4b839f80c80e3126fefa&scope.project.id=b66f4b53bbc24536a888dad02ece0dcc&role.id=f6c8fc0dc0f24de3907b0960a1201901 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:35.420397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595fd38-baff-4d73-a623-01cd28ad08f7 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:35.457120 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f494b-833d-46b4-b40d-8258f614dc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:35.458030 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f494b-833d-46b4-b40d-8258f614dc48 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:35.458371 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f494b-833d-46b4-b40d-8258f614dc48 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:35.458651 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f494b-833d-46b4-b40d-8258f614dc48 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:35.459572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f494b-833d-46b4-b40d-8258f614dc48 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:35.459883 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f494b-833d-46b4-b40d-8258f614dc48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:35.461401 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f494b-833d-46b4-b40d-8258f614dc48 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:35.481218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 533/1072] 10.222.0.76 () {56 vars in 1133 bytes} [Mon May 16 15:02:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:35.487017 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee0363-fee0-4b20-90ae-5eea290cdfe4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:35.590087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee0363-fee0-4b20-90ae-5eea290cdfe4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:35.624227 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c0cd8-6ddd-410b-8a3b-8d7883e29cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:35.625015 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c0cd8-6ddd-410b-8a3b-8d7883e29cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:35.625324 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c0cd8-6ddd-410b-8a3b-8d7883e29cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:35.625601 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c0cd8-6ddd-410b-8a3b-8d7883e29cb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:35.636606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c0cd8-6ddd-410b-8a3b-8d7883e29cb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:35.638050 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c0cd8-6ddd-410b-8a3b-8d7883e29cb0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:35.654564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-f00c0cd8-6ddd-410b-8a3b-8d7883e29cb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:35.654564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:35.654564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:35.654564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:35.654564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:35.654564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:35.654564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:35.654564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:35.654564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:35.654564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:35.654564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:35.654564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:35.654564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:02:35.654564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:02:35.654564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:02:35.655649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:02:35.655649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:35.655649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:35.655649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:35.655649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:35.655649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:35.655649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:35.655649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:35.655649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:35.655649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:35.655649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:35.655649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:35.655649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:35.655649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:35.655649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:35.655649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:35.655649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:35.656869 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:02:35.656869 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:02:35.656869 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:35.656869 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:35.656869 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 540/1073] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:35.661460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f494b-833d-46b4-b40d-8258f614dc48 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:35.759804 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f494b-833d-46b4-b40d-8258f614dc48 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:35.791522 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55625821-9965-4160-85b5-29cbaea498d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:35.792183 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55625821-9965-4160-85b5-29cbaea498d1 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:35.792468 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55625821-9965-4160-85b5-29cbaea498d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:35.792744 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55625821-9965-4160-85b5-29cbaea498d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:35.793460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55625821-9965-4160-85b5-29cbaea498d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:35.793765 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55625821-9965-4160-85b5-29cbaea498d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:35.795162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55625821-9965-4160-85b5-29cbaea498d1 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:35.806360 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 534/1074] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:35.811822 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c0cd8-6ddd-410b-8a3b-8d7883e29cb0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:35.907973 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c0cd8-6ddd-410b-8a3b-8d7883e29cb0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:35.940005 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d4c85-2282-41cc-a286-1156b8a45005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:35.940792 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d4c85-2282-41cc-a286-1156b8a45005 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:35.941075 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d4c85-2282-41cc-a286-1156b8a45005 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:35.941349 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d4c85-2282-41cc-a286-1156b8a45005 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:35.948586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d4c85-2282-41cc-a286-1156b8a45005 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:35.950024 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d4c85-2282-41cc-a286-1156b8a45005 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:35.963944 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-088d4c85-2282-41cc-a286-1156b8a45005 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:02:35.963944 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:35.963944 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:35.963944 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:35.963944 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:35.963944 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:35.963944 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:35.963944 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:35.963944 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:35.963944 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:35.963944 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:35.963944 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:35.963944 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:02:35.963944 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:02:35.963944 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:02:35.964978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:02:35.964978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:35.964978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:35.964978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:35.964978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:35.964978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:35.964978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:35.964978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:35.964978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:35.964978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:35.964978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:35.964978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:35.964978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:35.964978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:35.964978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:35.964978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:35.964978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:35.965939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:02:35.965939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:02:35.965939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:02:35.965939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:02:35.965939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:02:35.965939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:02:35.965939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:02:35.965939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:35.965939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 541/1075] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:02:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:35.970826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55625821-9965-4160-85b5-29cbaea498d1 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:36.066415 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55625821-9965-4160-85b5-29cbaea498d1 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:36.097717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1e045-f565-4afb-9d5d-e035a5d7e94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:36.098400 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1e045-f565-4afb-9d5d-e035a5d7e94c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:36.099175 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1e045-f565-4afb-9d5d-e035a5d7e94c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:36.099451 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1e045-f565-4afb-9d5d-e035a5d7e94c None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:36.100235 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1e045-f565-4afb-9d5d-e035a5d7e94c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:36.100542 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1e045-f565-4afb-9d5d-e035a5d7e94c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:36.101965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1e045-f565-4afb-9d5d-e035a5d7e94c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:36.114391 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 535/1076] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:02:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:36.120785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d4c85-2282-41cc-a286-1156b8a45005 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:36.215545 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d4c85-2282-41cc-a286-1156b8a45005 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:36.248368 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4415d-c2d4-4b18-9bc4-e143455d2c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:36.249237 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4415d-c2d4-4b18-9bc4-e143455d2c65 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:36.249516 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4415d-c2d4-4b18-9bc4-e143455d2c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:36.249787 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4415d-c2d4-4b18-9bc4-e143455d2c65 None admin] PATH_INFO: `/v3/projects/681a6490f3c04f9fa2830cfde3deb2e9/users/9d85024f010c40129d79543b3ec4cfae/roles/ab71625c5e074cf3b9b93b50548182f2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:36.252245 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4415d-c2d4-4b18-9bc4-e143455d2c65 None admin] RBAC: Authorizing `identity:create_grant(project_id=681a6490f3c04f9fa2830cfde3deb2e9, user_id=9d85024f010c40129d79543b3ec4cfae, role_id=ab71625c5e074cf3b9b93b50548182f2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:36.253679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4415d-c2d4-4b18-9bc4-e143455d2c65 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:36.326391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 542/1077] 10.222.0.76 () {58 vars in 1439 bytes} [Mon May 16 15:02:36 2022] PUT /identity/v3/projects/681a6490f3c04f9fa2830cfde3deb2e9/users/9d85024f010c40129d79543b3ec4cfae/roles/ab71625c5e074cf3b9b93b50548182f2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:02:37.589728 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b7085-28ba-4b36-a77e-0340e2e12397 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:37.590177 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b7085-28ba-4b36-a77e-0340e2e12397 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:37.590320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b7085-28ba-4b36-a77e-0340e2e12397 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:37.591696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 536/1078] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:37.597064 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a5c07-7a5f-40c5-90d8-e1f63d25799c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:37.597459 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a5c07-7a5f-40c5-90d8-e1f63d25799c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:37.597612 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a5c07-7a5f-40c5-90d8-e1f63d25799c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:37.615092 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-bc3a5c07-7a5f-40c5-90d8-e1f63d25799c None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:37.616253 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bc3a5c07-7a5f-40c5-90d8-e1f63d25799c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:37.680402 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 543/1079] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 15:02:37.702626 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b7085-28ba-4b36-a77e-0340e2e12397 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:37.799246 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b7085-28ba-4b36-a77e-0340e2e12397 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:37.830938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd8146-71ff-4da5-b25a-e488af404989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:37.831718 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd8146-71ff-4da5-b25a-e488af404989 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:37.831998 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd8146-71ff-4da5-b25a-e488af404989 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:37.832273 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd8146-71ff-4da5-b25a-e488af404989 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:37.841976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd8146-71ff-4da5-b25a-e488af404989 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:02:37.849917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-ccbd8146-71ff-4da5-b25a-e488af404989 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:02:37.849917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:37.849917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:37.849917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:37.849917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:37.849917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:37.849917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:37.849917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:37.849917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:37.849917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:37.849917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:37.849917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:37.849917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:02:37.849917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:02:37.849917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:02:37.849917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:02:37.851044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:02:37.851044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:02:37.851044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:02:37.851044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:02:37.851044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:37.851044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:37.851044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:37.851044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:37.851044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:37.851044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:37.851044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:37.851044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:37.851044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:37.851044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:37.851044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:37.851044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:37.852234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:37.852234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:37.852234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:37.852234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:37.852234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:02:37.852234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:02:37.852234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:02:37.852234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:02:37.852234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:02:37.852234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:02:37.852234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:02:37.852234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:37.852234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 537/1080] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:02:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:37.857095 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a5c07-7a5f-40c5-90d8-e1f63d25799c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:37.950559 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a5c07-7a5f-40c5-90d8-e1f63d25799c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:37.983103 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea5db9-d5cd-476b-b519-2fdf660c28a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:37.983758 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea5db9-d5cd-476b-b519-2fdf660c28a1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:37.984037 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea5db9-d5cd-476b-b519-2fdf660c28a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:37.984307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea5db9-d5cd-476b-b519-2fdf660c28a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:37.985048 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea5db9-d5cd-476b-b519-2fdf660c28a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:37.985351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea5db9-d5cd-476b-b519-2fdf660c28a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:37.986741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea5db9-d5cd-476b-b519-2fdf660c28a1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:37.995271 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 544/1081] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:02:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:38.001062 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd8146-71ff-4da5-b25a-e488af404989 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:38.097234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd8146-71ff-4da5-b25a-e488af404989 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:38.129126 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725b2b9-b8e3-433e-85fa-aa712744ba9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:38.130568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725b2b9-b8e3-433e-85fa-aa712744ba9e None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:38.130845 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725b2b9-b8e3-433e-85fa-aa712744ba9e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:38.131115 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725b2b9-b8e3-433e-85fa-aa712744ba9e None admin] PATH_INFO: `/v3/users/ef61d2d1219c4b839f80c80e3126fefa` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:38.132299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725b2b9-b8e3-433e-85fa-aa712744ba9e None admin] RBAC: Authorizing `identity:get_user(user_id=ef61d2d1219c4b839f80c80e3126fefa)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:38.133734 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725b2b9-b8e3-433e-85fa-aa712744ba9e None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:38.135399 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 538/1082] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:02:38 2022] GET /identity/v3/users/ef61d2d1219c4b839f80c80e3126fefa => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:02:38.141168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea5db9-d5cd-476b-b519-2fdf660c28a1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:38.235363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea5db9-d5cd-476b-b519-2fdf660c28a1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:38.267710 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fad155-6e2f-4378-af58-0ceacd442713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:38.268550 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fad155-6e2f-4378-af58-0ceacd442713 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:38.268825 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fad155-6e2f-4378-af58-0ceacd442713 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:38.269093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fad155-6e2f-4378-af58-0ceacd442713 None admin] PATH_INFO: `/v3/projects/b66f4b53bbc24536a888dad02ece0dcc` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:38.270270 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fad155-6e2f-4378-af58-0ceacd442713 None admin] RBAC: Authorizing `identity:get_project(project_id=b66f4b53bbc24536a888dad02ece0dcc)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:38.271733 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fad155-6e2f-4378-af58-0ceacd442713 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:38.273415 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 545/1083] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:02:38 2022] GET /identity/v3/projects/b66f4b53bbc24536a888dad02ece0dcc => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:38.279388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725b2b9-b8e3-433e-85fa-aa712744ba9e None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:38.378251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725b2b9-b8e3-433e-85fa-aa712744ba9e None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:38.410029 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b9325-8fec-4ada-b537-e1cf43da5f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:38.411455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b9325-8fec-4ada-b537-e1cf43da5f43 None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:38.411744 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b9325-8fec-4ada-b537-e1cf43da5f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:38.412019 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b9325-8fec-4ada-b537-e1cf43da5f43 None admin] PATH_INFO: `/v3/projects/b66f4b53bbc24536a888dad02ece0dcc/users/ef61d2d1219c4b839f80c80e3126fefa/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:38.413945 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b9325-8fec-4ada-b537-e1cf43da5f43 None admin] RBAC: Authorizing `identity:create_grant(project_id=b66f4b53bbc24536a888dad02ece0dcc, user_id=ef61d2d1219c4b839f80c80e3126fefa, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:38.415420 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b9325-8fec-4ada-b537-e1cf43da5f43 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:38.498301 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 539/1084] 10.222.0.76 () {58 vars in 1439 bytes} [Mon May 16 15:02:38 2022] PUT /identity/v3/projects/b66f4b53bbc24536a888dad02ece0dcc/users/ef61d2d1219c4b839f80c80e3126fefa/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:02:38.525624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e55e9-04a0-442f-96d2-435d055d79c7 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:38.526033 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e55e9-04a0-442f-96d2-435d055d79c7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:38.526359 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e55e9-04a0-442f-96d2-435d055d79c7 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:38.527778 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 546/1085] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:38.533899 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5f1a4-d69b-45bf-9a55-f0277b5b717b None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:38.534220 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5f1a4-d69b-45bf-9a55-f0277b5b717b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:38.534497 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5f1a4-d69b-45bf-9a55-f0277b5b717b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:38.552984 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-bef5f1a4-d69b-45bf-9a55-f0277b5b717b None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:38.554346 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-bef5f1a4-d69b-45bf-9a55-f0277b5b717b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:38.627198 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 540/1086] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:38.651506 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e55e9-04a0-442f-96d2-435d055d79c7 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:38.753360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e55e9-04a0-442f-96d2-435d055d79c7 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:38.787081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c55811-859a-4b61-9552-fa455442d5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:38.787881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c55811-859a-4b61-9552-fa455442d5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:38.788154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c55811-859a-4b61-9552-fa455442d5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:38.788418 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c55811-859a-4b61-9552-fa455442d5a8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:38.798580 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c55811-859a-4b61-9552-fa455442d5a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:02:38.806629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-f4c55811-859a-4b61-9552-fa455442d5a8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 15:02:38.806629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:38.806629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:38.806629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:38.806629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:38.806629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:38.806629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:38.806629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:38.806629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:38.806629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:38.806629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:38.806629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:38.806629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:02:38.806629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:02:38.806629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:02:38.806629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:02:38.807608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:02:38.807608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:02:38.807608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:02:38.807608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:02:38.807608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:38.807608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:38.807608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:38.807608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:38.807608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:38.807608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:38.807608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:38.807608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:38.807608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:38.807608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:38.807608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:38.807608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:38.808474 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:38.808474 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:38.808474 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:38.808474 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:38.808474 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:02:38.808474 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:02:38.808474 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:02:38.808474 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:02:38.808474 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:02:38.808474 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:02:38.808474 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 15:02:38.808474 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:38.809124 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 547/1087] 10.222.0.76 () {56 vars in 1120 bytes} [Mon May 16 15:02:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:38.813788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5f1a4-d69b-45bf-9a55-f0277b5b717b None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:38.908331 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5f1a4-d69b-45bf-9a55-f0277b5b717b None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:38.942683 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258a635-fc77-4a6e-8569-2a75d88893ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:38.943355 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258a635-fc77-4a6e-8569-2a75d88893ea None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:38.943637 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258a635-fc77-4a6e-8569-2a75d88893ea None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:38.943910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258a635-fc77-4a6e-8569-2a75d88893ea None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:38.944657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258a635-fc77-4a6e-8569-2a75d88893ea None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:38.944964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258a635-fc77-4a6e-8569-2a75d88893ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:38.946366 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258a635-fc77-4a6e-8569-2a75d88893ea None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:38.954034 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 541/1088] 10.222.0.76 () {56 vars in 1115 bytes} [Mon May 16 15:02:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:38.960160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c55811-859a-4b61-9552-fa455442d5a8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:39.055567 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c55811-859a-4b61-9552-fa455442d5a8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:39.086931 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ba3bb-8fd6-48b4-8be0-bebd6d56ad83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:39.087703 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ba3bb-8fd6-48b4-8be0-bebd6d56ad83 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:39.087981 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ba3bb-8fd6-48b4-8be0-bebd6d56ad83 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:39.088253 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ba3bb-8fd6-48b4-8be0-bebd6d56ad83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:39.098186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ba3bb-8fd6-48b4-8be0-bebd6d56ad83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:39.100177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ba3bb-8fd6-48b4-8be0-bebd6d56ad83 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:39.117236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-803ba3bb-8fd6-48b4-8be0-bebd6d56ad83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:39.117236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:39.117236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:39.117236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:39.117236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:39.117236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:39.117236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:39.117236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:39.117236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:39.117236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:39.117236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:39.117236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:39.117236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:02:39.117236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:02:39.117236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:02:39.118307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:02:39.118307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:39.118307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:39.118307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:39.118307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:39.118307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:39.118307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:39.118307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:39.118307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:39.118307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:39.118307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:39.118307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:39.118307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:39.118307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:39.118307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:39.118307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:39.118307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:39.119225 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:02:39.119225 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:02:39.119225 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:39.119225 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:39.122282 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 548/1089] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:39.124058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258a635-fc77-4a6e-8569-2a75d88893ea None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:39.220410 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258a635-fc77-4a6e-8569-2a75d88893ea None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:39.253546 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2109f3-5361-403c-a28f-bcd5d2fc77f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:39.254239 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2109f3-5361-403c-a28f-bcd5d2fc77f8 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:39.254524 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2109f3-5361-403c-a28f-bcd5d2fc77f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:39.254828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2109f3-5361-403c-a28f-bcd5d2fc77f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:39.255550 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2109f3-5361-403c-a28f-bcd5d2fc77f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:39.255857 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2109f3-5361-403c-a28f-bcd5d2fc77f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:39.257225 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2109f3-5361-403c-a28f-bcd5d2fc77f8 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:39.268467 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 542/1090] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:39.273996 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ba3bb-8fd6-48b4-8be0-bebd6d56ad83 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:39.370136 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ba3bb-8fd6-48b4-8be0-bebd6d56ad83 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:39.402151 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f53b3b-4d1a-41ff-ac85-73401c9bd5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:39.402930 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f53b3b-4d1a-41ff-ac85-73401c9bd5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:39.403215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f53b3b-4d1a-41ff-ac85-73401c9bd5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:39.403493 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f53b3b-4d1a-41ff-ac85-73401c9bd5a9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:39.410630 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f53b3b-4d1a-41ff-ac85-73401c9bd5a9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:39.412672 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f53b3b-4d1a-41ff-ac85-73401c9bd5a9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:39.426254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-90f53b3b-4d1a-41ff-ac85-73401c9bd5a9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 15:02:39.426254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:39.426254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:39.426254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:39.426254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:39.426254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:39.426254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:39.426254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:39.426254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:39.426254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:39.426254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:39.426254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:39.426254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:02:39.426254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:02:39.426254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:02:39.426254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:02:39.427269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:39.427269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:39.427269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:02:39.427269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:02:39.427269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:02:39.427269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:02:39.427269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:39.427269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:39.427269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:39.427269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:39.427269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:39.427269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:39.427269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:39.427269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:39.427269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:39.427269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:39.427269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:39.427269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:39.428258 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:39.428258 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:39.428258 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:02:39.428258 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:02:39.428258 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:02:39.428258 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:02:39.428258 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:02:39.428258 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:02:39.428258 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 15:02:39.428258 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:39.428258 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 549/1091] 10.222.0.76 () {56 vars in 1093 bytes} [Mon May 16 15:02:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:39.433297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2109f3-5361-403c-a28f-bcd5d2fc77f8 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:39.527949 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2109f3-5361-403c-a28f-bcd5d2fc77f8 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:39.560443 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c598a-bec0-4522-9168-f2d7ef91e644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:39.561113 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c598a-bec0-4522-9168-f2d7ef91e644 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:39.561393 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c598a-bec0-4522-9168-f2d7ef91e644 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:39.561667 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c598a-bec0-4522-9168-f2d7ef91e644 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:39.562530 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c598a-bec0-4522-9168-f2d7ef91e644 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:39.562843 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c598a-bec0-4522-9168-f2d7ef91e644 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:39.564344 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c598a-bec0-4522-9168-f2d7ef91e644 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:39.581558 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 543/1092] 10.222.0.76 () {56 vars in 1133 bytes} [Mon May 16 15:02:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:39.587504 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f53b3b-4d1a-41ff-ac85-73401c9bd5a9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:39.690450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f53b3b-4d1a-41ff-ac85-73401c9bd5a9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:39.730412 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855a1d2-fe30-465a-b67c-75a6deaefacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:39.731062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855a1d2-fe30-465a-b67c-75a6deaefacd None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:39.731344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855a1d2-fe30-465a-b67c-75a6deaefacd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:39.731620 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855a1d2-fe30-465a-b67c-75a6deaefacd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:39.796701 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855a1d2-fe30-465a-b67c-75a6deaefacd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:39.798082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855a1d2-fe30-465a-b67c-75a6deaefacd None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:39.890317 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 550/1093] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:02:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 15:02:39.896782 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c598a-bec0-4522-9168-f2d7ef91e644 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:39.990679 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c598a-bec0-4522-9168-f2d7ef91e644 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:40.027175 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c9be9-a9e4-4541-8d63-a4758cc2f0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:40.027966 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c9be9-a9e4-4541-8d63-a4758cc2f0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:40.028249 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c9be9-a9e4-4541-8d63-a4758cc2f0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:40.028526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c9be9-a9e4-4541-8d63-a4758cc2f0c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:40.038612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c9be9-a9e4-4541-8d63-a4758cc2f0c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:40.040061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c9be9-a9e4-4541-8d63-a4758cc2f0c2 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:40.057276 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-159c9be9-a9e4-4541-8d63-a4758cc2f0c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:40.057276 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:40.057276 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:40.057276 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:40.057276 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:40.057276 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:40.057276 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:40.057276 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:40.057276 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:40.057276 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:40.057276 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:40.057276 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:40.057276 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:02:40.057276 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:02:40.057276 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:02:40.058450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:02:40.058450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:40.058450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:40.058450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:40.058450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:40.058450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:40.058450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:40.058450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:40.058450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:40.058450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:40.058450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:40.058450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:40.058450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:40.058450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:40.058450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:40.058450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:40.058450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:40.059358 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:02:40.059358 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:02:40.059358 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:02:40.059358 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:40.059358 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 544/1094] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:40.064094 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855a1d2-fe30-465a-b67c-75a6deaefacd None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:40.159482 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855a1d2-fe30-465a-b67c-75a6deaefacd None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:40.192807 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d06d7c-68c5-4a03-b647-a40d2f0b0bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:40.193465 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d06d7c-68c5-4a03-b647-a40d2f0b0bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:40.193745 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d06d7c-68c5-4a03-b647-a40d2f0b0bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:40.194018 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d06d7c-68c5-4a03-b647-a40d2f0b0bd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:40.194773 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d06d7c-68c5-4a03-b647-a40d2f0b0bd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:40.195081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d06d7c-68c5-4a03-b647-a40d2f0b0bd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:40.196453 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d06d7c-68c5-4a03-b647-a40d2f0b0bd5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:40.207496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 551/1095] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:40.213064 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c9be9-a9e4-4541-8d63-a4758cc2f0c2 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:40.307829 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c9be9-a9e4-4541-8d63-a4758cc2f0c2 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:40.340036 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12812a3f-f9a0-4985-b7cd-e43b264a26e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:40.340832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12812a3f-f9a0-4985-b7cd-e43b264a26e0 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:40.341115 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12812a3f-f9a0-4985-b7cd-e43b264a26e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:40.341392 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12812a3f-f9a0-4985-b7cd-e43b264a26e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:40.347845 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12812a3f-f9a0-4985-b7cd-e43b264a26e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:40.349824 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12812a3f-f9a0-4985-b7cd-e43b264a26e0 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:40.363253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-12812a3f-f9a0-4985-b7cd-e43b264a26e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:02:40.363253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:40.363253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:40.363253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:40.363253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:40.363253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:40.363253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:40.363253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:40.363253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:40.363253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:40.363253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:40.363253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:40.363253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:02:40.363253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:02:40.363253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:02:40.364316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:02:40.364316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:40.364316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:40.364316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:40.364316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:40.364316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:40.364316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:40.364316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:40.364316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:02:40.364316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:40.364316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:40.364316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:40.364316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:40.364316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:40.364316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:40.364316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:40.364316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:40.365254 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:02:40.365254 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:02:40.365254 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:02:40.365254 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:02:40.365254 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:02:40.365254 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:02:40.365254 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:02:40.365254 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:02:40.365254 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 545/1096] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:02:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:02:40.370233 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d06d7c-68c5-4a03-b647-a40d2f0b0bd5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:40.469931 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d06d7c-68c5-4a03-b647-a40d2f0b0bd5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:40.502223 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42ba26-79a3-4098-a6c2-2f7886468f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:40.502877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42ba26-79a3-4098-a6c2-2f7886468f0d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:40.503155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42ba26-79a3-4098-a6c2-2f7886468f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:40.503429 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42ba26-79a3-4098-a6c2-2f7886468f0d None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:40.504204 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42ba26-79a3-4098-a6c2-2f7886468f0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:40.504509 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42ba26-79a3-4098-a6c2-2f7886468f0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:40.506457 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42ba26-79a3-4098-a6c2-2f7886468f0d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:40.517976 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 552/1097] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:02:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:40.524351 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12812a3f-f9a0-4985-b7cd-e43b264a26e0 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:40.623155 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12812a3f-f9a0-4985-b7cd-e43b264a26e0 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:40.656587 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f3db9-3166-428d-b12b-2fb8b8624947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:40.657247 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f3db9-3166-428d-b12b-2fb8b8624947 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:40.657530 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f3db9-3166-428d-b12b-2fb8b8624947 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:40.657809 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f3db9-3166-428d-b12b-2fb8b8624947 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:40.658665 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f3db9-3166-428d-b12b-2fb8b8624947 None admin] RBAC: Adding query filter params (role.id=ab71625c5e074cf3b9b93b50548182f2, scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9, user.id=9d85024f010c40129d79543b3ec4cfae) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:40.658978 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f3db9-3166-428d-b12b-2fb8b8624947 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:40.660404 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f3db9-3166-428d-b12b-2fb8b8624947 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:40.678163 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 546/1098] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:02:40 2022] GET /identity/v3/role_assignments?user.id=9d85024f010c40129d79543b3ec4cfae&scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9&role.id=ab71625c5e074cf3b9b93b50548182f2 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:40.781512 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4d8ec-3986-4804-bc3a-4bb319971b77 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:40.782047 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4d8ec-3986-4804-bc3a-4bb319971b77 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:40.782047 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4d8ec-3986-4804-bc3a-4bb319971b77 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:40.783475 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 553/1099] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:40.789708 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4561d-41a6-49df-9efd-c7abcef9964c None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:40.790003 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4561d-41a6-49df-9efd-c7abcef9964c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:40.790314 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4561d-41a6-49df-9efd-c7abcef9964c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:40.809138 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d3d4561d-41a6-49df-9efd-c7abcef9964c None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:40.810396 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d3d4561d-41a6-49df-9efd-c7abcef9964c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:40.877988 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 547/1100] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:40.902017 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4d8ec-3986-4804-bc3a-4bb319971b77 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:41.007229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4d8ec-3986-4804-bc3a-4bb319971b77 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:41.039700 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbad82d-74ef-461f-81ae-f23ed39eedc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:41.040493 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbad82d-74ef-461f-81ae-f23ed39eedc8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:41.040771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbad82d-74ef-461f-81ae-f23ed39eedc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:41.041039 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbad82d-74ef-461f-81ae-f23ed39eedc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:41.051148 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbad82d-74ef-461f-81ae-f23ed39eedc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:02:41.059471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-dbbad82d-74ef-461f-81ae-f23ed39eedc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:02:41.059471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:02:41.059471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:02:41.059471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:02:41.059471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:02:41.059471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:02:41.059471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:02:41.059471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:02:41.059471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:02:41.059471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:02:41.059471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:02:41.059471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:02:41.059471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:02:41.059471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:02:41.059471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:02:41.059471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:02:41.060526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:02:41.060526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:02:41.060526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:02:41.060526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:02:41.060526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:02:41.060526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:02:41.060526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:02:41.060526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:02:41.060526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:02:41.060526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:02:41.060526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:02:41.060526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:02:41.060526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:02:41.060526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:02:41.060526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:02:41.060526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:02:41.061491 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:02:41.061491 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:02:41.061491 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:02:41.061491 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:02:41.061491 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:02:41.061491 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:02:41.061491 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:02:41.061491 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:02:41.061491 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:02:41.061491 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:02:41.061491 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:02:41.061491 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:02:41.061491 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 554/1101] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:02:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:02:41.066763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4561d-41a6-49df-9efd-c7abcef9964c None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:41.163239 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4561d-41a6-49df-9efd-c7abcef9964c None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:41.196913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012dd54-614f-4846-ba5a-c5686dc516c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:41.197581 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012dd54-614f-4846-ba5a-c5686dc516c9 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:41.197871 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012dd54-614f-4846-ba5a-c5686dc516c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:41.198196 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012dd54-614f-4846-ba5a-c5686dc516c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:41.198939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012dd54-614f-4846-ba5a-c5686dc516c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:41.199246 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012dd54-614f-4846-ba5a-c5686dc516c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:41.200706 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012dd54-614f-4846-ba5a-c5686dc516c9 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:41.209370 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 548/1102] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:02:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:41.215306 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbad82d-74ef-461f-81ae-f23ed39eedc8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:41.317092 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbad82d-74ef-461f-81ae-f23ed39eedc8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:41.349955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547703f8-33bf-4279-8c6a-637af742bceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:41.350852 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547703f8-33bf-4279-8c6a-637af742bceb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:41.351127 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547703f8-33bf-4279-8c6a-637af742bceb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:41.351399 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547703f8-33bf-4279-8c6a-637af742bceb None admin] PATH_INFO: `/v3/users/ef61d2d1219c4b839f80c80e3126fefa` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:41.352575 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547703f8-33bf-4279-8c6a-637af742bceb None admin] RBAC: Authorizing `identity:get_user(user_id=ef61d2d1219c4b839f80c80e3126fefa)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:41.354007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547703f8-33bf-4279-8c6a-637af742bceb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:41.355721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 555/1103] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:02:41 2022] GET /identity/v3/users/ef61d2d1219c4b839f80c80e3126fefa => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:41.361637 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012dd54-614f-4846-ba5a-c5686dc516c9 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:41.461889 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012dd54-614f-4846-ba5a-c5686dc516c9 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:41.494569 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75cb995-67e2-4a1c-8648-435bccd34b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:41.495213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cb995-67e2-4a1c-8648-435bccd34b97 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:41.495490 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cb995-67e2-4a1c-8648-435bccd34b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:41.495765 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cb995-67e2-4a1c-8648-435bccd34b97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:41.559977 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75cb995-67e2-4a1c-8648-435bccd34b97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:41.561421 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75cb995-67e2-4a1c-8648-435bccd34b97 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:41.652788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 549/1104] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:02:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 15:02:41.658678 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547703f8-33bf-4279-8c6a-637af742bceb None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:41.760595 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547703f8-33bf-4279-8c6a-637af742bceb None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:41.792609 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f1197-decb-4b30-8af7-2641b7b6f79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:41.793457 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f1197-decb-4b30-8af7-2641b7b6f79f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:41.793737 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f1197-decb-4b30-8af7-2641b7b6f79f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:41.794010 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f1197-decb-4b30-8af7-2641b7b6f79f None admin] PATH_INFO: `/v3/projects/b66f4b53bbc24536a888dad02ece0dcc` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:41.795194 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f1197-decb-4b30-8af7-2641b7b6f79f None admin] RBAC: Authorizing `identity:get_project(project_id=b66f4b53bbc24536a888dad02ece0dcc)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:41.796615 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f1197-decb-4b30-8af7-2641b7b6f79f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:41.798326 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 556/1105] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:02:41 2022] GET /identity/v3/projects/b66f4b53bbc24536a888dad02ece0dcc => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:41.804911 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75cb995-67e2-4a1c-8648-435bccd34b97 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:41.898212 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75cb995-67e2-4a1c-8648-435bccd34b97 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:41.930146 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df6ccd-e6ff-4512-b9dc-7edcaccc4eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:41.930817 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df6ccd-e6ff-4512-b9dc-7edcaccc4eae None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:41.931100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df6ccd-e6ff-4512-b9dc-7edcaccc4eae None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:41.931374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df6ccd-e6ff-4512-b9dc-7edcaccc4eae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:41.932206 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df6ccd-e6ff-4512-b9dc-7edcaccc4eae None admin] RBAC: Adding query filter params (role.id=f6c8fc0dc0f24de3907b0960a1201901, scope.project.id=b66f4b53bbc24536a888dad02ece0dcc, user.id=ef61d2d1219c4b839f80c80e3126fefa) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:41.932509 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df6ccd-e6ff-4512-b9dc-7edcaccc4eae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:41.933930 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df6ccd-e6ff-4512-b9dc-7edcaccc4eae None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:41.939557 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 550/1106] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:02:41 2022] GET /identity/v3/role_assignments?user.id=ef61d2d1219c4b839f80c80e3126fefa&scope.project.id=b66f4b53bbc24536a888dad02ece0dcc&role.id=f6c8fc0dc0f24de3907b0960a1201901 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:44.161879 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3c43c-31f6-4139-b681-3a2afd2c511f None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:44.162466 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3c43c-31f6-4139-b681-3a2afd2c511f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:44.162466 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3c43c-31f6-4139-b681-3a2afd2c511f None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:44.163820 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 557/1107] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:44.169186 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b220b06-d8d8-4e2f-94f8-6b220e4030cf None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:44.169603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b220b06-d8d8-4e2f-94f8-6b220e4030cf None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:44.169736 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b220b06-d8d8-4e2f-94f8-6b220e4030cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:44.186368 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-2b220b06-d8d8-4e2f-94f8-6b220e4030cf None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:44.187520 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2b220b06-d8d8-4e2f-94f8-6b220e4030cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:44.249472 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 551/1108] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:44.274217 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3c43c-31f6-4139-b681-3a2afd2c511f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:44.369589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3c43c-31f6-4139-b681-3a2afd2c511f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:44.401951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73601e09-adc5-4930-8674-1e4e4875f634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:44.402782 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73601e09-adc5-4930-8674-1e4e4875f634 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:44.403062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73601e09-adc5-4930-8674-1e4e4875f634 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:44.403337 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73601e09-adc5-4930-8674-1e4e4875f634 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:44.404541 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73601e09-adc5-4930-8674-1e4e4875f634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:44.405990 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73601e09-adc5-4930-8674-1e4e4875f634 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:44.407748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 558/1109] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:44.414508 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b220b06-d8d8-4e2f-94f8-6b220e4030cf None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:44.506923 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b220b06-d8d8-4e2f-94f8-6b220e4030cf None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:44.538918 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e64ce-825f-47df-8567-039a395c288f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:44.539570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e64ce-825f-47df-8567-039a395c288f None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:44.539851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e64ce-825f-47df-8567-039a395c288f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:44.540123 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e64ce-825f-47df-8567-039a395c288f None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:44.540862 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e64ce-825f-47df-8567-039a395c288f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:44.542321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e64ce-825f-47df-8567-039a395c288f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:44.661898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 552/1110] 10.222.0.76 () {60 vars in 1132 bytes} [Mon May 16 15:02:44 2022] POST /identity/v3/users => generated 286 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:02:46.924009 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7003cec-e4c4-44e6-8a7b-a437d9d0bce1 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:46.924554 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7003cec-e4c4-44e6-8a7b-a437d9d0bce1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:46.924554 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7003cec-e4c4-44e6-8a7b-a437d9d0bce1 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:46.925919 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 559/1111] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:46.931219 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa291b45-fb44-405a-89c1-4ad51961db91 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:46.931634 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa291b45-fb44-405a-89c1-4ad51961db91 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:46.931781 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa291b45-fb44-405a-89c1-4ad51961db91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:46.948080 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-aa291b45-fb44-405a-89c1-4ad51961db91 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:46.949290 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-aa291b45-fb44-405a-89c1-4ad51961db91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:47.013309 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 553/1112] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:47.037028 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7003cec-e4c4-44e6-8a7b-a437d9d0bce1 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:47.135540 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7003cec-e4c4-44e6-8a7b-a437d9d0bce1 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:47.167619 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fff8a-4104-4ce2-91ac-b0da41521660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:47.168461 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fff8a-4104-4ce2-91ac-b0da41521660 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:47.168740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fff8a-4104-4ce2-91ac-b0da41521660 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:47.169015 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fff8a-4104-4ce2-91ac-b0da41521660 None admin] PATH_INFO: `/v3/roles/00ecc8471dbb4296b40c8b8c0b29aedd` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:47.170502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211fff8a-4104-4ce2-91ac-b0da41521660 None admin] RBAC: Authorizing `identity:get_role(role_id=00ecc8471dbb4296b40c8b8c0b29aedd)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:47.171871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211fff8a-4104-4ce2-91ac-b0da41521660 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:47.173243 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 560/1113] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:02:47 2022] GET /identity/v3/roles/00ecc8471dbb4296b40c8b8c0b29aedd => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:47.179619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa291b45-fb44-405a-89c1-4ad51961db91 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:47.271552 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa291b45-fb44-405a-89c1-4ad51961db91 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:47.303459 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7477c7-cf43-4306-9b7e-c25a2bd24b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:47.304310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7477c7-cf43-4306-9b7e-c25a2bd24b85 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:47.304586 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7477c7-cf43-4306-9b7e-c25a2bd24b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:47.304856 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7477c7-cf43-4306-9b7e-c25a2bd24b85 None admin] PATH_INFO: `/v3/users/f462f2504c944a6b992763d922db772e` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:47.317030 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7477c7-cf43-4306-9b7e-c25a2bd24b85 None admin] RBAC: Authorizing `identity:get_user(user_id=f462f2504c944a6b992763d922db772e)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:47.318485 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7477c7-cf43-4306-9b7e-c25a2bd24b85 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:47.320075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 554/1114] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:02:47 2022] GET /identity/v3/users/f462f2504c944a6b992763d922db772e => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:47.325688 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fff8a-4104-4ce2-91ac-b0da41521660 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:47.419354 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fff8a-4104-4ce2-91ac-b0da41521660 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:47.451130 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfed82d-41e7-40f9-8aea-1f3337582c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:47.451696 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfed82d-41e7-40f9-8aea-1f3337582c46 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:47.451976 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfed82d-41e7-40f9-8aea-1f3337582c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:47.452246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfed82d-41e7-40f9-8aea-1f3337582c46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:47.518390 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfed82d-41e7-40f9-8aea-1f3337582c46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:47.520439 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfed82d-41e7-40f9-8aea-1f3337582c46 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:47.614116 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 561/1115] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:02:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 15:02:47.620236 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7477c7-cf43-4306-9b7e-c25a2bd24b85 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:47.713992 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7477c7-cf43-4306-9b7e-c25a2bd24b85 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:47.746491 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d9e85-2f3b-499c-96d4-77f168b983c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:47.747330 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d9e85-2f3b-499c-96d4-77f168b983c3 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:47.747610 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d9e85-2f3b-499c-96d4-77f168b983c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:47.747882 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d9e85-2f3b-499c-96d4-77f168b983c3 None admin] PATH_INFO: `/v3/projects/b66f4b53bbc24536a888dad02ece0dcc` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:47.749041 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d9e85-2f3b-499c-96d4-77f168b983c3 None admin] RBAC: Authorizing `identity:get_project(project_id=b66f4b53bbc24536a888dad02ece0dcc)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:47.750504 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d9e85-2f3b-499c-96d4-77f168b983c3 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:47.752425 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 555/1116] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:02:47 2022] GET /identity/v3/projects/b66f4b53bbc24536a888dad02ece0dcc => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:47.758598 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfed82d-41e7-40f9-8aea-1f3337582c46 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:47.858024 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfed82d-41e7-40f9-8aea-1f3337582c46 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:47.889679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc1a88-0f13-456c-b47f-a60856621ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:47.890344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc1a88-0f13-456c-b47f-a60856621ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:47.890628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc1a88-0f13-456c-b47f-a60856621ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:47.890902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc1a88-0f13-456c-b47f-a60856621ca8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:47.891723 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc1a88-0f13-456c-b47f-a60856621ca8 None admin] RBAC: Adding query filter params (role.id=00ecc8471dbb4296b40c8b8c0b29aedd, scope.project.id=b66f4b53bbc24536a888dad02ece0dcc, user.id=f462f2504c944a6b992763d922db772e) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:47.892030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc1a88-0f13-456c-b47f-a60856621ca8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:47.893447 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc1a88-0f13-456c-b47f-a60856621ca8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:47.899153 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 562/1117] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:02:47 2022] GET /identity/v3/role_assignments?user.id=f462f2504c944a6b992763d922db772e&scope.project.id=b66f4b53bbc24536a888dad02ece0dcc&role.id=00ecc8471dbb4296b40c8b8c0b29aedd => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:50.051875 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c634705-a384-4ef3-863f-e6b7e1183dbe None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:50.052401 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c634705-a384-4ef3-863f-e6b7e1183dbe None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:50.052401 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c634705-a384-4ef3-863f-e6b7e1183dbe None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:50.053806 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 556/1118] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:50.058847 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f496c4-93ec-4bdd-9e23-6e2333562f08 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:50.059261 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f496c4-93ec-4bdd-9e23-6e2333562f08 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:50.059441 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f496c4-93ec-4bdd-9e23-6e2333562f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:50.075692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f0f496c4-93ec-4bdd-9e23-6e2333562f08 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:50.076900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f0f496c4-93ec-4bdd-9e23-6e2333562f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:50.139397 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 563/1119] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:50.161973 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c634705-a384-4ef3-863f-e6b7e1183dbe None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:50.258068 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c634705-a384-4ef3-863f-e6b7e1183dbe None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:50.289821 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2454b56-ec23-40bd-983a-d71be958e64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:50.290687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2454b56-ec23-40bd-983a-d71be958e64b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:50.290967 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2454b56-ec23-40bd-983a-d71be958e64b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:50.291240 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2454b56-ec23-40bd-983a-d71be958e64b None admin] PATH_INFO: `/v3/roles/00ecc8471dbb4296b40c8b8c0b29aedd` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:50.292685 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2454b56-ec23-40bd-983a-d71be958e64b None admin] RBAC: Authorizing `identity:get_role(role_id=00ecc8471dbb4296b40c8b8c0b29aedd)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:50.294047 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2454b56-ec23-40bd-983a-d71be958e64b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:50.295426 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 557/1120] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:02:50 2022] GET /identity/v3/roles/00ecc8471dbb4296b40c8b8c0b29aedd => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:50.301060 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f496c4-93ec-4bdd-9e23-6e2333562f08 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:50.394350 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f496c4-93ec-4bdd-9e23-6e2333562f08 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:50.426526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec66e91-4d00-43c3-a201-d6937e4ca81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:50.427374 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec66e91-4d00-43c3-a201-d6937e4ca81f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:50.427658 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec66e91-4d00-43c3-a201-d6937e4ca81f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:50.427931 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec66e91-4d00-43c3-a201-d6937e4ca81f None admin] PATH_INFO: `/v3/users/f462f2504c944a6b992763d922db772e` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:50.429108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec66e91-4d00-43c3-a201-d6937e4ca81f None admin] RBAC: Authorizing `identity:get_user(user_id=f462f2504c944a6b992763d922db772e)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:50.430574 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec66e91-4d00-43c3-a201-d6937e4ca81f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:50.432181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 564/1121] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:02:50 2022] GET /identity/v3/users/f462f2504c944a6b992763d922db772e => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:50.437824 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2454b56-ec23-40bd-983a-d71be958e64b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:50.531576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2454b56-ec23-40bd-983a-d71be958e64b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:50.562351 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58033391-6ab3-44d6-9f9d-651cd14d256d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:50.563196 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58033391-6ab3-44d6-9f9d-651cd14d256d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:50.563473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58033391-6ab3-44d6-9f9d-651cd14d256d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:50.563743 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58033391-6ab3-44d6-9f9d-651cd14d256d None admin] PATH_INFO: `/v3/projects/b66f4b53bbc24536a888dad02ece0dcc` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:50.564915 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58033391-6ab3-44d6-9f9d-651cd14d256d None admin] RBAC: Authorizing `identity:get_project(project_id=b66f4b53bbc24536a888dad02ece0dcc)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:50.566887 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58033391-6ab3-44d6-9f9d-651cd14d256d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:50.568550 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 558/1122] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:02:50 2022] GET /identity/v3/projects/b66f4b53bbc24536a888dad02ece0dcc => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:50.574286 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec66e91-4d00-43c3-a201-d6937e4ca81f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:50.668691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec66e91-4d00-43c3-a201-d6937e4ca81f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:50.701145 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbaa26d-6084-4995-bba8-120c0a9e0f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:50.702013 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaa26d-6084-4995-bba8-120c0a9e0f87 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:50.702451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaa26d-6084-4995-bba8-120c0a9e0f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:50.702732 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaa26d-6084-4995-bba8-120c0a9e0f87 None admin] PATH_INFO: `/v3/projects/b66f4b53bbc24536a888dad02ece0dcc/users/f462f2504c944a6b992763d922db772e/roles/00ecc8471dbb4296b40c8b8c0b29aedd` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:50.704899 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbaa26d-6084-4995-bba8-120c0a9e0f87 None admin] RBAC: Authorizing `identity:create_grant(project_id=b66f4b53bbc24536a888dad02ece0dcc, user_id=f462f2504c944a6b992763d922db772e, role_id=00ecc8471dbb4296b40c8b8c0b29aedd)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:50.706360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbaa26d-6084-4995-bba8-120c0a9e0f87 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:50.788428 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 565/1123] 10.222.0.76 () {58 vars in 1439 bytes} [Mon May 16 15:02:50 2022] PUT /identity/v3/projects/b66f4b53bbc24536a888dad02ece0dcc/users/f462f2504c944a6b992763d922db772e/roles/00ecc8471dbb4296b40c8b8c0b29aedd => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:02:52.992501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32b3e3-9583-42ae-81fd-b4d1155291ff None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:52.993028 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32b3e3-9583-42ae-81fd-b4d1155291ff None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:52.993028 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32b3e3-9583-42ae-81fd-b4d1155291ff None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:52.994439 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 559/1124] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:52.999688 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7490513-b628-4a5d-90b1-73e3ca1072be None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:53.000106 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7490513-b628-4a5d-90b1-73e3ca1072be None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:53.000273 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7490513-b628-4a5d-90b1-73e3ca1072be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:53.017230 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c7490513-b628-4a5d-90b1-73e3ca1072be None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:53.018428 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c7490513-b628-4a5d-90b1-73e3ca1072be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:53.080738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 566/1125] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 15:02:53.112795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32b3e3-9583-42ae-81fd-b4d1155291ff None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:53.209189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32b3e3-9583-42ae-81fd-b4d1155291ff None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:53.240947 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fea479-46c8-49a2-908e-f754155d0233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:53.241780 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fea479-46c8-49a2-908e-f754155d0233 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:53.242061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fea479-46c8-49a2-908e-f754155d0233 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:53.242363 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fea479-46c8-49a2-908e-f754155d0233 None admin] PATH_INFO: `/v3/roles/00ecc8471dbb4296b40c8b8c0b29aedd` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:53.243854 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fea479-46c8-49a2-908e-f754155d0233 None admin] RBAC: Authorizing `identity:get_role(role_id=00ecc8471dbb4296b40c8b8c0b29aedd)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:53.245161 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fea479-46c8-49a2-908e-f754155d0233 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:53.246538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 560/1126] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:02:53 2022] GET /identity/v3/roles/00ecc8471dbb4296b40c8b8c0b29aedd => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:53.252474 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7490513-b628-4a5d-90b1-73e3ca1072be None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:53.359234 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7490513-b628-4a5d-90b1-73e3ca1072be None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:53.392114 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fa865-328c-432a-980a-ef4a68d67f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:53.392968 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fa865-328c-432a-980a-ef4a68d67f9c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:53.393245 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fa865-328c-432a-980a-ef4a68d67f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:53.393515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fa865-328c-432a-980a-ef4a68d67f9c None admin] PATH_INFO: `/v3/users/f462f2504c944a6b992763d922db772e` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:53.394718 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fa865-328c-432a-980a-ef4a68d67f9c None admin] RBAC: Authorizing `identity:get_user(user_id=f462f2504c944a6b992763d922db772e)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:53.396161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fa865-328c-432a-980a-ef4a68d67f9c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:53.397785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 567/1127] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:02:53 2022] GET /identity/v3/users/f462f2504c944a6b992763d922db772e => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:53.403514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fea479-46c8-49a2-908e-f754155d0233 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:53.496959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fea479-46c8-49a2-908e-f754155d0233 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:53.528166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658813a2-e219-4a66-a624-f080661a0dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:53.528794 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658813a2-e219-4a66-a624-f080661a0dcd None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:53.529074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658813a2-e219-4a66-a624-f080661a0dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:53.529347 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658813a2-e219-4a66-a624-f080661a0dcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:53.592229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658813a2-e219-4a66-a624-f080661a0dcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:53.593680 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658813a2-e219-4a66-a624-f080661a0dcd None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:53.685495 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 561/1128] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:02:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 15:02:53.691331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fa865-328c-432a-980a-ef4a68d67f9c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:53.785756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fa865-328c-432a-980a-ef4a68d67f9c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:53.817047 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b35d55-4495-41ef-b4d8-f7e59d0a3da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:53.817872 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b35d55-4495-41ef-b4d8-f7e59d0a3da4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:53.818173 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b35d55-4495-41ef-b4d8-f7e59d0a3da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:53.818451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b35d55-4495-41ef-b4d8-f7e59d0a3da4 None admin] PATH_INFO: `/v3/projects/b66f4b53bbc24536a888dad02ece0dcc` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:53.819611 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b35d55-4495-41ef-b4d8-f7e59d0a3da4 None admin] RBAC: Authorizing `identity:get_project(project_id=b66f4b53bbc24536a888dad02ece0dcc)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:53.821035 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b35d55-4495-41ef-b4d8-f7e59d0a3da4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:53.822735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 568/1129] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:02:53 2022] GET /identity/v3/projects/b66f4b53bbc24536a888dad02ece0dcc => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:53.828599 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658813a2-e219-4a66-a624-f080661a0dcd None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:53.926099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658813a2-e219-4a66-a624-f080661a0dcd None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:53.958662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6f101-1322-4e22-9ccb-751ef4162b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:53.959302 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6f101-1322-4e22-9ccb-751ef4162b85 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:53.959580 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6f101-1322-4e22-9ccb-751ef4162b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:53.959850 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6f101-1322-4e22-9ccb-751ef4162b85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:53.960674 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6f101-1322-4e22-9ccb-751ef4162b85 None admin] RBAC: Adding query filter params (role.id=00ecc8471dbb4296b40c8b8c0b29aedd, scope.project.id=b66f4b53bbc24536a888dad02ece0dcc, user.id=f462f2504c944a6b992763d922db772e) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:02:53.960982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6f101-1322-4e22-9ccb-751ef4162b85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:53.962467 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6f101-1322-4e22-9ccb-751ef4162b85 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:53.967995 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 562/1130] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:02:53 2022] GET /identity/v3/role_assignments?user.id=f462f2504c944a6b992763d922db772e&scope.project.id=b66f4b53bbc24536a888dad02ece0dcc&role.id=00ecc8471dbb4296b40c8b8c0b29aedd => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:56.259497 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb8b27-7d89-40b9-a1e7-6e1fc4296c34 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:56.260184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb8b27-7d89-40b9-a1e7-6e1fc4296c34 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:56.260184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb8b27-7d89-40b9-a1e7-6e1fc4296c34 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:56.261429 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 569/1131] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:56.268362 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e475e-8880-4306-9c59-58c53e49be77 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:56.268856 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e475e-8880-4306-9c59-58c53e49be77 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:56.268964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e475e-8880-4306-9c59-58c53e49be77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:56.287539 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-490e475e-8880-4306-9c59-58c53e49be77 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:56.288831 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-490e475e-8880-4306-9c59-58c53e49be77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:56.354269 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 563/1132] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:56.377928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb8b27-7d89-40b9-a1e7-6e1fc4296c34 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:56.474625 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb8b27-7d89-40b9-a1e7-6e1fc4296c34 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:56.507199 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f480ba-34eb-4ee1-8f23-88825725022d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:56.507967 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f480ba-34eb-4ee1-8f23-88825725022d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:56.508247 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f480ba-34eb-4ee1-8f23-88825725022d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:56.508519 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f480ba-34eb-4ee1-8f23-88825725022d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:56.509723 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f480ba-34eb-4ee1-8f23-88825725022d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:56.511125 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f480ba-34eb-4ee1-8f23-88825725022d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:56.512723 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 570/1133] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:56.518719 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e475e-8880-4306-9c59-58c53e49be77 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:56.611321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e475e-8880-4306-9c59-58c53e49be77 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:56.644034 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d16347-4fde-4f91-bdb9-964190760b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:56.644691 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d16347-4fde-4f91-bdb9-964190760b36 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:56.644976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d16347-4fde-4f91-bdb9-964190760b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:56.645255 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d16347-4fde-4f91-bdb9-964190760b36 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:56.645955 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d16347-4fde-4f91-bdb9-964190760b36 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:56.647425 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d16347-4fde-4f91-bdb9-964190760b36 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:56.737585 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 564/1134] 10.222.0.76 () {60 vars in 1141 bytes} [Mon May 16 15:02:56 2022] POST /identity/v3/projects => generated 311 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:02:58.988944 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1eb3c-32f3-429e-8926-8271e307e767 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:58.989468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1eb3c-32f3-429e-8926-8271e307e767 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:58.989468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1eb3c-32f3-429e-8926-8271e307e767 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:58.990912 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 571/1135] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:02:58.996269 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afca674-470e-4088-b17f-a4e0eb0e7452 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:58.996654 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afca674-470e-4088-b17f-a4e0eb0e7452 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:58.996835 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afca674-470e-4088-b17f-a4e0eb0e7452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:59.013424 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-2afca674-470e-4088-b17f-a4e0eb0e7452 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:02:59.014642 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2afca674-470e-4088-b17f-a4e0eb0e7452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:02:59.076985 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 565/1136] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:02:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:02:59.102491 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1eb3c-32f3-429e-8926-8271e307e767 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:59.201573 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1eb3c-32f3-429e-8926-8271e307e767 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:59.233808 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af5b61-97f8-41bb-9057-e471ccce8d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:59.234608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af5b61-97f8-41bb-9057-e471ccce8d19 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:59.234890 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af5b61-97f8-41bb-9057-e471ccce8d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:59.235163 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af5b61-97f8-41bb-9057-e471ccce8d19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:59.236318 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af5b61-97f8-41bb-9057-e471ccce8d19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:59.237785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af5b61-97f8-41bb-9057-e471ccce8d19 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:59.239464 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 572/1137] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:02:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:02:59.245255 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afca674-470e-4088-b17f-a4e0eb0e7452 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:02:59.339139 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afca674-470e-4088-b17f-a4e0eb0e7452 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:02:59.370754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e85644-c4f7-4613-9011-8af67c72d514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:02:59.371408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e85644-c4f7-4613-9011-8af67c72d514 None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:02:59.371692 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e85644-c4f7-4613-9011-8af67c72d514 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:02:59.371971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e85644-c4f7-4613-9011-8af67c72d514 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:02:59.372669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e85644-c4f7-4613-9011-8af67c72d514 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:02:59.374096 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e85644-c4f7-4613-9011-8af67c72d514 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:02:59.546288 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 566/1138] 10.222.0.76 () {60 vars in 1132 bytes} [Mon May 16 15:02:59 2022] POST /identity/v3/users => generated 286 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:03:01.820833 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca022b-166c-43b8-a101-548706cc492c None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:01.821407 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca022b-166c-43b8-a101-548706cc492c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:01.821407 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca022b-166c-43b8-a101-548706cc492c None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:01.822775 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 573/1139] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:03:01.828046 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d192d-8d42-41c5-9258-fc3adab577b8 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:01.828494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d192d-8d42-41c5-9258-fc3adab577b8 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:01.828594 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d192d-8d42-41c5-9258-fc3adab577b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:01.844707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-783d192d-8d42-41c5-9258-fc3adab577b8 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:03:01.845800 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-783d192d-8d42-41c5-9258-fc3adab577b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:03:01.908449 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 567/1140] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:03:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:03:01.932687 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca022b-166c-43b8-a101-548706cc492c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:02.031717 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca022b-166c-43b8-a101-548706cc492c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:02.064428 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb79e8-3d77-4dbb-a376-c8de66826f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:02.065205 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb79e8-3d77-4dbb-a376-c8de66826f07 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:02.066046 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb79e8-3d77-4dbb-a376-c8de66826f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:02.066361 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb79e8-3d77-4dbb-a376-c8de66826f07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:02.076080 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb79e8-3d77-4dbb-a376-c8de66826f07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:03:02.083695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-8adb79e8-3d77-4dbb-a376-c8de66826f07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:03:02.083695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:03:02.083695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:03:02.083695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:03:02.083695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:03:02.083695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:03:02.083695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:03:02.083695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:03:02.083695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:03:02.083695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:03:02.083695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:03:02.083695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:03:02.083695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:03:02.083695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:03:02.083695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:03:02.083695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:03:02.084883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:03:02.084883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:03:02.084883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:03:02.084883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:03:02.084883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:03:02.084883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:03:02.084883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:03:02.084883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:03:02.084883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:03:02.084883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:03:02.084883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:03:02.084883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:03:02.084883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:03:02.084883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:03:02.084883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:03:02.084883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:03:02.085987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:03:02.085987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:03:02.085987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:03:02.085987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:03:02.085987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:03:02.085987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:03:02.085987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:03:02.085987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:03:02.085987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:03:02.085987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:03:02.085987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:03:02.085987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:03:02.085987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 574/1141] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:03:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:03:02.090893 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d192d-8d42-41c5-9258-fc3adab577b8 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:02.182406 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d192d-8d42-41c5-9258-fc3adab577b8 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:02.213522 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5203e-78fd-4d4e-aad7-a8602d07a7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:02.214189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5203e-78fd-4d4e-aad7-a8602d07a7bb None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:02.214472 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5203e-78fd-4d4e-aad7-a8602d07a7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:02.214744 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5203e-78fd-4d4e-aad7-a8602d07a7bb None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:02.215474 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5203e-78fd-4d4e-aad7-a8602d07a7bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:03:02.215775 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5203e-78fd-4d4e-aad7-a8602d07a7bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:02.217135 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5203e-78fd-4d4e-aad7-a8602d07a7bb None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:02.225158 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 568/1142] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:03:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:03:02.230698 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb79e8-3d77-4dbb-a376-c8de66826f07 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:02.325879 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb79e8-3d77-4dbb-a376-c8de66826f07 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:02.358598 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba424637-1a4f-4971-b99c-d93dfbc83a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:02.359447 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba424637-1a4f-4971-b99c-d93dfbc83a33 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:02.359727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba424637-1a4f-4971-b99c-d93dfbc83a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:02.359998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba424637-1a4f-4971-b99c-d93dfbc83a33 None admin] PATH_INFO: `/v3/users/863bd796a77a4b4b93822f1b39ca4807` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:02.372738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba424637-1a4f-4971-b99c-d93dfbc83a33 None admin] RBAC: Authorizing `identity:get_user(user_id=863bd796a77a4b4b93822f1b39ca4807)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:02.374202 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba424637-1a4f-4971-b99c-d93dfbc83a33 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:02.376107 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 575/1143] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:03:02 2022] GET /identity/v3/users/863bd796a77a4b4b93822f1b39ca4807 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:03:02.382410 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5203e-78fd-4d4e-aad7-a8602d07a7bb None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:02.476330 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5203e-78fd-4d4e-aad7-a8602d07a7bb None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:02.508242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bf2e5-853e-4f3f-84f3-e992ed55933e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:02.508878 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bf2e5-853e-4f3f-84f3-e992ed55933e None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:02.509161 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bf2e5-853e-4f3f-84f3-e992ed55933e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:02.509435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bf2e5-853e-4f3f-84f3-e992ed55933e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:02.572684 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bf2e5-853e-4f3f-84f3-e992ed55933e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:02.574211 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bf2e5-853e-4f3f-84f3-e992ed55933e None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:02.666684 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 569/1144] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:03:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 15:03:02.672523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba424637-1a4f-4971-b99c-d93dfbc83a33 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:02.778081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba424637-1a4f-4971-b99c-d93dfbc83a33 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:02.810173 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc9029-6504-45a4-b521-144793d51ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:02.811024 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc9029-6504-45a4-b521-144793d51ecb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:02.811307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc9029-6504-45a4-b521-144793d51ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:02.811583 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc9029-6504-45a4-b521-144793d51ecb None admin] PATH_INFO: `/v3/projects/0c53ff00d5f748b68a736f16f184ec1e` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:02.812750 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc9029-6504-45a4-b521-144793d51ecb None admin] RBAC: Authorizing `identity:get_project(project_id=0c53ff00d5f748b68a736f16f184ec1e)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:02.814206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc9029-6504-45a4-b521-144793d51ecb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:02.816480 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 576/1145] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:03:02 2022] GET /identity/v3/projects/0c53ff00d5f748b68a736f16f184ec1e => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:03:02.822609 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bf2e5-853e-4f3f-84f3-e992ed55933e None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:02.914338 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bf2e5-853e-4f3f-84f3-e992ed55933e None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:02.946854 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af7612-53c2-4455-8f0d-9c85d890093e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:02.947492 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af7612-53c2-4455-8f0d-9c85d890093e None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:02.947775 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af7612-53c2-4455-8f0d-9c85d890093e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:02.948050 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af7612-53c2-4455-8f0d-9c85d890093e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:02.948883 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af7612-53c2-4455-8f0d-9c85d890093e None admin] RBAC: Adding query filter params (role.id=f6c8fc0dc0f24de3907b0960a1201901, scope.project.id=0c53ff00d5f748b68a736f16f184ec1e, user.id=863bd796a77a4b4b93822f1b39ca4807) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:03:02.949195 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af7612-53c2-4455-8f0d-9c85d890093e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:02.950657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af7612-53c2-4455-8f0d-9c85d890093e None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:02.955785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 570/1146] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:03:02 2022] GET /identity/v3/role_assignments?user.id=863bd796a77a4b4b93822f1b39ca4807&scope.project.id=0c53ff00d5f748b68a736f16f184ec1e&role.id=f6c8fc0dc0f24de3907b0960a1201901 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:03:05.110249 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17a6e8-3dcc-48ca-9b70-4b88589e7999 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:05.110799 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17a6e8-3dcc-48ca-9b70-4b88589e7999 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:05.110799 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17a6e8-3dcc-48ca-9b70-4b88589e7999 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:05.112667 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 577/1147] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:03:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:03:05.117779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e45973-8177-433f-be49-b6530750ea04 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:05.118229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e45973-8177-433f-be49-b6530750ea04 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:05.118358 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e45973-8177-433f-be49-b6530750ea04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:05.135446 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-b7e45973-8177-433f-be49-b6530750ea04 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:03:05.136618 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b7e45973-8177-433f-be49-b6530750ea04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:03:05.199349 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 571/1148] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:03:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:03:05.222419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17a6e8-3dcc-48ca-9b70-4b88589e7999 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:05.322017 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17a6e8-3dcc-48ca-9b70-4b88589e7999 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:05.354033 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e86930-2104-4c58-97ef-96c0fe876ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:05.354839 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e86930-2104-4c58-97ef-96c0fe876ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:05.355115 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e86930-2104-4c58-97ef-96c0fe876ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:05.355382 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e86930-2104-4c58-97ef-96c0fe876ba6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:05.365081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e86930-2104-4c58-97ef-96c0fe876ba6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:03:05.372489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-26e86930-2104-4c58-97ef-96c0fe876ba6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:03:05.372489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:03:05.372489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:03:05.372489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:03:05.372489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:03:05.372489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:03:05.372489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:03:05.372489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:03:05.372489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:03:05.372489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:03:05.372489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:03:05.372489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:03:05.372489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:03:05.372489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:03:05.372489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:03:05.372489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:03:05.373596 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:03:05.373596 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:03:05.373596 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:03:05.373596 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:03:05.373596 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:03:05.373596 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:03:05.373596 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:03:05.373596 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:03:05.373596 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:03:05.373596 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:03:05.373596 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:03:05.373596 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:03:05.373596 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:03:05.373596 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:03:05.373596 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:03:05.373596 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:03:05.374627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:03:05.374627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:03:05.374627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:03:05.374627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:03:05.374627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:03:05.374627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:03:05.374627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:03:05.374627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:03:05.374627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:03:05.374627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:03:05.374627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:03:05.374627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:03:05.374627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 578/1149] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:03:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:03:05.380371 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e45973-8177-433f-be49-b6530750ea04 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:05.472094 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e45973-8177-433f-be49-b6530750ea04 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:05.503948 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f02858-e760-46e1-8faa-f33be1def077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:05.504592 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f02858-e760-46e1-8faa-f33be1def077 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:05.504873 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f02858-e760-46e1-8faa-f33be1def077 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:05.505143 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f02858-e760-46e1-8faa-f33be1def077 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:05.505873 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f02858-e760-46e1-8faa-f33be1def077 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:03:05.506200 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f02858-e760-46e1-8faa-f33be1def077 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:05.507555 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f02858-e760-46e1-8faa-f33be1def077 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:05.515104 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 572/1150] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:03:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:03:05.521156 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e86930-2104-4c58-97ef-96c0fe876ba6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:05.615717 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e86930-2104-4c58-97ef-96c0fe876ba6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:05.647731 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99331e6e-825c-4d86-9ccd-938e620eb46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:05.648582 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99331e6e-825c-4d86-9ccd-938e620eb46e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:05.648861 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99331e6e-825c-4d86-9ccd-938e620eb46e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:05.649134 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99331e6e-825c-4d86-9ccd-938e620eb46e None admin] PATH_INFO: `/v3/users/863bd796a77a4b4b93822f1b39ca4807` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:05.650330 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99331e6e-825c-4d86-9ccd-938e620eb46e None admin] RBAC: Authorizing `identity:get_user(user_id=863bd796a77a4b4b93822f1b39ca4807)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:05.651760 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99331e6e-825c-4d86-9ccd-938e620eb46e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:05.653371 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 579/1151] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:03:05 2022] GET /identity/v3/users/863bd796a77a4b4b93822f1b39ca4807 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:03:05.659774 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f02858-e760-46e1-8faa-f33be1def077 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:05.753308 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f02858-e760-46e1-8faa-f33be1def077 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:05.785179 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a777f-325f-4967-ba9a-c947505e27d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:05.786018 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a777f-325f-4967-ba9a-c947505e27d8 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:05.786335 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a777f-325f-4967-ba9a-c947505e27d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:05.786611 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a777f-325f-4967-ba9a-c947505e27d8 None admin] PATH_INFO: `/v3/projects/0c53ff00d5f748b68a736f16f184ec1e` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:05.787778 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a777f-325f-4967-ba9a-c947505e27d8 None admin] RBAC: Authorizing `identity:get_project(project_id=0c53ff00d5f748b68a736f16f184ec1e)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:05.789203 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a777f-325f-4967-ba9a-c947505e27d8 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:05.790911 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 573/1152] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:03:05 2022] GET /identity/v3/projects/0c53ff00d5f748b68a736f16f184ec1e => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:03:05.796517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99331e6e-825c-4d86-9ccd-938e620eb46e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:05.893738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99331e6e-825c-4d86-9ccd-938e620eb46e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:05.925330 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36276b1c-cb1c-4690-a3ef-0130cd2944c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:05.926207 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36276b1c-cb1c-4690-a3ef-0130cd2944c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:05.926489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36276b1c-cb1c-4690-a3ef-0130cd2944c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:05.926757 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36276b1c-cb1c-4690-a3ef-0130cd2944c9 None admin] PATH_INFO: `/v3/projects/0c53ff00d5f748b68a736f16f184ec1e/users/863bd796a77a4b4b93822f1b39ca4807/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:05.928666 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36276b1c-cb1c-4690-a3ef-0130cd2944c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c53ff00d5f748b68a736f16f184ec1e, user_id=863bd796a77a4b4b93822f1b39ca4807, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:05.930080 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36276b1c-cb1c-4690-a3ef-0130cd2944c9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:06.021454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 580/1153] 10.222.0.76 () {58 vars in 1439 bytes} [Mon May 16 15:03:05 2022] PUT /identity/v3/projects/0c53ff00d5f748b68a736f16f184ec1e/users/863bd796a77a4b4b93822f1b39ca4807/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:03:08.184154 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5247c3-ea89-4f04-9ac7-18ddde1f11d7 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:08.184678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5247c3-ea89-4f04-9ac7-18ddde1f11d7 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:08.184678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5247c3-ea89-4f04-9ac7-18ddde1f11d7 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:08.186050 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 574/1154] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:03:08.191951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26515b7-da1c-4d52-8e96-b06379322d32 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:08.192340 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26515b7-da1c-4d52-8e96-b06379322d32 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:08.192497 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26515b7-da1c-4d52-8e96-b06379322d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:08.208695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b26515b7-da1c-4d52-8e96-b06379322d32 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:03:08.209861 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b26515b7-da1c-4d52-8e96-b06379322d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:03:08.272897 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 581/1155] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:03:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:03:08.295916 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5247c3-ea89-4f04-9ac7-18ddde1f11d7 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:08.394088 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5247c3-ea89-4f04-9ac7-18ddde1f11d7 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:08.425170 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea294d-5926-4c41-8888-53c32badc331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:08.431563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea294d-5926-4c41-8888-53c32badc331 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:08.431563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea294d-5926-4c41-8888-53c32badc331 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:08.431563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea294d-5926-4c41-8888-53c32badc331 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:08.436748 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea294d-5926-4c41-8888-53c32badc331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:03:08.444961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-ddea294d-5926-4c41-8888-53c32badc331 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:03:08.444961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:03:08.444961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:03:08.444961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:03:08.444961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:03:08.444961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:03:08.444961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:03:08.444961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:03:08.444961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:03:08.444961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:03:08.444961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:03:08.444961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:03:08.444961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:03:08.444961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:03:08.444961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:03:08.444961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:03:08.446061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:03:08.446061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:03:08.446061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:03:08.446061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:03:08.446061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:03:08.446061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:03:08.446061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:03:08.446061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:03:08.446061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:03:08.446061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:03:08.446061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:03:08.446061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:03:08.446061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:03:08.446061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:03:08.446061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:03:08.446061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:03:08.446972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:03:08.446972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:03:08.446972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:03:08.446972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:03:08.446972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:03:08.446972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:03:08.446972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:03:08.446972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:03:08.446972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:03:08.446972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:03:08.446972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:03:08.446972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:03:08.446972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 575/1156] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:03:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:03:08.452002 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26515b7-da1c-4d52-8e96-b06379322d32 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:08.549176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26515b7-da1c-4d52-8e96-b06379322d32 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:08.582405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f62602-4775-4874-82ec-caafb5c9809a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:08.583080 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f62602-4775-4874-82ec-caafb5c9809a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:08.583364 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f62602-4775-4874-82ec-caafb5c9809a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:08.583640 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f62602-4775-4874-82ec-caafb5c9809a None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:08.584420 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f62602-4775-4874-82ec-caafb5c9809a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:03:08.584728 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f62602-4775-4874-82ec-caafb5c9809a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:08.586107 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f62602-4775-4874-82ec-caafb5c9809a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:08.594134 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 582/1157] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:03:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:03:08.600257 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea294d-5926-4c41-8888-53c32badc331 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:08.693630 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea294d-5926-4c41-8888-53c32badc331 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:08.726083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241654d8-8fe3-4d68-a7d7-be212218966b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:08.726960 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241654d8-8fe3-4d68-a7d7-be212218966b None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:08.727242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241654d8-8fe3-4d68-a7d7-be212218966b None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:08.727514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241654d8-8fe3-4d68-a7d7-be212218966b None admin] PATH_INFO: `/v3/users/863bd796a77a4b4b93822f1b39ca4807` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:08.728689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241654d8-8fe3-4d68-a7d7-be212218966b None admin] RBAC: Authorizing `identity:get_user(user_id=863bd796a77a4b4b93822f1b39ca4807)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:08.730116 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241654d8-8fe3-4d68-a7d7-be212218966b None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:08.731749 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 576/1158] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:03:08 2022] GET /identity/v3/users/863bd796a77a4b4b93822f1b39ca4807 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:03:08.737290 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f62602-4775-4874-82ec-caafb5c9809a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:08.833403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f62602-4775-4874-82ec-caafb5c9809a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:08.865680 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa4d35-38ee-4b92-bbc7-35d84b38f751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:08.866362 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa4d35-38ee-4b92-bbc7-35d84b38f751 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:08.866646 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa4d35-38ee-4b92-bbc7-35d84b38f751 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:08.866923 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa4d35-38ee-4b92-bbc7-35d84b38f751 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:08.930350 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa4d35-38ee-4b92-bbc7-35d84b38f751 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:08.931791 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa4d35-38ee-4b92-bbc7-35d84b38f751 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:09.023939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 583/1159] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:03:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 15:03:09.029699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241654d8-8fe3-4d68-a7d7-be212218966b None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:09.123315 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241654d8-8fe3-4d68-a7d7-be212218966b None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:09.155075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe73a4c-223e-4fc5-8169-81c9fb20ca79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:09.155918 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe73a4c-223e-4fc5-8169-81c9fb20ca79 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:09.156196 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe73a4c-223e-4fc5-8169-81c9fb20ca79 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:09.156470 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe73a4c-223e-4fc5-8169-81c9fb20ca79 None admin] PATH_INFO: `/v3/projects/0c53ff00d5f748b68a736f16f184ec1e` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:09.157623 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe73a4c-223e-4fc5-8169-81c9fb20ca79 None admin] RBAC: Authorizing `identity:get_project(project_id=0c53ff00d5f748b68a736f16f184ec1e)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:09.159606 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe73a4c-223e-4fc5-8169-81c9fb20ca79 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:09.161268 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 577/1160] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:03:09 2022] GET /identity/v3/projects/0c53ff00d5f748b68a736f16f184ec1e => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:03:09.167205 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa4d35-38ee-4b92-bbc7-35d84b38f751 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:09.259966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa4d35-38ee-4b92-bbc7-35d84b38f751 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:09.294031 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c13dd8-76ec-4b30-8550-116f4f4de042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:09.294631 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c13dd8-76ec-4b30-8550-116f4f4de042 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:09.294910 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c13dd8-76ec-4b30-8550-116f4f4de042 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:09.295181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c13dd8-76ec-4b30-8550-116f4f4de042 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:09.296001 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c13dd8-76ec-4b30-8550-116f4f4de042 None admin] RBAC: Adding query filter params (role.id=f6c8fc0dc0f24de3907b0960a1201901, scope.project.id=0c53ff00d5f748b68a736f16f184ec1e, user.id=863bd796a77a4b4b93822f1b39ca4807) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:03:09.296304 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c13dd8-76ec-4b30-8550-116f4f4de042 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:09.297716 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c13dd8-76ec-4b30-8550-116f4f4de042 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:09.303441 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 584/1161] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:03:09 2022] GET /identity/v3/role_assignments?user.id=863bd796a77a4b4b93822f1b39ca4807&scope.project.id=0c53ff00d5f748b68a736f16f184ec1e&role.id=f6c8fc0dc0f24de3907b0960a1201901 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:03:11.524626 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787a904-70d8-4822-b7f3-3368a29972f2 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:11.525180 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787a904-70d8-4822-b7f3-3368a29972f2 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:11.525274 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787a904-70d8-4822-b7f3-3368a29972f2 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:11.526698 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 578/1162] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:03:11.532019 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ebb3d-6b35-4b76-9603-608303ad0355 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:11.532443 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ebb3d-6b35-4b76-9603-608303ad0355 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:11.532544 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ebb3d-6b35-4b76-9603-608303ad0355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:11.548902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-272ebb3d-6b35-4b76-9603-608303ad0355 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:03:11.550071 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-272ebb3d-6b35-4b76-9603-608303ad0355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:03:11.615103 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 585/1163] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:03:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 15:03:11.637732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787a904-70d8-4822-b7f3-3368a29972f2 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:11.733443 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787a904-70d8-4822-b7f3-3368a29972f2 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:11.765395 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff15e23-072d-47be-89d2-0429521e17bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:11.766028 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff15e23-072d-47be-89d2-0429521e17bc None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:11.766339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff15e23-072d-47be-89d2-0429521e17bc None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:11.766616 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff15e23-072d-47be-89d2-0429521e17bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:11.838396 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff15e23-072d-47be-89d2-0429521e17bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:11.839807 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff15e23-072d-47be-89d2-0429521e17bc None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:11.931827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 579/1164] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:03:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 15:03:11.937939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ebb3d-6b35-4b76-9603-608303ad0355 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:12.053849 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ebb3d-6b35-4b76-9603-608303ad0355 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:12.087219 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c589f6b-f964-497d-ae0e-4bcd86413363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:12.088013 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c589f6b-f964-497d-ae0e-4bcd86413363 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:12.088300 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c589f6b-f964-497d-ae0e-4bcd86413363 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:12.088621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c589f6b-f964-497d-ae0e-4bcd86413363 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:12.095339 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c589f6b-f964-497d-ae0e-4bcd86413363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:12.097286 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c589f6b-f964-497d-ae0e-4bcd86413363 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:12.111665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-1c589f6b-f964-497d-ae0e-4bcd86413363 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 16 15:03:12.111665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:03:12.111665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 16 15:03:12.111665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 16 15:03:12.111665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:03:12.111665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:03:12.111665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:03:12.111665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:03:12.111665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 16 15:03:12.111665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:03:12.111665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:03:12.111665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:03:12.111665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:03:12.111665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:03:12.111665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:03:12.111665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:03:12.111665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:03:12.113426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:03:12.113426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:03:12.113426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:03:12.113426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:03:12.113426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:03:12.113426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:03:12.113426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:03:12.113426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:03:12.113426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:03:12.113426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:03:12.113426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:03:12.113426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:03:12.113426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:03:12.113426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:03:12.113426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:03:12.113426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:03:12.114331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:03:12.114331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:03:12.114331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:03:12.114331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:03:12.114331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:03:12.114331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:03:12.114331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:03:12.114331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:03:12.114331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:03:12.114331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:03:12.114331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 16 15:03:12.114331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:03:12.114331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 16 15:03:12.114331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:03:12.114331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 586/1165] 10.222.0.76 () {56 vars in 1117 bytes} [Mon May 16 15:03:11 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:03:12.119553 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff15e23-072d-47be-89d2-0429521e17bc None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:12.213905 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff15e23-072d-47be-89d2-0429521e17bc None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:12.246841 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43eb5d-0c5b-4034-804c-153e36a6e0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:12.247497 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43eb5d-0c5b-4034-804c-153e36a6e0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:12.247773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43eb5d-0c5b-4034-804c-153e36a6e0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:12.248045 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43eb5d-0c5b-4034-804c-153e36a6e0d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:12.248752 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea43eb5d-0c5b-4034-804c-153e36a6e0d4 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:03:12.249106 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea43eb5d-0c5b-4034-804c-153e36a6e0d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:12.250748 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea43eb5d-0c5b-4034-804c-153e36a6e0d4 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:12.257663 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 580/1166] 10.222.0.76 () {56 vars in 1115 bytes} [Mon May 16 15:03:12 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:03:14.450282 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c97cf7-37a8-41ad-89a4-d7e96a11d372 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:14.450845 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c97cf7-37a8-41ad-89a4-d7e96a11d372 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:14.450845 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c97cf7-37a8-41ad-89a4-d7e96a11d372 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:14.452208 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 587/1167] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:03:14.457465 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d4c79-4109-4d4b-8049-f9c3c8ec188a None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:14.457880 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d4c79-4109-4d4b-8049-f9c3c8ec188a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:14.458013 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d4c79-4109-4d4b-8049-f9c3c8ec188a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:14.474783 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-807d4c79-4109-4d4b-8049-f9c3c8ec188a None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:03:14.475946 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-807d4c79-4109-4d4b-8049-f9c3c8ec188a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:03:14.538492 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 581/1168] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:03:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:03:14.561550 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c97cf7-37a8-41ad-89a4-d7e96a11d372 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:14.680231 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c97cf7-37a8-41ad-89a4-d7e96a11d372 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:14.711607 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49904b-db2a-4365-b38c-da0775c46ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:14.712192 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49904b-db2a-4365-b38c-da0775c46ca5 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:14.712467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49904b-db2a-4365-b38c-da0775c46ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:14.712734 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49904b-db2a-4365-b38c-da0775c46ca5 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:14.713470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49904b-db2a-4365-b38c-da0775c46ca5 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:14.714864 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49904b-db2a-4365-b38c-da0775c46ca5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:14.890644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 588/1169] 10.222.0.76 () {60 vars in 1138 bytes} [Mon May 16 15:03:14 2022] POST /identity/v3/domains => generated 267 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:03:17.106154 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e4c09-4dcf-48d5-803d-4bbf53bce592 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:17.106710 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e4c09-4dcf-48d5-803d-4bbf53bce592 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:17.106710 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e4c09-4dcf-48d5-803d-4bbf53bce592 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:17.108068 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 582/1170] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:03:17.113190 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cef347-b63f-47bc-83ea-50ae6bd718f0 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:17.113618 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cef347-b63f-47bc-83ea-50ae6bd718f0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:17.113738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cef347-b63f-47bc-83ea-50ae6bd718f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:17.130102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-22cef347-b63f-47bc-83ea-50ae6bd718f0 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:03:17.131298 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-22cef347-b63f-47bc-83ea-50ae6bd718f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:03:17.192412 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 589/1171] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:03:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:03:17.215272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e4c09-4dcf-48d5-803d-4bbf53bce592 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:17.309760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e4c09-4dcf-48d5-803d-4bbf53bce592 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:17.348837 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24779f90-e988-4406-b755-d06e29b62974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:17.349696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24779f90-e988-4406-b755-d06e29b62974 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:17.349974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24779f90-e988-4406-b755-d06e29b62974 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:17.350279 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24779f90-e988-4406-b755-d06e29b62974 None admin] PATH_INFO: `/v3/domains/e2902f00b72a4c3cb042cdf382f5ee3b` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:17.360213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24779f90-e988-4406-b755-d06e29b62974 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e2902f00b72a4c3cb042cdf382f5ee3b)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:17.361688 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24779f90-e988-4406-b755-d06e29b62974 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:17.363330 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 583/1172] 10.222.0.76 () {56 vars in 1183 bytes} [Mon May 16 15:03:17 2022] GET /identity/v3/domains/e2902f00b72a4c3cb042cdf382f5ee3b => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:03:17.369111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cef347-b63f-47bc-83ea-50ae6bd718f0 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:17.461697 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cef347-b63f-47bc-83ea-50ae6bd718f0 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:17.492681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c439aa-776d-4fdb-8731-3391cc7290e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:17.493320 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c439aa-776d-4fdb-8731-3391cc7290e2 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:17.493611 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c439aa-776d-4fdb-8731-3391cc7290e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:17.493861 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c439aa-776d-4fdb-8731-3391cc7290e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:17.494593 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c439aa-776d-4fdb-8731-3391cc7290e2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:17.496017 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c439aa-776d-4fdb-8731-3391cc7290e2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:17.599309 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 590/1173] 10.222.0.76 () {60 vars in 1141 bytes} [Mon May 16 15:03:17 2022] POST /identity/v3/projects => generated 361 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:03:19.836991 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0ebe1-0a98-411f-8881-9f6134345669 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:19.837578 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0ebe1-0a98-411f-8881-9f6134345669 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:19.837578 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0ebe1-0a98-411f-8881-9f6134345669 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:19.838914 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 584/1174] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:03:19.844055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9afc1-97b8-47fc-aac2-2117f6d5ef83 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:19.844422 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9afc1-97b8-47fc-aac2-2117f6d5ef83 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:19.844615 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9afc1-97b8-47fc-aac2-2117f6d5ef83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:19.861494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-44e9afc1-97b8-47fc-aac2-2117f6d5ef83 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:03:19.863178 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-44e9afc1-97b8-47fc-aac2-2117f6d5ef83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:03:19.925566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 591/1175] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:03:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:03:19.949785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0ebe1-0a98-411f-8881-9f6134345669 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:20.045165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0ebe1-0a98-411f-8881-9f6134345669 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:20.075559 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4034c4-2145-4620-a030-bb1e2d111311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:20.076390 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4034c4-2145-4620-a030-bb1e2d111311 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:20.076662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4034c4-2145-4620-a030-bb1e2d111311 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:20.076928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4034c4-2145-4620-a030-bb1e2d111311 None admin] PATH_INFO: `/v3/domains/e2902f00b72a4c3cb042cdf382f5ee3b` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:20.078075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4034c4-2145-4620-a030-bb1e2d111311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e2902f00b72a4c3cb042cdf382f5ee3b)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:20.079513 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4034c4-2145-4620-a030-bb1e2d111311 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:20.081609 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 585/1176] 10.222.0.76 () {56 vars in 1183 bytes} [Mon May 16 15:03:19 2022] GET /identity/v3/domains/e2902f00b72a4c3cb042cdf382f5ee3b => generated 267 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:03:20.087217 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9afc1-97b8-47fc-aac2-2117f6d5ef83 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:20.180318 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9afc1-97b8-47fc-aac2-2117f6d5ef83 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:20.212215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389f552-4181-48d1-8159-30f56f5a4cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:20.212869 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389f552-4181-48d1-8159-30f56f5a4cad None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:20.213153 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389f552-4181-48d1-8159-30f56f5a4cad None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:20.213430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389f552-4181-48d1-8159-30f56f5a4cad None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:20.214151 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b389f552-4181-48d1-8159-30f56f5a4cad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:20.215580 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b389f552-4181-48d1-8159-30f56f5a4cad None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:20.352765 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 592/1177] 10.222.0.76 () {60 vars in 1132 bytes} [Mon May 16 15:03:20 2022] POST /identity/v3/users => generated 311 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:03:22.569633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcea647-d99b-4ab8-8c48-3eb7b2b22547 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:22.570176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcea647-d99b-4ab8-8c48-3eb7b2b22547 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:22.570176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcea647-d99b-4ab8-8c48-3eb7b2b22547 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:22.571556 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 586/1178] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:03:22.576613 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859c854-04c1-4f60-bce3-63d8a416c180 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:22.576997 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859c854-04c1-4f60-bce3-63d8a416c180 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:22.577163 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859c854-04c1-4f60-bce3-63d8a416c180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:22.593422 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-4859c854-04c1-4f60-bce3-63d8a416c180 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:03:22.594616 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4859c854-04c1-4f60-bce3-63d8a416c180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:03:22.657018 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 593/1179] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:03:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:03:22.680662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcea647-d99b-4ab8-8c48-3eb7b2b22547 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:22.776944 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcea647-d99b-4ab8-8c48-3eb7b2b22547 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:22.809706 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e26230-cda8-4e96-af26-e04b0dd743f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:22.810513 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e26230-cda8-4e96-af26-e04b0dd743f6 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:22.810795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e26230-cda8-4e96-af26-e04b0dd743f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:22.811065 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e26230-cda8-4e96-af26-e04b0dd743f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:22.821645 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e26230-cda8-4e96-af26-e04b0dd743f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:03:22.829063 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-f9e26230-cda8-4e96-af26-e04b0dd743f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:03:22.829063 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:03:22.829063 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:03:22.829063 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:03:22.829063 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:03:22.829063 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:03:22.829063 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:03:22.829063 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:03:22.829063 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:03:22.829063 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:03:22.829063 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:03:22.829063 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:03:22.829063 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:03:22.829063 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:03:22.829063 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:03:22.829063 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:03:22.830652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:03:22.830652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:03:22.830652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:03:22.830652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:03:22.830652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:03:22.830652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:03:22.830652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:03:22.830652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:03:22.830652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:03:22.830652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:03:22.830652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:03:22.830652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:03:22.830652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:03:22.830652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:03:22.830652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:03:22.830652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:03:22.831522 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:03:22.831522 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:03:22.831522 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:03:22.831522 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:03:22.831522 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:03:22.831522 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:03:22.831522 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:03:22.831522 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:03:22.831522 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:03:22.831522 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:03:22.831522 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:03:22.831522 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:03:22.831522 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 587/1180] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:03:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:03:22.836829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859c854-04c1-4f60-bce3-63d8a416c180 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:22.928942 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859c854-04c1-4f60-bce3-63d8a416c180 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:22.961348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cacf80-d591-458b-8c31-ad6005dc95a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:22.961997 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cacf80-d591-458b-8c31-ad6005dc95a1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:22.962321 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cacf80-d591-458b-8c31-ad6005dc95a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:22.962597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cacf80-d591-458b-8c31-ad6005dc95a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:22.963335 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cacf80-d591-458b-8c31-ad6005dc95a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:03:22.963636 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cacf80-d591-458b-8c31-ad6005dc95a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:22.965010 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cacf80-d591-458b-8c31-ad6005dc95a1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:22.972662 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 594/1181] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:03:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:03:22.978220 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e26230-cda8-4e96-af26-e04b0dd743f6 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:23.071200 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e26230-cda8-4e96-af26-e04b0dd743f6 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:23.103212 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134e54b-c52b-486e-a8bc-085e093afe7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:23.103990 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134e54b-c52b-486e-a8bc-085e093afe7d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:23.104269 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134e54b-c52b-486e-a8bc-085e093afe7d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:23.104545 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134e54b-c52b-486e-a8bc-085e093afe7d None admin] PATH_INFO: `/v3/users/d072e2f88f01453591626e06bc04928b` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:23.117316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134e54b-c52b-486e-a8bc-085e093afe7d None admin] RBAC: Authorizing `identity:get_user(user_id=d072e2f88f01453591626e06bc04928b)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:23.118783 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134e54b-c52b-486e-a8bc-085e093afe7d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:23.120383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 588/1182] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:03:22 2022] GET /identity/v3/users/d072e2f88f01453591626e06bc04928b => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:03:23.126270 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cacf80-d591-458b-8c31-ad6005dc95a1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:23.219816 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cacf80-d591-458b-8c31-ad6005dc95a1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:23.251248 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a3d4f-efb9-4af2-9899-ec0b86f52575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:23.252405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a3d4f-efb9-4af2-9899-ec0b86f52575 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:23.252686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a3d4f-efb9-4af2-9899-ec0b86f52575 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:23.252963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a3d4f-efb9-4af2-9899-ec0b86f52575 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:23.317051 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a3d4f-efb9-4af2-9899-ec0b86f52575 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:23.318530 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a3d4f-efb9-4af2-9899-ec0b86f52575 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:23.410737 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 595/1183] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:03:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 15:03:23.416521 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134e54b-c52b-486e-a8bc-085e093afe7d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:23.512835 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134e54b-c52b-486e-a8bc-085e093afe7d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:23.544723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85445ba-86e0-41f2-a8f9-90cce52139bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:23.545567 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85445ba-86e0-41f2-a8f9-90cce52139bd None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:23.545851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85445ba-86e0-41f2-a8f9-90cce52139bd None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:23.546153 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85445ba-86e0-41f2-a8f9-90cce52139bd None admin] PATH_INFO: `/v3/projects/c31c157dc6a843f8abe23c267fcca1bb` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:23.547322 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85445ba-86e0-41f2-a8f9-90cce52139bd None admin] RBAC: Authorizing `identity:get_project(project_id=c31c157dc6a843f8abe23c267fcca1bb)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:23.549392 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85445ba-86e0-41f2-a8f9-90cce52139bd None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:23.551094 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 589/1184] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:03:23 2022] GET /identity/v3/projects/c31c157dc6a843f8abe23c267fcca1bb => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:03:23.557052 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a3d4f-efb9-4af2-9899-ec0b86f52575 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:23.651216 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a3d4f-efb9-4af2-9899-ec0b86f52575 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:23.683805 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa33d2-4762-41af-abdb-db009cbc8923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:23.684425 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa33d2-4762-41af-abdb-db009cbc8923 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:23.684708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa33d2-4762-41af-abdb-db009cbc8923 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:23.684984 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa33d2-4762-41af-abdb-db009cbc8923 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:23.685810 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa33d2-4762-41af-abdb-db009cbc8923 None admin] RBAC: Adding query filter params (role.id=f6c8fc0dc0f24de3907b0960a1201901, scope.project.id=c31c157dc6a843f8abe23c267fcca1bb, user.id=d072e2f88f01453591626e06bc04928b) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:03:23.686146 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa33d2-4762-41af-abdb-db009cbc8923 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:23.687564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa33d2-4762-41af-abdb-db009cbc8923 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:23.692803 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 596/1185] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:03:23 2022] GET /identity/v3/role_assignments?user.id=d072e2f88f01453591626e06bc04928b&scope.project.id=c31c157dc6a843f8abe23c267fcca1bb&role.id=f6c8fc0dc0f24de3907b0960a1201901 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:03:25.883906 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe07ca5-2924-4cb0-8098-9e8cbe9b5700 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:25.884412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe07ca5-2924-4cb0-8098-9e8cbe9b5700 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:25.884528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe07ca5-2924-4cb0-8098-9e8cbe9b5700 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:25.885815 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 590/1186] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:03:25.890881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ad820-1d1a-4315-89a9-e46d0b450e6c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:25.891303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ad820-1d1a-4315-89a9-e46d0b450e6c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:25.891433 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ad820-1d1a-4315-89a9-e46d0b450e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:25.907546 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-d74ad820-1d1a-4315-89a9-e46d0b450e6c None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:03:25.908728 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d74ad820-1d1a-4315-89a9-e46d0b450e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:03:25.970858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 597/1187] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:03:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:03:25.992901 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe07ca5-2924-4cb0-8098-9e8cbe9b5700 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:26.086699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe07ca5-2924-4cb0-8098-9e8cbe9b5700 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:26.118265 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75055b76-beae-49da-add9-8c9b3327686d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:26.119037 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75055b76-beae-49da-add9-8c9b3327686d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:26.119318 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75055b76-beae-49da-add9-8c9b3327686d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:26.119591 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75055b76-beae-49da-add9-8c9b3327686d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:26.129863 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75055b76-beae-49da-add9-8c9b3327686d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:03:26.137435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-75055b76-beae-49da-add9-8c9b3327686d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:03:26.137435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:03:26.137435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:03:26.137435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:03:26.137435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:03:26.137435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:03:26.137435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:03:26.137435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:03:26.137435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:03:26.137435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:03:26.137435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:03:26.137435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:03:26.137435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:03:26.137435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:03:26.137435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:03:26.137435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:03:26.138563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:03:26.138563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:03:26.138563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:03:26.138563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:03:26.138563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:03:26.138563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:03:26.138563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:03:26.138563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:03:26.138563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:03:26.138563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:03:26.138563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:03:26.138563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:03:26.138563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:03:26.138563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:03:26.138563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:03:26.138563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:03:26.139449 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:03:26.139449 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:03:26.139449 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:03:26.139449 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:03:26.139449 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:03:26.139449 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:03:26.139449 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:03:26.139449 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:03:26.139449 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:03:26.139449 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:03:26.139449 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:03:26.139449 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:03:26.139449 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 591/1188] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:03:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:03:26.144826 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ad820-1d1a-4315-89a9-e46d0b450e6c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:26.236742 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ad820-1d1a-4315-89a9-e46d0b450e6c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:26.269206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd009ff-2c3b-4504-87fb-171d83c2bc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:26.269849 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd009ff-2c3b-4504-87fb-171d83c2bc56 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:26.270150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd009ff-2c3b-4504-87fb-171d83c2bc56 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:26.270426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd009ff-2c3b-4504-87fb-171d83c2bc56 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:26.271160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd009ff-2c3b-4504-87fb-171d83c2bc56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:03:26.271463 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd009ff-2c3b-4504-87fb-171d83c2bc56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:26.272824 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd009ff-2c3b-4504-87fb-171d83c2bc56 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:26.280548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 598/1189] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:03:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:03:26.286152 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75055b76-beae-49da-add9-8c9b3327686d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:26.384565 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75055b76-beae-49da-add9-8c9b3327686d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:26.416411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f453b2-e096-42b6-9f3c-b577539ea409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:26.417204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f453b2-e096-42b6-9f3c-b577539ea409 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:26.417485 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f453b2-e096-42b6-9f3c-b577539ea409 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:26.417758 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f453b2-e096-42b6-9f3c-b577539ea409 None admin] PATH_INFO: `/v3/users/d072e2f88f01453591626e06bc04928b` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:26.418950 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f453b2-e096-42b6-9f3c-b577539ea409 None admin] RBAC: Authorizing `identity:get_user(user_id=d072e2f88f01453591626e06bc04928b)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:26.420376 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f453b2-e096-42b6-9f3c-b577539ea409 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:26.421980 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 592/1190] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:03:26 2022] GET /identity/v3/users/d072e2f88f01453591626e06bc04928b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:03:26.427706 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd009ff-2c3b-4504-87fb-171d83c2bc56 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:26.523641 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd009ff-2c3b-4504-87fb-171d83c2bc56 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:26.554645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f101da-6048-41a9-b58d-1730ab2b925c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:26.555486 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f101da-6048-41a9-b58d-1730ab2b925c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:26.555769 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f101da-6048-41a9-b58d-1730ab2b925c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:26.556047 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f101da-6048-41a9-b58d-1730ab2b925c None admin] PATH_INFO: `/v3/projects/c31c157dc6a843f8abe23c267fcca1bb` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:26.557209 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f101da-6048-41a9-b58d-1730ab2b925c None admin] RBAC: Authorizing `identity:get_project(project_id=c31c157dc6a843f8abe23c267fcca1bb)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:26.558813 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f101da-6048-41a9-b58d-1730ab2b925c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:26.560498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 599/1191] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:03:26 2022] GET /identity/v3/projects/c31c157dc6a843f8abe23c267fcca1bb => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:03:26.566772 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f453b2-e096-42b6-9f3c-b577539ea409 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:26.660548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f453b2-e096-42b6-9f3c-b577539ea409 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:26.691348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82732e1-4c99-4931-a381-358feec1d63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:26.692161 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82732e1-4c99-4931-a381-358feec1d63a None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:26.692441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82732e1-4c99-4931-a381-358feec1d63a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:26.692710 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82732e1-4c99-4931-a381-358feec1d63a None admin] PATH_INFO: `/v3/projects/c31c157dc6a843f8abe23c267fcca1bb/users/d072e2f88f01453591626e06bc04928b/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:26.694655 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82732e1-4c99-4931-a381-358feec1d63a None admin] RBAC: Authorizing `identity:create_grant(project_id=c31c157dc6a843f8abe23c267fcca1bb, user_id=d072e2f88f01453591626e06bc04928b, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:26.696088 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82732e1-4c99-4931-a381-358feec1d63a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:26.803130 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 593/1192] 10.222.0.76 () {58 vars in 1439 bytes} [Mon May 16 15:03:26 2022] PUT /identity/v3/projects/c31c157dc6a843f8abe23c267fcca1bb/users/d072e2f88f01453591626e06bc04928b/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:03:28.979753 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dd06b-efb8-4ba7-9561-d14497b45e3b None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:28.980274 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dd06b-efb8-4ba7-9561-d14497b45e3b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:28.980364 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dd06b-efb8-4ba7-9561-d14497b45e3b None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:28.981677 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 600/1193] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:03:28.987591 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f89d3d-cd46-4a48-9bd3-46aafe82ac7c None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:28.987989 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f89d3d-cd46-4a48-9bd3-46aafe82ac7c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:28.988143 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f89d3d-cd46-4a48-9bd3-46aafe82ac7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:29.005368 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-17f89d3d-cd46-4a48-9bd3-46aafe82ac7c None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:03:29.006585 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-17f89d3d-cd46-4a48-9bd3-46aafe82ac7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:03:29.069469 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 594/1194] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:03:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:03:29.092241 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dd06b-efb8-4ba7-9561-d14497b45e3b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:29.188289 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dd06b-efb8-4ba7-9561-d14497b45e3b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:29.221373 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f145ac-58de-44c1-9372-35aaaafe50e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:29.222169 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f145ac-58de-44c1-9372-35aaaafe50e8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:29.222452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f145ac-58de-44c1-9372-35aaaafe50e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:29.222723 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f145ac-58de-44c1-9372-35aaaafe50e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:29.232417 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f145ac-58de-44c1-9372-35aaaafe50e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:03:29.240451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-53f145ac-58de-44c1-9372-35aaaafe50e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:03:29.240451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:03:29.240451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:03:29.240451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:03:29.240451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:03:29.240451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:03:29.240451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:03:29.240451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:03:29.240451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:03:29.240451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:03:29.240451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:03:29.240451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:03:29.240451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:03:29.240451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:03:29.240451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:03:29.240451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:03:29.241526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:03:29.241526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:03:29.241526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:03:29.241526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:03:29.241526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:03:29.241526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:03:29.241526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:03:29.241526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:03:29.241526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:03:29.241526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:03:29.241526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:03:29.241526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:03:29.241526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:03:29.241526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:03:29.241526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:03:29.241526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:03:29.242446 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:03:29.242446 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:03:29.242446 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:03:29.242446 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:03:29.242446 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:03:29.242446 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:03:29.242446 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:03:29.242446 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:03:29.242446 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:03:29.242446 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:03:29.242446 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:03:29.242446 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:03:29.242446 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 601/1195] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:03:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:03:29.247918 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f89d3d-cd46-4a48-9bd3-46aafe82ac7c None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:29.340451 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f89d3d-cd46-4a48-9bd3-46aafe82ac7c None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:29.372680 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010838e-be6d-4451-be67-5b51b681486a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:29.373334 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010838e-be6d-4451-be67-5b51b681486a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:29.373616 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010838e-be6d-4451-be67-5b51b681486a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:29.373891 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010838e-be6d-4451-be67-5b51b681486a None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:29.374922 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010838e-be6d-4451-be67-5b51b681486a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:03:29.375228 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010838e-be6d-4451-be67-5b51b681486a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:29.376626 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010838e-be6d-4451-be67-5b51b681486a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:29.384570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 595/1196] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:03:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:03:29.390286 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f145ac-58de-44c1-9372-35aaaafe50e8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:29.484700 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f145ac-58de-44c1-9372-35aaaafe50e8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:29.518157 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abb90e-be03-4aa1-bf5f-90eb018311e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:29.519040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abb90e-be03-4aa1-bf5f-90eb018311e0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:29.519316 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abb90e-be03-4aa1-bf5f-90eb018311e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:29.519703 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abb90e-be03-4aa1-bf5f-90eb018311e0 None admin] PATH_INFO: `/v3/users/d072e2f88f01453591626e06bc04928b` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:29.520877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abb90e-be03-4aa1-bf5f-90eb018311e0 None admin] RBAC: Authorizing `identity:get_user(user_id=d072e2f88f01453591626e06bc04928b)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:29.522356 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abb90e-be03-4aa1-bf5f-90eb018311e0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:29.523992 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 602/1197] 10.222.0.76 () {56 vars in 1177 bytes} [Mon May 16 15:03:29 2022] GET /identity/v3/users/d072e2f88f01453591626e06bc04928b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:03:29.529798 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010838e-be6d-4451-be67-5b51b681486a None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:29.626230 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010838e-be6d-4451-be67-5b51b681486a None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:29.658182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86209b68-d900-4378-bb43-3c86ea5b82d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:29.658828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86209b68-d900-4378-bb43-3c86ea5b82d5 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:29.659108 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86209b68-d900-4378-bb43-3c86ea5b82d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:29.659385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86209b68-d900-4378-bb43-3c86ea5b82d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:29.722234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86209b68-d900-4378-bb43-3c86ea5b82d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:29.723677 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86209b68-d900-4378-bb43-3c86ea5b82d5 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:29.814888 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 596/1198] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:03:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 15:03:29.820839 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abb90e-be03-4aa1-bf5f-90eb018311e0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:29.932368 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abb90e-be03-4aa1-bf5f-90eb018311e0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:29.964038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7475b-bb80-4109-9b43-815a9aa13abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:29.964880 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7475b-bb80-4109-9b43-815a9aa13abb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:29.965157 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7475b-bb80-4109-9b43-815a9aa13abb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:29.965427 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7475b-bb80-4109-9b43-815a9aa13abb None admin] PATH_INFO: `/v3/projects/c31c157dc6a843f8abe23c267fcca1bb` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:29.966645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7475b-bb80-4109-9b43-815a9aa13abb None admin] RBAC: Authorizing `identity:get_project(project_id=c31c157dc6a843f8abe23c267fcca1bb)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:29.968060 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7475b-bb80-4109-9b43-815a9aa13abb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:29.969775 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 603/1199] 10.222.0.76 () {56 vars in 1186 bytes} [Mon May 16 15:03:29 2022] GET /identity/v3/projects/c31c157dc6a843f8abe23c267fcca1bb => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:03:29.976516 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86209b68-d900-4378-bb43-3c86ea5b82d5 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:03:30.069680 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86209b68-d900-4378-bb43-3c86ea5b82d5 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:03:30.101264 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e12a62-6d0c-4cd0-ba7f-d158c7dda07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:03:30.101984 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e12a62-6d0c-4cd0-ba7f-d158c7dda07a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:03:30.102308 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e12a62-6d0c-4cd0-ba7f-d158c7dda07a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:03:30.102585 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e12a62-6d0c-4cd0-ba7f-d158c7dda07a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:03:30.103411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e12a62-6d0c-4cd0-ba7f-d158c7dda07a None admin] RBAC: Adding query filter params (role.id=f6c8fc0dc0f24de3907b0960a1201901, scope.project.id=c31c157dc6a843f8abe23c267fcca1bb, user.id=d072e2f88f01453591626e06bc04928b) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:03:30.103718 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e12a62-6d0c-4cd0-ba7f-d158c7dda07a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:03:30.105134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e12a62-6d0c-4cd0-ba7f-d158c7dda07a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:03:30.110748 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 597/1200] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:03:29 2022] GET /identity/v3/role_assignments?user.id=d072e2f88f01453591626e06bc04928b&scope.project.id=c31c157dc6a843f8abe23c267fcca1bb&role.id=f6c8fc0dc0f24de3907b0960a1201901 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:04:53.915194 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b13a8-683e-4af0-85c3-0e8c21a87853 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:04:53.915777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b13a8-683e-4af0-85c3-0e8c21a87853 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:04:53.915777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b13a8-683e-4af0-85c3-0e8c21a87853 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:04:53.917139 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 604/1201] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:04:53.922499 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f88857-51ad-491e-80b2-f6ec47dc6bba None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:04:53.922904 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f88857-51ad-491e-80b2-f6ec47dc6bba None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:04:53.923046 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f88857-51ad-491e-80b2-f6ec47dc6bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:04:53.939833 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d4f88857-51ad-491e-80b2-f6ec47dc6bba None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:04:53.940988 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d4f88857-51ad-491e-80b2-f6ec47dc6bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:04:54.004920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 598/1202] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:04:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:04:54.028993 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b13a8-683e-4af0-85c3-0e8c21a87853 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:04:54.127231 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b13a8-683e-4af0-85c3-0e8c21a87853 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:04:54.159206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c994ec-27e8-4563-9e75-5f3b51cd1708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:04:54.160230 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c994ec-27e8-4563-9e75-5f3b51cd1708 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:04:54.160230 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c994ec-27e8-4563-9e75-5f3b51cd1708 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:04:54.160503 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c994ec-27e8-4563-9e75-5f3b51cd1708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:04:54.171065 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c994ec-27e8-4563-9e75-5f3b51cd1708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:04:54.172449 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c994ec-27e8-4563-9e75-5f3b51cd1708 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:04:54.190452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-b3c994ec-27e8-4563-9e75-5f3b51cd1708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:04:54.190452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:04:54.190452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:04:54.190452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:04:54.190452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:04:54.190452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:04:54.190452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:04:54.190452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:04:54.190452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:04:54.190452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:04:54.190452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:04:54.190452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:04:54.190452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:04:54.190452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:04:54.190452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:04:54.191597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:04:54.191597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:04:54.191597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:04:54.191597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:04:54.191597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:04:54.191597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:04:54.191597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:04:54.191597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:04:54.191597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:04:54.191597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:04:54.191597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:04:54.191597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:04:54.191597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:04:54.191597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:04:54.191597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:04:54.191597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:04:54.191597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:04:54.192585 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:04:54.192585 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:04:54.192585 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:04:54.192585 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:04:54.192585 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 605/1203] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:04:54.197774 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f88857-51ad-491e-80b2-f6ec47dc6bba None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:04:54.293752 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f88857-51ad-491e-80b2-f6ec47dc6bba None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:04:54.327804 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3480fca-4982-4a7b-93dd-a686504bb6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:04:54.328459 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3480fca-4982-4a7b-93dd-a686504bb6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:04:54.328740 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3480fca-4982-4a7b-93dd-a686504bb6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:04:54.329012 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3480fca-4982-4a7b-93dd-a686504bb6d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:04:54.329727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3480fca-4982-4a7b-93dd-a686504bb6d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:04:54.330039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3480fca-4982-4a7b-93dd-a686504bb6d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:04:54.331430 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3480fca-4982-4a7b-93dd-a686504bb6d6 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:04:54.343023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 599/1204] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:04:54.348633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c994ec-27e8-4563-9e75-5f3b51cd1708 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:04:54.443631 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c994ec-27e8-4563-9e75-5f3b51cd1708 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:04:54.475184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fe69b-ad32-4a76-8b76-eb7c645b95d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:04:54.475829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fe69b-ad32-4a76-8b76-eb7c645b95d9 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:04:54.476106 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fe69b-ad32-4a76-8b76-eb7c645b95d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:04:54.476377 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fe69b-ad32-4a76-8b76-eb7c645b95d9 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:04:54.477060 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fe69b-ad32-4a76-8b76-eb7c645b95d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:04:54.478513 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fe69b-ad32-4a76-8b76-eb7c645b95d9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:04:54.706739 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 606/1205] 10.222.0.76 () {60 vars in 1132 bytes} [Mon May 16 15:04:54 2022] POST /identity/v3/users => generated 251 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:04:56.969208 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750aff3-05b1-4b11-810d-fc3740a3da4c None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:04:56.969757 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750aff3-05b1-4b11-810d-fc3740a3da4c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:04:56.969757 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750aff3-05b1-4b11-810d-fc3740a3da4c None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:04:56.971159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 600/1206] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:04:56.976412 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f362df-1433-4eff-8180-19230f4deb39 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:04:56.976847 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f362df-1433-4eff-8180-19230f4deb39 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:04:56.976949 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f362df-1433-4eff-8180-19230f4deb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:04:56.993237 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-92f362df-1433-4eff-8180-19230f4deb39 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:04:56.994459 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-92f362df-1433-4eff-8180-19230f4deb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:04:57.059053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 607/1207] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:04:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:04:57.082682 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750aff3-05b1-4b11-810d-fc3740a3da4c None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:04:57.179761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750aff3-05b1-4b11-810d-fc3740a3da4c None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:04:57.211829 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313be74c-54da-4e91-900f-78b4d7867fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:04:57.212612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313be74c-54da-4e91-900f-78b4d7867fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:04:57.212896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313be74c-54da-4e91-900f-78b4d7867fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:04:57.213171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313be74c-54da-4e91-900f-78b4d7867fb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:04:57.224304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313be74c-54da-4e91-900f-78b4d7867fb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:04:57.231922 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-313be74c-54da-4e91-900f-78b4d7867fb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 15:04:57.231922 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:04:57.231922 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:04:57.231922 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:04:57.231922 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:04:57.231922 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:04:57.231922 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:04:57.231922 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:04:57.231922 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:04:57.231922 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:04:57.231922 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:04:57.231922 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:04:57.231922 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:04:57.231922 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:04:57.231922 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:04:57.231922 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:04:57.233323 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:04:57.233323 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:04:57.233323 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:04:57.233323 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:04:57.233323 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:04:57.233323 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:04:57.233323 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:04:57.233323 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:04:57.233323 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:04:57.233323 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:04:57.233323 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:04:57.233323 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:04:57.233323 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:04:57.233323 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:04:57.233323 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:04:57.233323 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:04:57.234237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:04:57.234237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:04:57.234237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:04:57.234237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:04:57.234237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:04:57.234237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:04:57.234237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:04:57.234237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:04:57.234237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:04:57.234237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:04:57.234237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 15:04:57.234237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:04:57.234237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 601/1208] 10.222.0.76 () {56 vars in 1102 bytes} [Mon May 16 15:04:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:04:57.239239 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f362df-1433-4eff-8180-19230f4deb39 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:04:57.334109 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f362df-1433-4eff-8180-19230f4deb39 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:04:57.366788 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc90a6-6286-4726-809a-62204699afd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:04:57.367447 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc90a6-6286-4726-809a-62204699afd2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:04:57.367728 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc90a6-6286-4726-809a-62204699afd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:04:57.368003 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc90a6-6286-4726-809a-62204699afd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:04:57.368749 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc90a6-6286-4726-809a-62204699afd2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:04:57.369055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc90a6-6286-4726-809a-62204699afd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:04:57.370451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc90a6-6286-4726-809a-62204699afd2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:04:57.379521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 608/1209] 10.222.0.76 () {56 vars in 1103 bytes} [Mon May 16 15:04:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:04:57.385192 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313be74c-54da-4e91-900f-78b4d7867fb0 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:04:57.480864 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313be74c-54da-4e91-900f-78b4d7867fb0 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:04:57.512654 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77780fb4-1078-4340-b4dc-aa5aeb9c338d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:04:57.513976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77780fb4-1078-4340-b4dc-aa5aeb9c338d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:04:57.514283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77780fb4-1078-4340-b4dc-aa5aeb9c338d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:04:57.514555 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77780fb4-1078-4340-b4dc-aa5aeb9c338d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:04:57.523963 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77780fb4-1078-4340-b4dc-aa5aeb9c338d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:04:57.525386 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77780fb4-1078-4340-b4dc-aa5aeb9c338d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:04:57.541912 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-77780fb4-1078-4340-b4dc-aa5aeb9c338d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:04:57.541912 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:04:57.541912 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:04:57.541912 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:04:57.541912 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:04:57.541912 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:04:57.541912 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:04:57.541912 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:04:57.541912 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:04:57.541912 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:04:57.541912 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:04:57.541912 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:04:57.541912 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:04:57.541912 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:04:57.541912 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:04:57.543253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:04:57.543253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:04:57.543253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:04:57.543253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:04:57.543253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:04:57.543253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:04:57.543253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:04:57.543253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:04:57.543253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:04:57.543253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:04:57.543253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:04:57.543253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:04:57.543253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:04:57.543253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:04:57.543253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:04:57.543253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:04:57.543253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:04:57.544592 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:04:57.544592 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:04:57.544592 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:04:57.544592 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:04:57.544592 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 602/1210] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:04:57.549046 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc90a6-6286-4726-809a-62204699afd2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:04:57.644137 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc90a6-6286-4726-809a-62204699afd2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:04:57.675177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6841e-1da4-43f4-a80b-117651f6b283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:04:57.675820 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6841e-1da4-43f4-a80b-117651f6b283 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:04:57.676098 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6841e-1da4-43f4-a80b-117651f6b283 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:04:57.676367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6841e-1da4-43f4-a80b-117651f6b283 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:04:57.677072 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6841e-1da4-43f4-a80b-117651f6b283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:04:57.677374 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6841e-1da4-43f4-a80b-117651f6b283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:04:57.678761 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6841e-1da4-43f4-a80b-117651f6b283 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:04:57.690592 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 609/1211] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:04:57.696213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77780fb4-1078-4340-b4dc-aa5aeb9c338d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:04:57.798758 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77780fb4-1078-4340-b4dc-aa5aeb9c338d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:04:57.829967 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079ce76-a049-4cef-b27a-a78aa0c16582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:04:57.830780 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079ce76-a049-4cef-b27a-a78aa0c16582 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:04:57.831060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079ce76-a049-4cef-b27a-a78aa0c16582 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:04:57.831329 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079ce76-a049-4cef-b27a-a78aa0c16582 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:04:57.838422 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079ce76-a049-4cef-b27a-a78aa0c16582 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:04:57.839848 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079ce76-a049-4cef-b27a-a78aa0c16582 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:04:57.853514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-a079ce76-a049-4cef-b27a-a78aa0c16582 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 15:04:57.853514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:04:57.853514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:04:57.853514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:04:57.853514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:04:57.853514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:04:57.853514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:04:57.853514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:04:57.853514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:04:57.853514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:04:57.853514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:04:57.853514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:04:57.853514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:04:57.853514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:04:57.853514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:04:57.853514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:04:57.854725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:04:57.854725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:04:57.854725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:04:57.854725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:04:57.854725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:04:57.854725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:04:57.854725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:04:57.854725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:04:57.854725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:04:57.854725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:04:57.854725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:04:57.854725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:04:57.854725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:04:57.854725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:04:57.854725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:04:57.854725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:04:57.854725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:04:57.854725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:04:57.855931 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:04:57.855931 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:04:57.855931 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:04:57.855931 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:04:57.855931 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:04:57.855931 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:04:57.855931 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:04:57.855931 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:04:57.855931 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 15:04:57.855931 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:04:57.855931 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 603/1212] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:04:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:04:57.861065 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6841e-1da4-43f4-a80b-117651f6b283 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:04:57.955013 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6841e-1da4-43f4-a80b-117651f6b283 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:04:57.987181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1259c10-e508-47c4-a7a3-6adb59df7004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:04:57.988012 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1259c10-e508-47c4-a7a3-6adb59df7004 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:04:57.988489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1259c10-e508-47c4-a7a3-6adb59df7004 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:04:57.988965 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1259c10-e508-47c4-a7a3-6adb59df7004 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:04:57.990071 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1259c10-e508-47c4-a7a3-6adb59df7004 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:04:57.997860 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1259c10-e508-47c4-a7a3-6adb59df7004 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:04:57.997860 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1259c10-e508-47c4-a7a3-6adb59df7004 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:04:58.010389 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 610/1213] 10.222.0.76 () {56 vars in 1143 bytes} [Mon May 16 15:04:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:04:58.016090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079ce76-a049-4cef-b27a-a78aa0c16582 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:04:58.111167 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079ce76-a049-4cef-b27a-a78aa0c16582 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:04:58.143000 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172568e8-898a-488d-80db-a0facc0d0013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:04:58.143643 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172568e8-898a-488d-80db-a0facc0d0013 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:04:58.143927 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172568e8-898a-488d-80db-a0facc0d0013 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:04:58.144203 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172568e8-898a-488d-80db-a0facc0d0013 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:04:58.209402 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172568e8-898a-488d-80db-a0facc0d0013 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:04:58.210881 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172568e8-898a-488d-80db-a0facc0d0013 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:04:58.303465 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 604/1214] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:04:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 15:04:58.309515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1259c10-e508-47c4-a7a3-6adb59df7004 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:04:58.403083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1259c10-e508-47c4-a7a3-6adb59df7004 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:04:58.439333 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c30e1-b9e9-412a-911a-4a3793b0897c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:04:58.440117 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c30e1-b9e9-412a-911a-4a3793b0897c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:04:58.440403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c30e1-b9e9-412a-911a-4a3793b0897c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:04:58.440678 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c30e1-b9e9-412a-911a-4a3793b0897c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:04:58.450511 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c30e1-b9e9-412a-911a-4a3793b0897c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:04:58.452500 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c30e1-b9e9-412a-911a-4a3793b0897c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:04:58.469721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-fa2c30e1-b9e9-412a-911a-4a3793b0897c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:04:58.469721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:04:58.469721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:04:58.469721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:04:58.469721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:04:58.469721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:04:58.469721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:04:58.469721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:04:58.469721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:04:58.469721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:04:58.469721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:04:58.469721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:04:58.469721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:04:58.469721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:04:58.469721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:04:58.470829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:04:58.470829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:04:58.470829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:04:58.470829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:04:58.470829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:04:58.470829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:04:58.470829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:04:58.470829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:04:58.470829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:04:58.470829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:04:58.470829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:04:58.470829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:04:58.470829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:04:58.470829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:04:58.470829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:04:58.470829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:04:58.470829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:04:58.472184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:04:58.472184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:04:58.472184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:04:58.472184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:04:58.472184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 611/1215] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:04:58.476612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172568e8-898a-488d-80db-a0facc0d0013 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:04:58.572681 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172568e8-898a-488d-80db-a0facc0d0013 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:04:58.605963 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f296df2-13e2-4d04-91d2-5a7e1091f668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:04:58.606651 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f296df2-13e2-4d04-91d2-5a7e1091f668 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:04:58.606934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f296df2-13e2-4d04-91d2-5a7e1091f668 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:04:58.607334 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f296df2-13e2-4d04-91d2-5a7e1091f668 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:04:58.608047 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f296df2-13e2-4d04-91d2-5a7e1091f668 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:04:58.608351 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f296df2-13e2-4d04-91d2-5a7e1091f668 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:04:58.609714 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f296df2-13e2-4d04-91d2-5a7e1091f668 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:04:58.620463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 605/1216] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:04:58.626436 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c30e1-b9e9-412a-911a-4a3793b0897c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:04:58.722068 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c30e1-b9e9-412a-911a-4a3793b0897c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:04:58.754656 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed73db9-ef21-49e4-a78a-6b2a9c24e037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:04:58.755440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed73db9-ef21-49e4-a78a-6b2a9c24e037 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:04:58.755724 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed73db9-ef21-49e4-a78a-6b2a9c24e037 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:04:58.756001 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed73db9-ef21-49e4-a78a-6b2a9c24e037 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:04:58.762579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed73db9-ef21-49e4-a78a-6b2a9c24e037 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:04:58.764556 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed73db9-ef21-49e4-a78a-6b2a9c24e037 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:04:58.777902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-0ed73db9-ef21-49e4-a78a-6b2a9c24e037 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:04:58.777902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:04:58.777902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:04:58.777902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:04:58.777902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:04:58.777902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:04:58.777902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:04:58.777902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:04:58.777902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:04:58.777902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:04:58.777902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:04:58.777902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:04:58.777902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:04:58.777902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:04:58.777902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:04:58.779927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:04:58.779927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:04:58.779927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:04:58.779927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:04:58.779927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:04:58.779927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:04:58.779927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:04:58.779927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:04:58.779927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:04:58.779927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:04:58.779927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:04:58.779927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:04:58.779927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:04:58.779927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:04:58.779927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:04:58.779927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:04:58.779927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:04:58.781123 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:04:58.781123 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:04:58.781123 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:04:58.781123 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:04:58.781123 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:04:58.781123 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:04:58.781123 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:04:58.781123 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:04:58.781123 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 612/1217] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:04:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:04:58.785637 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f296df2-13e2-4d04-91d2-5a7e1091f668 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:04:58.879981 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f296df2-13e2-4d04-91d2-5a7e1091f668 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:04:58.911782 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce753f-8e7b-447a-88f1-92ef239f353f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:04:58.912432 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce753f-8e7b-447a-88f1-92ef239f353f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:04:58.912713 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce753f-8e7b-447a-88f1-92ef239f353f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:04:58.912988 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce753f-8e7b-447a-88f1-92ef239f353f None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:04:58.913794 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce753f-8e7b-447a-88f1-92ef239f353f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:04:58.914090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce753f-8e7b-447a-88f1-92ef239f353f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:04:58.915549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce753f-8e7b-447a-88f1-92ef239f353f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:04:58.926926 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 606/1218] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:04:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:04:58.932962 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed73db9-ef21-49e4-a78a-6b2a9c24e037 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:04:59.035405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed73db9-ef21-49e4-a78a-6b2a9c24e037 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:04:59.067569 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f73889-6521-421f-8eb6-420ed404a68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:04:59.068214 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f73889-6521-421f-8eb6-420ed404a68f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:04:59.068499 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f73889-6521-421f-8eb6-420ed404a68f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:04:59.068777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f73889-6521-421f-8eb6-420ed404a68f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:04:59.069606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f73889-6521-421f-8eb6-420ed404a68f None admin] RBAC: Adding query filter params (role.id=f63aad4ab4a04108b87e1bf4ea8dfa53, scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9, user.id=1f231aa78ac84054b06a2126e1a11f31) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:04:59.069916 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f73889-6521-421f-8eb6-420ed404a68f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:04:59.071405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f73889-6521-421f-8eb6-420ed404a68f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:04:59.077441 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 613/1219] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:04:58 2022] GET /identity/v3/role_assignments?user.id=1f231aa78ac84054b06a2126e1a11f31&scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9&role.id=f63aad4ab4a04108b87e1bf4ea8dfa53 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:01.227189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a3dd5-f661-47aa-8290-2d0628bc4ffb None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:01.227720 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a3dd5-f661-47aa-8290-2d0628bc4ffb None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:01.227720 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a3dd5-f661-47aa-8290-2d0628bc4ffb None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:01.229073 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 607/1220] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:05:01.235045 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd36da-3c9c-4de6-b841-5fe7c9860bbe None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:01.235444 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd36da-3c9c-4de6-b841-5fe7c9860bbe None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:01.235772 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd36da-3c9c-4de6-b841-5fe7c9860bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:01.252471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-75cd36da-3c9c-4de6-b841-5fe7c9860bbe None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:05:01.253634 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-75cd36da-3c9c-4de6-b841-5fe7c9860bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:05:01.316023 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 614/1221] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:05:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:05:01.338576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a3dd5-f661-47aa-8290-2d0628bc4ffb None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:01.442519 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a3dd5-f661-47aa-8290-2d0628bc4ffb None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:01.476033 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2967b-5392-4cb2-8504-f642c07c30f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:01.476817 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2967b-5392-4cb2-8504-f642c07c30f7 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:01.477104 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2967b-5392-4cb2-8504-f642c07c30f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:01.477432 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2967b-5392-4cb2-8504-f642c07c30f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:01.487399 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2967b-5392-4cb2-8504-f642c07c30f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:05:01.495151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-f6a2967b-5392-4cb2-8504-f642c07c30f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 15:05:01.495151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:01.495151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:01.495151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:01.495151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:01.495151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:01.495151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:01.495151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:01.495151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:01.495151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:01.495151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:01.495151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:01.495151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:05:01.495151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:05:01.495151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:05:01.495151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:05:01.496633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:05:01.496633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:05:01.496633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:05:01.496633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:05:01.496633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:01.496633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:01.496633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:01.496633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:01.496633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:01.496633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:01.496633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:01.496633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:05:01.496633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:01.496633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:01.496633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:01.496633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:01.497511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:01.497511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:01.497511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:01.497511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:01.497511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:05:01.497511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:05:01.497511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:05:01.497511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:05:01.497511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:05:01.497511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:05:01.497511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 15:05:01.497511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:05:01.497511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 608/1222] 10.222.0.76 () {56 vars in 1102 bytes} [Mon May 16 15:05:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:05:01.502868 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd36da-3c9c-4de6-b841-5fe7c9860bbe None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:01.599899 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd36da-3c9c-4de6-b841-5fe7c9860bbe None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:01.633357 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283975b8-51a0-4c87-a472-61af40cc7b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:01.634014 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283975b8-51a0-4c87-a472-61af40cc7b3d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:01.634324 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283975b8-51a0-4c87-a472-61af40cc7b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:01.634601 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283975b8-51a0-4c87-a472-61af40cc7b3d None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:01.635360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283975b8-51a0-4c87-a472-61af40cc7b3d None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:01.635690 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283975b8-51a0-4c87-a472-61af40cc7b3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:01.637051 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283975b8-51a0-4c87-a472-61af40cc7b3d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:01.644801 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 615/1223] 10.222.0.76 () {56 vars in 1103 bytes} [Mon May 16 15:05:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:01.650896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2967b-5392-4cb2-8504-f642c07c30f7 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:01.748826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2967b-5392-4cb2-8504-f642c07c30f7 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:01.780001 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44461d3f-cefe-4f2f-8fbc-4bd9a30d297d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:01.780776 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44461d3f-cefe-4f2f-8fbc-4bd9a30d297d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:01.781053 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44461d3f-cefe-4f2f-8fbc-4bd9a30d297d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:01.781322 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44461d3f-cefe-4f2f-8fbc-4bd9a30d297d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:01.792207 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44461d3f-cefe-4f2f-8fbc-4bd9a30d297d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:01.793627 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44461d3f-cefe-4f2f-8fbc-4bd9a30d297d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:01.811134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-44461d3f-cefe-4f2f-8fbc-4bd9a30d297d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:05:01.811134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:01.811134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:01.811134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:01.811134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:01.811134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:01.811134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:01.811134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:01.811134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:01.811134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:01.811134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:01.811134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:01.811134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:05:01.811134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:05:01.811134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:05:01.812213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:05:01.812213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:01.812213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:01.812213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:01.812213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:01.812213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:01.812213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:01.812213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:01.812213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:05:01.812213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:01.812213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:01.812213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:01.812213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:01.812213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:01.812213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:01.812213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:01.812213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:01.813331 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:05:01.813331 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:05:01.813331 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:05:01.813331 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:05:01.813331 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 609/1224] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:05:01.818012 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283975b8-51a0-4c87-a472-61af40cc7b3d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:01.913650 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283975b8-51a0-4c87-a472-61af40cc7b3d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:01.946029 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff72ce8-045a-47b9-9747-8283051a410e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:01.946709 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff72ce8-045a-47b9-9747-8283051a410e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:01.946993 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff72ce8-045a-47b9-9747-8283051a410e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:01.947271 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff72ce8-045a-47b9-9747-8283051a410e None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:01.947986 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff72ce8-045a-47b9-9747-8283051a410e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:01.948291 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff72ce8-045a-47b9-9747-8283051a410e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:01.949664 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff72ce8-045a-47b9-9747-8283051a410e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:01.960881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 616/1225] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:01.973338 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44461d3f-cefe-4f2f-8fbc-4bd9a30d297d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:02.065166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44461d3f-cefe-4f2f-8fbc-4bd9a30d297d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:02.096345 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa10b4-7caf-4027-b4bd-ba82c8895796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:02.097129 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa10b4-7caf-4027-b4bd-ba82c8895796 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:02.097405 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa10b4-7caf-4027-b4bd-ba82c8895796 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:02.097672 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa10b4-7caf-4027-b4bd-ba82c8895796 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:02.104778 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa10b4-7caf-4027-b4bd-ba82c8895796 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:02.106229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa10b4-7caf-4027-b4bd-ba82c8895796 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:02.120570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-d7fa10b4-7caf-4027-b4bd-ba82c8895796 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 15:05:02.120570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:02.120570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:02.120570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:02.120570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:02.120570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:02.120570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:02.120570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:02.120570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:02.120570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:02.120570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:02.120570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:02.120570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:05:02.120570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:05:02.120570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:05:02.120570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:05:02.129093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:02.129093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:02.129093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:05:02.129093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:05:02.129093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:05:02.129093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:05:02.129093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:02.129093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:02.129093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:02.129093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:02.129093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:02.129093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:05:02.129093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:02.129093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:02.129093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:02.129093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:02.129093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:02.129093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:02.130320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:02.130320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:02.130320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:05:02.130320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:05:02.130320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:05:02.130320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:05:02.130320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:05:02.130320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:05:02.130320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 15:05:02.130320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:05:02.130320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 610/1226] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:05:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:05:02.131053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff72ce8-045a-47b9-9747-8283051a410e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:02.222523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff72ce8-045a-47b9-9747-8283051a410e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:02.254582 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da3b16-308c-496d-a5d7-4ec969855605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:02.255237 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da3b16-308c-496d-a5d7-4ec969855605 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:02.255561 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da3b16-308c-496d-a5d7-4ec969855605 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:02.255832 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da3b16-308c-496d-a5d7-4ec969855605 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:02.256656 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da3b16-308c-496d-a5d7-4ec969855605 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:02.256959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da3b16-308c-496d-a5d7-4ec969855605 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:02.258403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da3b16-308c-496d-a5d7-4ec969855605 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:02.275360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 617/1227] 10.222.0.76 () {56 vars in 1143 bytes} [Mon May 16 15:05:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:02.281544 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa10b4-7caf-4027-b4bd-ba82c8895796 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:02.376446 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa10b4-7caf-4027-b4bd-ba82c8895796 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:02.409107 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8e0e9-4b19-46d6-9025-5acfabe858da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:02.409913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8e0e9-4b19-46d6-9025-5acfabe858da None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:02.410224 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8e0e9-4b19-46d6-9025-5acfabe858da None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:02.410501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8e0e9-4b19-46d6-9025-5acfabe858da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:02.420616 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c8e0e9-4b19-46d6-9025-5acfabe858da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:02.422163 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c8e0e9-4b19-46d6-9025-5acfabe858da None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:02.438731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-22c8e0e9-4b19-46d6-9025-5acfabe858da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:05:02.438731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:02.438731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:02.438731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:02.438731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:02.438731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:02.438731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:02.438731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:02.438731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:02.438731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:02.438731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:02.438731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:02.438731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:05:02.438731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:05:02.438731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:05:02.439788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:05:02.439788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:02.439788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:02.439788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:02.439788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:02.439788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:02.439788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:02.439788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:02.439788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:05:02.439788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:02.439788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:02.439788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:02.439788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:02.439788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:02.439788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:02.439788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:02.439788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:02.440773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:05:02.440773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:05:02.440773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:05:02.440773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:05:02.440773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 611/1228] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:05:02.445753 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da3b16-308c-496d-a5d7-4ec969855605 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:02.541960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da3b16-308c-496d-a5d7-4ec969855605 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:02.575357 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286a059-5790-4411-b99a-1d85109f7f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:02.576635 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286a059-5790-4411-b99a-1d85109f7f69 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:02.576916 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286a059-5790-4411-b99a-1d85109f7f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:02.577186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286a059-5790-4411-b99a-1d85109f7f69 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:02.578088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286a059-5790-4411-b99a-1d85109f7f69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:02.579524 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286a059-5790-4411-b99a-1d85109f7f69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:02.582413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286a059-5790-4411-b99a-1d85109f7f69 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:02.594555 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 618/1229] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:05:02.601129 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8e0e9-4b19-46d6-9025-5acfabe858da None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:02.695520 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8e0e9-4b19-46d6-9025-5acfabe858da None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:02.727544 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3151bf9-dad8-4104-b787-f77867d885ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:02.728324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3151bf9-dad8-4104-b787-f77867d885ff None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:02.728606 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3151bf9-dad8-4104-b787-f77867d885ff None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:02.728877 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3151bf9-dad8-4104-b787-f77867d885ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:02.735229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3151bf9-dad8-4104-b787-f77867d885ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:02.736671 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3151bf9-dad8-4104-b787-f77867d885ff None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:02.751218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-c3151bf9-dad8-4104-b787-f77867d885ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:05:02.751218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:02.751218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:02.751218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:02.751218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:02.751218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:02.751218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:02.751218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:02.751218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:02.751218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:02.751218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:02.751218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:02.751218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:05:02.751218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:05:02.751218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:05:02.752383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:05:02.752383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:02.752383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:02.752383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:02.752383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:02.752383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:02.752383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:02.752383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:02.752383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:05:02.752383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:02.752383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:02.752383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:02.752383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:02.752383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:02.752383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:02.752383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:02.752383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:02.753294 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:05:02.753294 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:05:02.753294 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:05:02.753294 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:05:02.753294 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:05:02.753294 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:05:02.753294 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:05:02.753294 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:05:02.753294 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 612/1230] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:05:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:05:02.758590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286a059-5790-4411-b99a-1d85109f7f69 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:02.857326 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286a059-5790-4411-b99a-1d85109f7f69 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:02.890188 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0fa77-83d3-45b4-aadd-57d8a8a5d12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:02.890837 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0fa77-83d3-45b4-aadd-57d8a8a5d12c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:02.891123 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0fa77-83d3-45b4-aadd-57d8a8a5d12c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:02.891399 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0fa77-83d3-45b4-aadd-57d8a8a5d12c None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:02.892182 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0fa77-83d3-45b4-aadd-57d8a8a5d12c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:02.892486 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0fa77-83d3-45b4-aadd-57d8a8a5d12c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:02.893910 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0fa77-83d3-45b4-aadd-57d8a8a5d12c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:02.905314 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 619/1231] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:05:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:02.911386 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3151bf9-dad8-4104-b787-f77867d885ff None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:03.005344 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3151bf9-dad8-4104-b787-f77867d885ff None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:03.036793 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ded5f-4d67-48b0-982d-03d4cedbcb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:03.037661 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ded5f-4d67-48b0-982d-03d4cedbcb91 None admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:03.037937 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ded5f-4d67-48b0-982d-03d4cedbcb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:03.038303 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ded5f-4d67-48b0-982d-03d4cedbcb91 None admin] PATH_INFO: `/v3/projects/681a6490f3c04f9fa2830cfde3deb2e9/users/1f231aa78ac84054b06a2126e1a11f31/roles/f63aad4ab4a04108b87e1bf4ea8dfa53` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:03.053238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ded5f-4d67-48b0-982d-03d4cedbcb91 None admin] RBAC: Authorizing `identity:create_grant(project_id=681a6490f3c04f9fa2830cfde3deb2e9, user_id=1f231aa78ac84054b06a2126e1a11f31, role_id=f63aad4ab4a04108b87e1bf4ea8dfa53)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:03.054717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ded5f-4d67-48b0-982d-03d4cedbcb91 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:03.151021 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 613/1232] 10.222.0.76 () {58 vars in 1439 bytes} [Mon May 16 15:05:02 2022] PUT /identity/v3/projects/681a6490f3c04f9fa2830cfde3deb2e9/users/1f231aa78ac84054b06a2126e1a11f31/roles/f63aad4ab4a04108b87e1bf4ea8dfa53 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:05:05.314175 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adaab3-e30c-493b-95be-d234600a2ae6 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:05.314725 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adaab3-e30c-493b-95be-d234600a2ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:05.314725 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adaab3-e30c-493b-95be-d234600a2ae6 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:05.316083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 620/1233] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:05:05.321469 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500a78f-e881-4e3b-88d6-1dac894b609c None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:05.321907 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500a78f-e881-4e3b-88d6-1dac894b609c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:05.322008 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500a78f-e881-4e3b-88d6-1dac894b609c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:05.337770 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-7500a78f-e881-4e3b-88d6-1dac894b609c None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:05:05.338980 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7500a78f-e881-4e3b-88d6-1dac894b609c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:05:05.406521 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 614/1234] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:05:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 15:05:05.430174 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adaab3-e30c-493b-95be-d234600a2ae6 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:05.530570 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adaab3-e30c-493b-95be-d234600a2ae6 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:05.565351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63170d-b206-4e73-b5f6-91397b572d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:05.566072 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63170d-b206-4e73-b5f6-91397b572d50 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:05.566389 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63170d-b206-4e73-b5f6-91397b572d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:05.566690 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63170d-b206-4e73-b5f6-91397b572d50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:05.576598 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63170d-b206-4e73-b5f6-91397b572d50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:05:05.584375 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-db63170d-b206-4e73-b5f6-91397b572d50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 15:05:05.584375 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:05.584375 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:05.584375 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:05.584375 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:05.584375 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:05.584375 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:05.584375 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:05.584375 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:05.584375 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:05.584375 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:05.584375 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:05.584375 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:05:05.584375 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:05:05.584375 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:05:05.584375 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:05:05.587315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:05:05.587315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:05:05.587315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:05:05.587315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:05:05.587315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:05.587315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:05.587315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:05.587315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:05.587315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:05.587315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:05.587315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:05.587315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:05:05.587315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:05.587315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:05.587315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:05.587315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:05.588966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:05.588966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:05.588966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:05.588966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:05.588966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:05:05.588966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:05:05.588966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:05:05.588966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:05:05.588966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:05:05.588966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:05:05.588966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 15:05:05.588966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:05:05.588966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 621/1235] 10.222.0.76 () {56 vars in 1102 bytes} [Mon May 16 15:05:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:05:05.592027 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500a78f-e881-4e3b-88d6-1dac894b609c None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:05.689655 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500a78f-e881-4e3b-88d6-1dac894b609c None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:05.726487 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a2958-e21e-4f25-9a49-373655a951b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:05.727152 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a2958-e21e-4f25-9a49-373655a951b5 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:05.727431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a2958-e21e-4f25-9a49-373655a951b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:05.727704 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a2958-e21e-4f25-9a49-373655a951b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:05.728443 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a2958-e21e-4f25-9a49-373655a951b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:05.728743 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a2958-e21e-4f25-9a49-373655a951b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:05.730096 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a2958-e21e-4f25-9a49-373655a951b5 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:05.738924 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 615/1236] 10.222.0.76 () {56 vars in 1103 bytes} [Mon May 16 15:05:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:05.744817 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63170d-b206-4e73-b5f6-91397b572d50 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:05.840643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63170d-b206-4e73-b5f6-91397b572d50 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:05.873849 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e27632-5008-4965-b16c-a026b4f0eb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:05.874665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e27632-5008-4965-b16c-a026b4f0eb02 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:05.874949 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e27632-5008-4965-b16c-a026b4f0eb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:05.875226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e27632-5008-4965-b16c-a026b4f0eb02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:05.885305 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e27632-5008-4965-b16c-a026b4f0eb02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:05.886862 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e27632-5008-4965-b16c-a026b4f0eb02 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:05.903200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-24e27632-5008-4965-b16c-a026b4f0eb02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:05:05.903200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:05.903200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:05.903200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:05.903200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:05.903200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:05.903200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:05.903200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:05.903200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:05.903200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:05.903200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:05.903200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:05.903200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:05:05.903200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:05:05.903200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:05:05.904644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:05:05.904644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:05.904644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:05.904644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:05.904644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:05.904644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:05.904644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:05.904644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:05.904644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:05:05.904644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:05.904644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:05.904644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:05.904644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:05.904644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:05.904644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:05.904644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:05.904644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:05.905671 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:05:05.905671 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:05:05.905671 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:05:05.905671 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:05:05.905671 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 622/1237] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:05:05.910628 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a2958-e21e-4f25-9a49-373655a951b5 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:06.005249 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a2958-e21e-4f25-9a49-373655a951b5 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:06.037932 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0082b-80e9-4e8d-a65c-2f063fdd8056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:06.038621 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0082b-80e9-4e8d-a65c-2f063fdd8056 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:06.038902 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0082b-80e9-4e8d-a65c-2f063fdd8056 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:06.039171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0082b-80e9-4e8d-a65c-2f063fdd8056 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:06.039880 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0082b-80e9-4e8d-a65c-2f063fdd8056 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:06.040181 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0082b-80e9-4e8d-a65c-2f063fdd8056 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:06.041601 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0082b-80e9-4e8d-a65c-2f063fdd8056 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:06.052638 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 616/1238] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:06.058413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e27632-5008-4965-b16c-a026b4f0eb02 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:06.159725 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e27632-5008-4965-b16c-a026b4f0eb02 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:06.191255 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4203f9c-7010-4ece-8909-b6698fef5310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:06.192048 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4203f9c-7010-4ece-8909-b6698fef5310 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:06.192332 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4203f9c-7010-4ece-8909-b6698fef5310 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:06.192610 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4203f9c-7010-4ece-8909-b6698fef5310 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:06.199778 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4203f9c-7010-4ece-8909-b6698fef5310 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:06.201774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4203f9c-7010-4ece-8909-b6698fef5310 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:06.215679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d4203f9c-7010-4ece-8909-b6698fef5310 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 15:05:06.215679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:06.215679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:06.215679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:06.215679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:06.215679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:06.215679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:06.215679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:06.215679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:06.215679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:06.215679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:06.215679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:06.215679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:05:06.215679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:05:06.215679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:05:06.215679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:05:06.217398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:06.217398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:06.217398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:05:06.217398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:05:06.217398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:05:06.217398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:05:06.217398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:06.217398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:06.217398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:06.217398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:06.217398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:06.217398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:05:06.217398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:06.217398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:06.217398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:06.217398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:06.217398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:06.217398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:06.218685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:06.218685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:06.218685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:05:06.218685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:05:06.218685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:05:06.218685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:05:06.218685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:05:06.218685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:05:06.218685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 15:05:06.218685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:05:06.218685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 623/1239] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:05:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:05:06.223184 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0082b-80e9-4e8d-a65c-2f063fdd8056 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:06.318043 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0082b-80e9-4e8d-a65c-2f063fdd8056 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:06.349790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc32cf7-6949-4008-9acd-ada7d72cb1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:06.355126 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc32cf7-6949-4008-9acd-ada7d72cb1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:06.355126 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc32cf7-6949-4008-9acd-ada7d72cb1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:06.355126 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc32cf7-6949-4008-9acd-ada7d72cb1c5 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:06.355126 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc32cf7-6949-4008-9acd-ada7d72cb1c5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:06.355126 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc32cf7-6949-4008-9acd-ada7d72cb1c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:06.355126 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc32cf7-6949-4008-9acd-ada7d72cb1c5 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:06.369687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 617/1240] 10.222.0.76 () {56 vars in 1143 bytes} [Mon May 16 15:05:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:06.376131 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4203f9c-7010-4ece-8909-b6698fef5310 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:06.484172 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4203f9c-7010-4ece-8909-b6698fef5310 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:06.516561 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246ba33-058f-40be-a572-2f7630dd4db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:06.517202 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246ba33-058f-40be-a572-2f7630dd4db7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:06.517484 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246ba33-058f-40be-a572-2f7630dd4db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:06.517756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246ba33-058f-40be-a572-2f7630dd4db7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:06.581386 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246ba33-058f-40be-a572-2f7630dd4db7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:06.582880 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246ba33-058f-40be-a572-2f7630dd4db7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:06.678384 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 624/1241] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:05:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 15:05:06.684318 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc32cf7-6949-4008-9acd-ada7d72cb1c5 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:06.780896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc32cf7-6949-4008-9acd-ada7d72cb1c5 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:06.813701 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dd0d7-6af5-4300-adbb-67e5ac25c4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:06.814503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dd0d7-6af5-4300-adbb-67e5ac25c4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:06.814780 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dd0d7-6af5-4300-adbb-67e5ac25c4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:06.815047 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dd0d7-6af5-4300-adbb-67e5ac25c4f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:06.824449 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511dd0d7-6af5-4300-adbb-67e5ac25c4f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:06.825881 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511dd0d7-6af5-4300-adbb-67e5ac25c4f8 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:06.843196 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-511dd0d7-6af5-4300-adbb-67e5ac25c4f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:05:06.843196 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:06.843196 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:06.843196 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:06.843196 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:06.843196 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:06.843196 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:06.843196 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:06.843196 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:06.843196 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:06.843196 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:06.843196 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:06.843196 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:05:06.843196 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:05:06.843196 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:05:06.856082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:05:06.856082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:06.856082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:06.856082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:06.856082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:06.856082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:06.856082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:06.856082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:06.856082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:05:06.856082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:06.856082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:06.856082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:06.856082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:06.856082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:06.856082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:06.856082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:06.856082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:06.857701 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:05:06.857701 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:05:06.857701 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:05:06.857701 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:05:06.857701 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 618/1242] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:05:06.858043 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246ba33-058f-40be-a572-2f7630dd4db7 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:06.946286 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246ba33-058f-40be-a572-2f7630dd4db7 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:06.978050 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f76d7-9ffd-49af-912b-d224cf837f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:06.978737 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f76d7-9ffd-49af-912b-d224cf837f84 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:06.979019 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f76d7-9ffd-49af-912b-d224cf837f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:06.979296 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f76d7-9ffd-49af-912b-d224cf837f84 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:06.980017 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f76d7-9ffd-49af-912b-d224cf837f84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:06.980322 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f76d7-9ffd-49af-912b-d224cf837f84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:06.982220 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f76d7-9ffd-49af-912b-d224cf837f84 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:06.993056 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 625/1243] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:06.999473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dd0d7-6af5-4300-adbb-67e5ac25c4f8 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:07.095369 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dd0d7-6af5-4300-adbb-67e5ac25c4f8 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:07.127694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db026d-fed3-4863-b14d-40f627c0c9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:07.128471 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db026d-fed3-4863-b14d-40f627c0c9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:07.128755 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db026d-fed3-4863-b14d-40f627c0c9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:07.129032 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db026d-fed3-4863-b14d-40f627c0c9a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:07.135438 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db026d-fed3-4863-b14d-40f627c0c9a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:07.136873 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db026d-fed3-4863-b14d-40f627c0c9a7 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:07.150445 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-f0db026d-fed3-4863-b14d-40f627c0c9a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:05:07.150445 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:07.150445 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:07.150445 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:07.150445 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:07.150445 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:07.150445 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:07.150445 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:07.150445 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:07.150445 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:07.150445 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:07.150445 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:07.150445 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:05:07.150445 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:05:07.150445 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:05:07.155737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:05:07.155737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:07.155737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:07.155737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:07.155737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:07.155737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:07.155737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:07.155737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:07.155737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:05:07.155737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:07.155737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:07.155737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:07.155737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:07.155737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:07.155737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:07.155737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:07.155737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:07.156965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:05:07.156965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:05:07.156965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:05:07.156965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:05:07.156965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:05:07.156965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:05:07.156965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:05:07.156965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:05:07.156965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 619/1244] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:05:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:05:07.158066 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f76d7-9ffd-49af-912b-d224cf837f84 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:07.253623 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f76d7-9ffd-49af-912b-d224cf837f84 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:07.286614 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488ad3a-e88d-45d3-aed3-82a9bbd7710a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:07.287303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488ad3a-e88d-45d3-aed3-82a9bbd7710a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:07.287587 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488ad3a-e88d-45d3-aed3-82a9bbd7710a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:07.287863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488ad3a-e88d-45d3-aed3-82a9bbd7710a None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:07.288642 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488ad3a-e88d-45d3-aed3-82a9bbd7710a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:07.288951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488ad3a-e88d-45d3-aed3-82a9bbd7710a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:07.290404 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488ad3a-e88d-45d3-aed3-82a9bbd7710a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:07.302663 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 626/1245] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:05:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:07.308794 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db026d-fed3-4863-b14d-40f627c0c9a7 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:07.402438 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db026d-fed3-4863-b14d-40f627c0c9a7 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:07.434409 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b572bfc-7a31-4f7e-a764-f2cba7fdebeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:07.435064 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b572bfc-7a31-4f7e-a764-f2cba7fdebeb None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:07.435340 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b572bfc-7a31-4f7e-a764-f2cba7fdebeb None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:07.435656 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b572bfc-7a31-4f7e-a764-f2cba7fdebeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:07.436468 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b572bfc-7a31-4f7e-a764-f2cba7fdebeb None admin] RBAC: Adding query filter params (role.id=f63aad4ab4a04108b87e1bf4ea8dfa53, scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9, user.id=1f231aa78ac84054b06a2126e1a11f31) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:07.436771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b572bfc-7a31-4f7e-a764-f2cba7fdebeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:07.438210 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b572bfc-7a31-4f7e-a764-f2cba7fdebeb None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:07.443787 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 620/1246] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:05:07 2022] GET /identity/v3/role_assignments?user.id=1f231aa78ac84054b06a2126e1a11f31&scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9&role.id=f63aad4ab4a04108b87e1bf4ea8dfa53 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:09.691001 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ffb65-5894-4aad-bd9f-c7a0f72d2c75 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:09.691534 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ffb65-5894-4aad-bd9f-c7a0f72d2c75 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:09.691534 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ffb65-5894-4aad-bd9f-c7a0f72d2c75 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:09.692983 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 627/1247] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:05:09.698091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa782c53-ae41-43e7-a209-e571f15a6362 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:09.698568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa782c53-ae41-43e7-a209-e571f15a6362 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:09.698688 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa782c53-ae41-43e7-a209-e571f15a6362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:09.715527 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-fa782c53-ae41-43e7-a209-e571f15a6362 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:05:09.716714 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-fa782c53-ae41-43e7-a209-e571f15a6362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:05:09.780336 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 621/1248] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:05:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:05:09.803472 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ffb65-5894-4aad-bd9f-c7a0f72d2c75 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:09.900562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ffb65-5894-4aad-bd9f-c7a0f72d2c75 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:09.932846 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895887d-6c03-425a-ba0f-f02b2725bab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:09.933631 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895887d-6c03-425a-ba0f-f02b2725bab9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:09.933914 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895887d-6c03-425a-ba0f-f02b2725bab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:09.934217 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895887d-6c03-425a-ba0f-f02b2725bab9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:09.944646 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895887d-6c03-425a-ba0f-f02b2725bab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:05:09.952229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a895887d-6c03-425a-ba0f-f02b2725bab9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:05:09.952229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:09.952229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:09.952229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:09.952229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:09.952229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:09.952229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:09.952229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:09.952229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:09.952229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:09.952229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:09.952229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:09.952229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:05:09.952229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:05:09.952229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:05:09.952229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:05:09.953413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:05:09.953413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:05:09.953413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:05:09.953413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:05:09.953413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:09.953413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:09.953413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:09.953413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:09.953413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:09.953413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:09.953413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:09.953413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:05:09.953413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:09.953413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:09.953413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:09.953413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:09.954391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:09.954391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:09.954391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:09.954391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:09.954391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:05:09.954391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:05:09.954391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:05:09.954391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:05:09.954391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:05:09.954391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:05:09.954391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:05:09.954391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:05:09.954391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 628/1249] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:05:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:05:09.959398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa782c53-ae41-43e7-a209-e571f15a6362 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:10.051610 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa782c53-ae41-43e7-a209-e571f15a6362 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:10.084787 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f5a3f-0d92-43c1-a1e3-6bd53cbff889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:10.085451 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f5a3f-0d92-43c1-a1e3-6bd53cbff889 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:10.085737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f5a3f-0d92-43c1-a1e3-6bd53cbff889 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:10.086015 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f5a3f-0d92-43c1-a1e3-6bd53cbff889 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:10.086805 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f5a3f-0d92-43c1-a1e3-6bd53cbff889 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:10.087111 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f5a3f-0d92-43c1-a1e3-6bd53cbff889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:10.088513 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f5a3f-0d92-43c1-a1e3-6bd53cbff889 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:10.096924 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 622/1250] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:05:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:10.102601 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895887d-6c03-425a-ba0f-f02b2725bab9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:10.199283 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895887d-6c03-425a-ba0f-f02b2725bab9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:10.230840 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91aa953-99cd-4ae0-8d3c-3c87907a0fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:10.232186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91aa953-99cd-4ae0-8d3c-3c87907a0fad None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:10.232464 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91aa953-99cd-4ae0-8d3c-3c87907a0fad None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:10.232737 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91aa953-99cd-4ae0-8d3c-3c87907a0fad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:10.242997 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91aa953-99cd-4ae0-8d3c-3c87907a0fad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:10.245357 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91aa953-99cd-4ae0-8d3c-3c87907a0fad None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:10.261777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d91aa953-99cd-4ae0-8d3c-3c87907a0fad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:05:10.261777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:10.261777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:10.261777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:10.261777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:10.261777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:10.261777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:10.261777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:10.261777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:10.261777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:10.261777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:10.261777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:10.261777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:05:10.261777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:05:10.261777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:05:10.263468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:05:10.263468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:10.263468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:10.263468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:10.263468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:10.263468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:10.263468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:10.263468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:10.263468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:05:10.263468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:10.263468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:10.263468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:10.263468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:10.263468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:10.263468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:10.263468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:10.263468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:10.264582 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:05:10.264582 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:05:10.264582 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:05:10.264582 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:05:10.264582 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 629/1251] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:05:10.269343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f5a3f-0d92-43c1-a1e3-6bd53cbff889 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:10.364520 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f5a3f-0d92-43c1-a1e3-6bd53cbff889 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:10.397216 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6d561-4fb8-484f-b8d3-6670faf5fabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:10.397871 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6d561-4fb8-484f-b8d3-6670faf5fabe None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:10.398179 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6d561-4fb8-484f-b8d3-6670faf5fabe None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:10.398459 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6d561-4fb8-484f-b8d3-6670faf5fabe None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:10.399183 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6d561-4fb8-484f-b8d3-6670faf5fabe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:10.399491 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6d561-4fb8-484f-b8d3-6670faf5fabe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:10.400908 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6d561-4fb8-484f-b8d3-6670faf5fabe None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:10.412519 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 623/1252] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:10.418091 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91aa953-99cd-4ae0-8d3c-3c87907a0fad None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:10.514399 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91aa953-99cd-4ae0-8d3c-3c87907a0fad None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:10.547307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ec89a-449f-450a-9234-9c68d9d01125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:10.548097 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ec89a-449f-450a-9234-9c68d9d01125 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:10.548385 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ec89a-449f-450a-9234-9c68d9d01125 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:10.548660 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ec89a-449f-450a-9234-9c68d9d01125 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:10.556791 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ec89a-449f-450a-9234-9c68d9d01125 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:10.568326 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ec89a-449f-450a-9234-9c68d9d01125 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:10.572881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a89ec89a-449f-450a-9234-9c68d9d01125 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 15:05:10.572881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:10.572881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:10.572881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:10.572881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:10.572881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:10.572881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:10.572881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:10.572881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:10.572881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:10.572881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:10.572881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:10.572881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:05:10.572881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:05:10.572881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:05:10.572881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:05:10.574004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:10.574004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:10.574004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:05:10.574004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:05:10.574004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:05:10.574004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:05:10.574004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:10.574004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:10.574004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:10.574004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:10.574004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:10.574004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:05:10.574004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:10.574004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:10.574004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:10.574004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:10.574004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:10.574004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:10.575048 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:10.575048 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:10.575048 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:05:10.575048 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:05:10.575048 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:05:10.575048 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:05:10.575048 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:05:10.575048 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:05:10.575048 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 15:05:10.575048 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:05:10.575048 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 630/1253] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:05:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:05:10.579863 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6d561-4fb8-484f-b8d3-6670faf5fabe None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:10.677709 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6d561-4fb8-484f-b8d3-6670faf5fabe None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:10.710322 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f295cd-09dc-4be6-b58d-82147f498a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:10.711005 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f295cd-09dc-4be6-b58d-82147f498a28 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:10.711270 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f295cd-09dc-4be6-b58d-82147f498a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:10.711542 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f295cd-09dc-4be6-b58d-82147f498a28 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:10.712373 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f295cd-09dc-4be6-b58d-82147f498a28 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:10.712679 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f295cd-09dc-4be6-b58d-82147f498a28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:10.714109 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f295cd-09dc-4be6-b58d-82147f498a28 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:10.730374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 624/1254] 10.222.0.76 () {56 vars in 1143 bytes} [Mon May 16 15:05:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:10.736598 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ec89a-449f-450a-9234-9c68d9d01125 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:10.833723 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ec89a-449f-450a-9234-9c68d9d01125 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:10.872673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76335ee0-8183-4dac-be83-9957c57da321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:10.873324 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76335ee0-8183-4dac-be83-9957c57da321 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:10.873608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76335ee0-8183-4dac-be83-9957c57da321 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:10.873884 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76335ee0-8183-4dac-be83-9957c57da321 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:10.938513 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76335ee0-8183-4dac-be83-9957c57da321 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:10.939978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76335ee0-8183-4dac-be83-9957c57da321 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:11.034222 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 631/1255] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:05:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 15:05:11.039945 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f295cd-09dc-4be6-b58d-82147f498a28 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:11.134715 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f295cd-09dc-4be6-b58d-82147f498a28 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:11.166731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2b509-a8ac-4bca-b6bc-cc0adbb01ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:11.167510 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2b509-a8ac-4bca-b6bc-cc0adbb01ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:11.167790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2b509-a8ac-4bca-b6bc-cc0adbb01ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:11.168064 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2b509-a8ac-4bca-b6bc-cc0adbb01ab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:11.177689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2b509-a8ac-4bca-b6bc-cc0adbb01ab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:11.179163 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2b509-a8ac-4bca-b6bc-cc0adbb01ab7 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:11.196595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-23b2b509-a8ac-4bca-b6bc-cc0adbb01ab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:05:11.196595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:11.196595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:11.196595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:11.196595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:11.196595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:11.196595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:11.196595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:11.196595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:11.196595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:11.196595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:11.196595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:11.196595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:05:11.196595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:05:11.196595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:05:11.197657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:05:11.197657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:11.197657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:11.197657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:11.197657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:11.197657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:11.197657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:11.197657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:11.197657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:05:11.197657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:11.197657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:11.197657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:11.197657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:11.197657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:11.197657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:11.197657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:11.197657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:11.198861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:05:11.198861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:05:11.198861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:05:11.198861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:05:11.198861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 625/1256] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 15:05:11.204125 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76335ee0-8183-4dac-be83-9957c57da321 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:11.299477 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76335ee0-8183-4dac-be83-9957c57da321 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:11.331842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e6918-1692-4a97-b690-e415b345c3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:11.332521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e6918-1692-4a97-b690-e415b345c3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:11.332809 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e6918-1692-4a97-b690-e415b345c3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:11.333075 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e6918-1692-4a97-b690-e415b345c3e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:11.333784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e6918-1692-4a97-b690-e415b345c3e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:11.334089 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e6918-1692-4a97-b690-e415b345c3e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:11.335483 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e6918-1692-4a97-b690-e415b345c3e3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:11.347094 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 632/1257] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:11.352901 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2b509-a8ac-4bca-b6bc-cc0adbb01ab7 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:11.447392 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2b509-a8ac-4bca-b6bc-cc0adbb01ab7 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:11.480225 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d5d93-1f04-4945-a11b-405ef409e778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:11.481044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d5d93-1f04-4945-a11b-405ef409e778 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:11.481354 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d5d93-1f04-4945-a11b-405ef409e778 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:11.481630 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d5d93-1f04-4945-a11b-405ef409e778 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:11.488078 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d5d93-1f04-4945-a11b-405ef409e778 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:11.489517 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d5d93-1f04-4945-a11b-405ef409e778 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:11.503251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-df1d5d93-1f04-4945-a11b-405ef409e778 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:05:11.503251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:11.503251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:11.503251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:11.503251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:11.503251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:11.503251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:11.503251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:11.503251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:11.503251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:11.503251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:11.503251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:11.503251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:05:11.503251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:05:11.503251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:05:11.504411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:05:11.504411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:11.504411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:11.504411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:11.504411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:11.504411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:11.504411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:11.504411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:11.504411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:05:11.504411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:11.504411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:11.504411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:11.504411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:11.504411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:11.504411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:11.504411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:11.504411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:11.505354 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:05:11.505354 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:05:11.505354 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:05:11.505354 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:05:11.505354 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:05:11.505354 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:05:11.505354 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:05:11.505354 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:05:11.505354 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 626/1258] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:05:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:05:11.510376 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e6918-1692-4a97-b690-e415b345c3e3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:11.608825 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e6918-1692-4a97-b690-e415b345c3e3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:11.644329 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525cae2-775f-4d77-9b3d-8cd3c2c93d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:11.644983 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525cae2-775f-4d77-9b3d-8cd3c2c93d61 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:11.645268 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525cae2-775f-4d77-9b3d-8cd3c2c93d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:11.645544 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525cae2-775f-4d77-9b3d-8cd3c2c93d61 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:11.646488 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525cae2-775f-4d77-9b3d-8cd3c2c93d61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:11.646800 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525cae2-775f-4d77-9b3d-8cd3c2c93d61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:11.648230 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525cae2-775f-4d77-9b3d-8cd3c2c93d61 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:11.660197 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 633/1259] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:05:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:11.666169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d5d93-1f04-4945-a11b-405ef409e778 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:11.762574 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d5d93-1f04-4945-a11b-405ef409e778 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:11.795864 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e305b3-c1ec-4df5-8b3f-f509c04410da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:11.796498 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e305b3-c1ec-4df5-8b3f-f509c04410da None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:11.800599 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e305b3-c1ec-4df5-8b3f-f509c04410da None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:11.800599 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e305b3-c1ec-4df5-8b3f-f509c04410da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:11.800599 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e305b3-c1ec-4df5-8b3f-f509c04410da None admin] RBAC: Adding query filter params (role.id=f6c8fc0dc0f24de3907b0960a1201901, scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9, user.id=1f231aa78ac84054b06a2126e1a11f31) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:11.800599 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e305b3-c1ec-4df5-8b3f-f509c04410da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:11.800599 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e305b3-c1ec-4df5-8b3f-f509c04410da None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:11.804854 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 627/1260] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:05:11 2022] GET /identity/v3/role_assignments?user.id=1f231aa78ac84054b06a2126e1a11f31&scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9&role.id=f6c8fc0dc0f24de3907b0960a1201901 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:13.958240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125c499-234a-4fa7-9df3-ba5430f3bfdc None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:13.958772 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125c499-234a-4fa7-9df3-ba5430f3bfdc None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:13.958772 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125c499-234a-4fa7-9df3-ba5430f3bfdc None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:13.960198 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 634/1261] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:05:13.965201 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fee63-8256-41db-b68e-9cd686d80e24 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:13.966119 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fee63-8256-41db-b68e-9cd686d80e24 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:13.966321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fee63-8256-41db-b68e-9cd686d80e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:13.983052 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-1d7fee63-8256-41db-b68e-9cd686d80e24 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:05:13.984212 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1d7fee63-8256-41db-b68e-9cd686d80e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:05:14.048227 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 628/1262] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:05:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:05:14.070912 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125c499-234a-4fa7-9df3-ba5430f3bfdc None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:14.167336 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125c499-234a-4fa7-9df3-ba5430f3bfdc None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:14.199829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9be35-2fab-4da0-bbed-9d1b37895ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:14.201117 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9be35-2fab-4da0-bbed-9d1b37895ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:14.201394 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9be35-2fab-4da0-bbed-9d1b37895ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:14.201661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9be35-2fab-4da0-bbed-9d1b37895ab7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:14.211194 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9be35-2fab-4da0-bbed-9d1b37895ab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:05:14.218590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-0ae9be35-2fab-4da0-bbed-9d1b37895ab7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:05:14.218590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:14.218590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:14.218590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:14.218590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:14.218590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:14.218590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:14.218590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:14.218590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:14.218590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:14.218590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:14.218590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:14.218590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:05:14.218590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:05:14.218590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:05:14.218590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:05:14.219692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:05:14.219692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:05:14.219692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:05:14.219692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:05:14.219692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:14.219692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:14.219692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:14.219692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:14.219692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:14.219692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:14.219692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:14.219692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:05:14.219692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:14.219692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:14.219692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:14.219692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:14.220735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:14.220735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:14.220735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:14.220735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:14.220735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:05:14.220735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:05:14.220735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:05:14.220735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:05:14.220735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:05:14.220735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:05:14.220735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:05:14.220735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:05:14.220735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 635/1263] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:05:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:05:14.225798 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fee63-8256-41db-b68e-9cd686d80e24 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:14.320605 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fee63-8256-41db-b68e-9cd686d80e24 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:14.352044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999a9d9-b834-4828-96b5-92a0faaf6279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:14.354872 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999a9d9-b834-4828-96b5-92a0faaf6279 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:14.354872 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999a9d9-b834-4828-96b5-92a0faaf6279 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:14.354872 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999a9d9-b834-4828-96b5-92a0faaf6279 None admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:14.354872 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999a9d9-b834-4828-96b5-92a0faaf6279 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:14.354872 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999a9d9-b834-4828-96b5-92a0faaf6279 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:14.355728 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999a9d9-b834-4828-96b5-92a0faaf6279 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:14.364363 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 629/1264] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:05:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:14.370179 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9be35-2fab-4da0-bbed-9d1b37895ab7 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:14.465646 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9be35-2fab-4da0-bbed-9d1b37895ab7 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:14.498430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c27a57-93ec-4805-bd60-9ff64b0cb7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:14.499139 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c27a57-93ec-4805-bd60-9ff64b0cb7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:14.499424 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c27a57-93ec-4805-bd60-9ff64b0cb7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:14.499700 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c27a57-93ec-4805-bd60-9ff64b0cb7d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:14.509831 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c27a57-93ec-4805-bd60-9ff64b0cb7d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:14.511723 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c27a57-93ec-4805-bd60-9ff64b0cb7d3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:14.527721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e1c27a57-93ec-4805-bd60-9ff64b0cb7d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:05:14.527721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:14.527721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:14.527721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:14.527721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:14.527721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:14.527721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:14.527721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:14.527721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:14.527721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:14.527721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:14.527721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:14.527721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:05:14.527721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:05:14.527721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:05:14.528876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:05:14.528876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:14.528876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:14.528876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:14.528876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:14.528876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:14.528876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:14.528876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:14.528876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:05:14.528876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:14.528876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:14.528876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:14.528876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:14.528876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:14.528876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:14.528876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:14.528876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:14.530027 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:05:14.530027 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:05:14.530027 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:05:14.530027 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:05:14.530027 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 636/1265] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:05:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:05:14.537414 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999a9d9-b834-4828-96b5-92a0faaf6279 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:14.647474 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999a9d9-b834-4828-96b5-92a0faaf6279 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:14.679708 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52173325-af98-45a0-9a49-73bd273090fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:14.680368 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52173325-af98-45a0-9a49-73bd273090fa None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:14.680672 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52173325-af98-45a0-9a49-73bd273090fa None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:14.680930 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52173325-af98-45a0-9a49-73bd273090fa None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:14.681651 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52173325-af98-45a0-9a49-73bd273090fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:14.681955 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52173325-af98-45a0-9a49-73bd273090fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:14.683360 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52173325-af98-45a0-9a49-73bd273090fa None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:14.697430 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 630/1266] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:14.703826 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c27a57-93ec-4805-bd60-9ff64b0cb7d3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:14.797706 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c27a57-93ec-4805-bd60-9ff64b0cb7d3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:14.829670 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1eb7b-00a4-4493-870d-aa96137cba50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:14.830471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1eb7b-00a4-4493-870d-aa96137cba50 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:14.830752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1eb7b-00a4-4493-870d-aa96137cba50 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:14.831024 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1eb7b-00a4-4493-870d-aa96137cba50 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:14.838189 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1eb7b-00a4-4493-870d-aa96137cba50 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:14.839622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1eb7b-00a4-4493-870d-aa96137cba50 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:14.853341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-c4e1eb7b-00a4-4493-870d-aa96137cba50 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 15:05:14.853341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:14.853341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:14.853341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:14.853341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:14.853341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:14.853341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:14.853341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:14.853341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:14.853341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:14.853341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:14.853341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:14.853341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:05:14.853341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:05:14.853341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:05:14.853341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:05:14.854501 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:14.854501 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:14.854501 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:05:14.854501 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:05:14.854501 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:05:14.854501 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:05:14.854501 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:14.854501 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:14.854501 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:14.854501 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:14.854501 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:14.854501 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:05:14.854501 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:14.854501 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:14.854501 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:14.854501 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:14.854501 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:14.854501 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:14.859691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:14.859691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:14.859691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:05:14.859691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:05:14.859691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:05:14.859691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:05:14.859691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:05:14.859691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:05:14.859691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 15:05:14.859691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:05:14.859691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 637/1267] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:05:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:05:14.860579 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52173325-af98-45a0-9a49-73bd273090fa None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:14.959283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52173325-af98-45a0-9a49-73bd273090fa None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:14.991137 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d891c6a-8e2b-47b7-b11d-46f660262306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:14.991779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d891c6a-8e2b-47b7-b11d-46f660262306 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:14.992059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d891c6a-8e2b-47b7-b11d-46f660262306 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:14.992330 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d891c6a-8e2b-47b7-b11d-46f660262306 None admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:14.993148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d891c6a-8e2b-47b7-b11d-46f660262306 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:14.993450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d891c6a-8e2b-47b7-b11d-46f660262306 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:14.994940 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d891c6a-8e2b-47b7-b11d-46f660262306 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:15.012213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 631/1268] 10.222.0.76 () {56 vars in 1143 bytes} [Mon May 16 15:05:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:15.017930 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1eb7b-00a4-4493-870d-aa96137cba50 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:15.113586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1eb7b-00a4-4493-870d-aa96137cba50 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:15.146720 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46bc49-4566-45f7-884f-5da0d0eff0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:15.147556 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46bc49-4566-45f7-884f-5da0d0eff0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:15.147834 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46bc49-4566-45f7-884f-5da0d0eff0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:15.148104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46bc49-4566-45f7-884f-5da0d0eff0e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:15.158259 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46bc49-4566-45f7-884f-5da0d0eff0e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:15.159744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46bc49-4566-45f7-884f-5da0d0eff0e5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:15.176531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-1c46bc49-4566-45f7-884f-5da0d0eff0e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:05:15.176531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:15.176531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:15.176531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:15.176531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:15.176531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:15.176531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:15.176531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:15.176531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:15.176531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:15.176531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:15.176531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:15.176531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:05:15.176531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:05:15.176531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:05:15.177411 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:05:15.177411 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:15.177411 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:15.177411 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:15.177411 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:15.177411 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:15.177411 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:15.177411 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:15.177411 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:05:15.177411 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:15.177411 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:15.177411 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:15.177411 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:15.177411 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:15.177411 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:15.177411 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:15.177411 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:15.181363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:05:15.181363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:05:15.181363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:05:15.181363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:05:15.181363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 638/1269] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:05:15.183399 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d891c6a-8e2b-47b7-b11d-46f660262306 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:15.277968 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d891c6a-8e2b-47b7-b11d-46f660262306 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:15.310433 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d2847-e5cf-4639-a67f-3ad8b5bc87d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:15.311091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d2847-e5cf-4639-a67f-3ad8b5bc87d2 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:15.311862 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d2847-e5cf-4639-a67f-3ad8b5bc87d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:15.312142 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d2847-e5cf-4639-a67f-3ad8b5bc87d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:15.312865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d2847-e5cf-4639-a67f-3ad8b5bc87d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:15.313168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d2847-e5cf-4639-a67f-3ad8b5bc87d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:15.314572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d2847-e5cf-4639-a67f-3ad8b5bc87d2 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:15.325282 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 632/1270] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:15.331097 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46bc49-4566-45f7-884f-5da0d0eff0e5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:15.428273 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46bc49-4566-45f7-884f-5da0d0eff0e5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:15.460018 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0972a9-7462-46dd-b280-c9141465af20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:15.460794 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0972a9-7462-46dd-b280-c9141465af20 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:15.461073 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0972a9-7462-46dd-b280-c9141465af20 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:15.461346 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0972a9-7462-46dd-b280-c9141465af20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:15.468443 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0972a9-7462-46dd-b280-c9141465af20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:15.469976 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0972a9-7462-46dd-b280-c9141465af20 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:15.484906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-4a0972a9-7462-46dd-b280-c9141465af20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:05:15.484906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:15.484906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:15.484906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:15.484906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:15.484906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:15.484906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:15.484906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:15.484906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:15.484906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:15.484906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:15.484906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:15.484906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:05:15.484906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:05:15.484906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:05:15.485928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:05:15.485928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:15.485928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:15.485928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:15.485928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:15.485928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:15.485928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:15.485928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:15.485928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:05:15.485928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:15.485928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:15.485928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:15.485928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:15.485928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:15.485928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:15.485928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:15.485928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:15.486919 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:05:15.486919 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:05:15.486919 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:05:15.486919 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:05:15.486919 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:05:15.486919 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:05:15.486919 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:05:15.486919 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:05:15.486919 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 639/1271] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:05:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:05:15.491820 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d2847-e5cf-4639-a67f-3ad8b5bc87d2 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:15.586813 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d2847-e5cf-4639-a67f-3ad8b5bc87d2 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:15.618532 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfd930-4d0f-4d25-9e5e-f43b683ddf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:15.619181 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfd930-4d0f-4d25-9e5e-f43b683ddf90 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:15.619463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfd930-4d0f-4d25-9e5e-f43b683ddf90 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:15.619739 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfd930-4d0f-4d25-9e5e-f43b683ddf90 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:15.620523 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfd930-4d0f-4d25-9e5e-f43b683ddf90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:15.621087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfd930-4d0f-4d25-9e5e-f43b683ddf90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:15.623062 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfd930-4d0f-4d25-9e5e-f43b683ddf90 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:15.635264 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 633/1272] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:05:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:15.641650 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0972a9-7462-46dd-b280-c9141465af20 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:15.737558 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0972a9-7462-46dd-b280-c9141465af20 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:15.770588 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27181e25-2a7a-4452-8cd1-18d56a5bc848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:15.771513 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27181e25-2a7a-4452-8cd1-18d56a5bc848 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:15.771797 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27181e25-2a7a-4452-8cd1-18d56a5bc848 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:15.772072 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27181e25-2a7a-4452-8cd1-18d56a5bc848 None admin] PATH_INFO: `/v3/projects/681a6490f3c04f9fa2830cfde3deb2e9/users/1f231aa78ac84054b06a2126e1a11f31/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:15.774168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27181e25-2a7a-4452-8cd1-18d56a5bc848 None admin] RBAC: Authorizing `identity:create_grant(project_id=681a6490f3c04f9fa2830cfde3deb2e9, user_id=1f231aa78ac84054b06a2126e1a11f31, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:15.775613 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27181e25-2a7a-4452-8cd1-18d56a5bc848 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:15.944265 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 640/1273] 10.222.0.76 () {58 vars in 1439 bytes} [Mon May 16 15:05:15 2022] PUT /identity/v3/projects/681a6490f3c04f9fa2830cfde3deb2e9/users/1f231aa78ac84054b06a2126e1a11f31/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:05:18.152130 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28641b-e0d5-42e0-af7f-0a0f60bfb0bd None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:18.152662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28641b-e0d5-42e0-af7f-0a0f60bfb0bd None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:18.152662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28641b-e0d5-42e0-af7f-0a0f60bfb0bd None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:18.154598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 634/1274] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:05:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:05:18.159846 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2c80d-6321-489a-9dbc-797adac3d121 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:18.162200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2c80d-6321-489a-9dbc-797adac3d121 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:18.162200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2c80d-6321-489a-9dbc-797adac3d121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:18.177346 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-adb2c80d-6321-489a-9dbc-797adac3d121 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:05:18.178583 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-adb2c80d-6321-489a-9dbc-797adac3d121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:05:18.241886 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 641/1275] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:05:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:05:18.265657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28641b-e0d5-42e0-af7f-0a0f60bfb0bd None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:18.361234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28641b-e0d5-42e0-af7f-0a0f60bfb0bd None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:18.394625 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd0fe0-d33d-4d3c-b5b0-71a3fe54dcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:18.395409 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd0fe0-d33d-4d3c-b5b0-71a3fe54dcc0 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:18.395717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd0fe0-d33d-4d3c-b5b0-71a3fe54dcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:18.396010 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd0fe0-d33d-4d3c-b5b0-71a3fe54dcc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:18.405757 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd0fe0-d33d-4d3c-b5b0-71a3fe54dcc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 15:05:18.413238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-2dcd0fe0-d33d-4d3c-b5b0-71a3fe54dcc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:05:18.413238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:18.413238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:18.413238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:18.413238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:18.413238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:18.413238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:18.413238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:18.413238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:18.413238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:18.413238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:18.413238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:18.413238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 15:05:18.413238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 15:05:18.413238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 15:05:18.413238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 15:05:18.414374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 15:05:18.414374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 15:05:18.414374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 15:05:18.414374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 15:05:18.414374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:18.414374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:18.414374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:18.414374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:18.414374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:18.414374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:18.414374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:18.414374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:05:18.414374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:18.414374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:18.414374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:18.414374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:18.415413 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:18.415413 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:18.415413 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:18.415413 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:18.415413 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 15:05:18.415413 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 15:05:18.415413 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 15:05:18.415413 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 15:05:18.415413 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 15:05:18.415413 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 15:05:18.415413 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 15:05:18.415413 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:05:18.415413 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 635/1276] 10.222.0.76 () {56 vars in 1096 bytes} [Mon May 16 15:05:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:05:18.420404 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2c80d-6321-489a-9dbc-797adac3d121 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:18.515034 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2c80d-6321-489a-9dbc-797adac3d121 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:18.546753 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4059d-265a-47e1-bfa2-631d432a575f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:18.547412 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4059d-265a-47e1-bfa2-631d432a575f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:18.547693 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4059d-265a-47e1-bfa2-631d432a575f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:18.547967 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4059d-265a-47e1-bfa2-631d432a575f None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:18.548714 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4059d-265a-47e1-bfa2-631d432a575f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:18.549076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4059d-265a-47e1-bfa2-631d432a575f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:18.551865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4059d-265a-47e1-bfa2-631d432a575f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:18.560370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 642/1277] 10.222.0.76 () {56 vars in 1099 bytes} [Mon May 16 15:05:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:18.564875 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd0fe0-d33d-4d3c-b5b0-71a3fe54dcc0 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:18.661523 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd0fe0-d33d-4d3c-b5b0-71a3fe54dcc0 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:18.693037 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4a1fb-ca57-4a48-b468-3d70e708cc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:18.693816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4a1fb-ca57-4a48-b468-3d70e708cc9c None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:18.694096 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4a1fb-ca57-4a48-b468-3d70e708cc9c None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:18.694403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4a1fb-ca57-4a48-b468-3d70e708cc9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:18.704857 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4a1fb-ca57-4a48-b468-3d70e708cc9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:18.706322 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4a1fb-ca57-4a48-b468-3d70e708cc9c None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:18.723060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-4eb4a1fb-ca57-4a48-b468-3d70e708cc9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:05:18.723060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:18.723060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:18.723060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:18.723060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:18.723060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:18.723060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:18.723060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:18.723060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:18.723060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:18.723060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:18.723060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:18.723060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:05:18.723060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:05:18.723060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:05:18.724082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:05:18.724082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:18.724082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:18.724082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:18.724082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:18.724082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:18.724082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:18.724082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:18.724082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:05:18.724082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:18.724082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:18.724082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:18.724082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:18.724082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:18.724082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:18.724082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:18.724082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:18.725030 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:05:18.725030 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:05:18.725030 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:05:18.725030 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:05:18.725030 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 636/1278] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:05:18.729958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4059d-265a-47e1-bfa2-631d432a575f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:18.826964 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4059d-265a-47e1-bfa2-631d432a575f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:18.859014 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea9b9a-e41e-4afb-955a-768f59a0dbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:18.864260 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea9b9a-e41e-4afb-955a-768f59a0dbcf None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:18.864260 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea9b9a-e41e-4afb-955a-768f59a0dbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:18.864260 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea9b9a-e41e-4afb-955a-768f59a0dbcf None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:18.864260 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea9b9a-e41e-4afb-955a-768f59a0dbcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:18.864260 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea9b9a-e41e-4afb-955a-768f59a0dbcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:18.864260 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea9b9a-e41e-4afb-955a-768f59a0dbcf None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:18.874080 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 643/1279] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:18.879786 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4a1fb-ca57-4a48-b468-3d70e708cc9c None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:18.982302 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4a1fb-ca57-4a48-b468-3d70e708cc9c None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:19.014237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409511cd-e548-4d5e-a7f0-2cdd8d7b30d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:19.015026 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409511cd-e548-4d5e-a7f0-2cdd8d7b30d5 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:19.015308 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409511cd-e548-4d5e-a7f0-2cdd8d7b30d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:19.015580 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409511cd-e548-4d5e-a7f0-2cdd8d7b30d5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:19.022716 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409511cd-e548-4d5e-a7f0-2cdd8d7b30d5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:19.024156 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409511cd-e548-4d5e-a7f0-2cdd8d7b30d5 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:19.038838 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-409511cd-e548-4d5e-a7f0-2cdd8d7b30d5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 15:05:19.038838 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:19.038838 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:19.038838 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:19.038838 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:19.038838 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:19.038838 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:19.038838 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:19.038838 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:19.038838 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:19.038838 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:19.038838 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:19.038838 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 15:05:19.038838 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 15:05:19.038838 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 15:05:19.038838 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 15:05:19.042507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:19.042507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:19.042507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 15:05:19.042507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:05:19.042507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 15:05:19.042507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 15:05:19.042507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:19.042507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:19.042507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:19.042507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:19.042507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:19.042507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:05:19.042507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:19.042507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:19.042507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:19.042507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:19.042507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:19.042507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:19.043712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:19.043712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:19.043712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 15:05:19.043712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 15:05:19.043712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 15:05:19.043712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 15:05:19.043712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 15:05:19.043712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 15:05:19.043712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 15:05:19.043712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:05:19.043712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 637/1280] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:05:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:05:19.045808 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea9b9a-e41e-4afb-955a-768f59a0dbcf None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:19.140925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea9b9a-e41e-4afb-955a-768f59a0dbcf None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:19.172658 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b32edb-ce03-4bcd-8610-f68587de6f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:19.173315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b32edb-ce03-4bcd-8610-f68587de6f17 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:19.173592 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b32edb-ce03-4bcd-8610-f68587de6f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:19.173861 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b32edb-ce03-4bcd-8610-f68587de6f17 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:19.174712 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b32edb-ce03-4bcd-8610-f68587de6f17 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:19.175014 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b32edb-ce03-4bcd-8610-f68587de6f17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:19.176429 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b32edb-ce03-4bcd-8610-f68587de6f17 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:19.194366 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 644/1281] 10.222.0.76 () {56 vars in 1143 bytes} [Mon May 16 15:05:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:19.200512 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409511cd-e548-4d5e-a7f0-2cdd8d7b30d5 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:19.300836 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409511cd-e548-4d5e-a7f0-2cdd8d7b30d5 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:19.332903 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d7878-8917-4dfb-a5d9-72ba0f008c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:19.333545 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d7878-8917-4dfb-a5d9-72ba0f008c8e None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:19.333831 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d7878-8917-4dfb-a5d9-72ba0f008c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:19.334105 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d7878-8917-4dfb-a5d9-72ba0f008c8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:19.398032 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d7878-8917-4dfb-a5d9-72ba0f008c8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:19.399518 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d7878-8917-4dfb-a5d9-72ba0f008c8e None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:19.491860 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 638/1282] 10.222.0.76 () {58 vars in 1282 bytes} [Mon May 16 15:05:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 15:05:19.498452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b32edb-ce03-4bcd-8610-f68587de6f17 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:19.600814 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b32edb-ce03-4bcd-8610-f68587de6f17 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:19.635565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f6fd9-6607-489f-befe-8bfed998ff7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:19.636359 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f6fd9-6607-489f-befe-8bfed998ff7d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:19.636643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f6fd9-6607-489f-befe-8bfed998ff7d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:19.636919 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f6fd9-6607-489f-befe-8bfed998ff7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:19.646728 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f6fd9-6607-489f-befe-8bfed998ff7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:19.648169 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f6fd9-6607-489f-befe-8bfed998ff7d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:19.664925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-6d5f6fd9-6607-489f-befe-8bfed998ff7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:05:19.664925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:19.664925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:19.664925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:19.664925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:19.664925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:19.664925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:19.664925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:19.664925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:19.664925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:19.664925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:19.664925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:19.664925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 15:05:19.664925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 15:05:19.664925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 15:05:19.689083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 15:05:19.689083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:19.689083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:19.689083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:19.689083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:19.689083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:19.689083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:19.689083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:19.689083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:05:19.689083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:19.689083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:19.689083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:19.689083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:19.689083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:19.689083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:19.689083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:19.689083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:19.690211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 15:05:19.690211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 15:05:19.690211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 15:05:19.690211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:05:19.690211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 645/1283] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:05:19.690644 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d7878-8917-4dfb-a5d9-72ba0f008c8e None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:19.769066 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d7878-8917-4dfb-a5d9-72ba0f008c8e None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:19.800930 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c81945-2b5b-4fd0-a76a-33ba6862f342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:19.801584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c81945-2b5b-4fd0-a76a-33ba6862f342 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:19.801864 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c81945-2b5b-4fd0-a76a-33ba6862f342 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:19.802155 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c81945-2b5b-4fd0-a76a-33ba6862f342 None admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:19.802879 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c81945-2b5b-4fd0-a76a-33ba6862f342 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:19.803186 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c81945-2b5b-4fd0-a76a-33ba6862f342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:19.804558 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c81945-2b5b-4fd0-a76a-33ba6862f342 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:19.815777 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 639/1284] 10.222.0.76 () {56 vars in 1109 bytes} [Mon May 16 15:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:19.821426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f6fd9-6607-489f-befe-8bfed998ff7d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:19.920156 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f6fd9-6607-489f-befe-8bfed998ff7d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:19.952685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d1a98-c60b-4385-8beb-411834ca49df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:19.953467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d1a98-c60b-4385-8beb-411834ca49df None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:19.953750 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d1a98-c60b-4385-8beb-411834ca49df None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:19.954024 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d1a98-c60b-4385-8beb-411834ca49df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:19.960549 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d1a98-c60b-4385-8beb-411834ca49df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:19.961992 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d1a98-c60b-4385-8beb-411834ca49df None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:19.975939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-1f4d1a98-c60b-4385-8beb-411834ca49df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:05:19.975939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:19.975939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:19.975939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:19.975939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:19.975939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:19.975939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:19.975939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:19.975939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:19.975939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:19.975939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:19.975939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:19.975939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 15:05:19.975939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 15:05:19.975939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 15:05:19.976977 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 15:05:19.976977 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:19.976977 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:19.976977 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:19.976977 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:19.976977 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:19.976977 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:19.976977 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:19.976977 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( May 16 15:05:19.976977 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:19.976977 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:19.976977 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:19.976977 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:19.976977 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:19.976977 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:19.976977 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:19.976977 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:19.978025 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 15:05:19.978025 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 15:05:19.978025 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 15:05:19.978025 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 15:05:19.978025 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 15:05:19.978025 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 15:05:19.978025 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 15:05:19.978025 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application May 16 15:05:19.978025 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 646/1285] 10.222.0.76 () {56 vars in 1111 bytes} [Mon May 16 15:05:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:05:19.983502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c81945-2b5b-4fd0-a76a-33ba6862f342 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:20.076472 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c81945-2b5b-4fd0-a76a-33ba6862f342 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:20.108937 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e71f8-db18-4eee-a5e0-f57a5c933779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:20.109598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e71f8-db18-4eee-a5e0-f57a5c933779 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:20.109876 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e71f8-db18-4eee-a5e0-f57a5c933779 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:20.110173 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e71f8-db18-4eee-a5e0-f57a5c933779 None admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:20.110962 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e71f8-db18-4eee-a5e0-f57a5c933779 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:20.111268 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e71f8-db18-4eee-a5e0-f57a5c933779 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:20.112701 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e71f8-db18-4eee-a5e0-f57a5c933779 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:20.124443 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 640/1286] 10.222.0.76 () {56 vars in 1148 bytes} [Mon May 16 15:05:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:20.130765 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d1a98-c60b-4385-8beb-411834ca49df None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:20.226669 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d1a98-c60b-4385-8beb-411834ca49df None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:20.258419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb043a-3444-4fce-8bbc-e0a8192fad7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:20.259064 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb043a-3444-4fce-8bbc-e0a8192fad7f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:20.259347 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb043a-3444-4fce-8bbc-e0a8192fad7f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:20.262622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb043a-3444-4fce-8bbc-e0a8192fad7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:20.262622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb043a-3444-4fce-8bbc-e0a8192fad7f None admin] RBAC: Adding query filter params (role.id=f6c8fc0dc0f24de3907b0960a1201901, scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9, user.id=1f231aa78ac84054b06a2126e1a11f31) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:20.262622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb043a-3444-4fce-8bbc-e0a8192fad7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:20.262878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb043a-3444-4fce-8bbc-e0a8192fad7f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:20.268299 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 647/1287] 10.222.0.76 () {56 vars in 1374 bytes} [Mon May 16 15:05:20 2022] GET /identity/v3/role_assignments?user.id=1f231aa78ac84054b06a2126e1a11f31&scope.project.id=681a6490f3c04f9fa2830cfde3deb2e9&role.id=f6c8fc0dc0f24de3907b0960a1201901 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:22.515694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676a847-2f85-4db9-b6a6-3e75356a28cc None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:22.516292 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676a847-2f85-4db9-b6a6-3e75356a28cc None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:22.516292 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676a847-2f85-4db9-b6a6-3e75356a28cc None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:22.517614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 641/1288] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:05:22.522952 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a9227-3871-4361-95bf-0a30f555ecaf None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:22.523409 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a9227-3871-4361-95bf-0a30f555ecaf None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:22.523542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a9227-3871-4361-95bf-0a30f555ecaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:22.540076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-882a9227-3871-4361-95bf-0a30f555ecaf None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:05:22.541254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-882a9227-3871-4361-95bf-0a30f555ecaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:05:22.607147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 648/1289] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:05:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:05:22.629814 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676a847-2f85-4db9-b6a6-3e75356a28cc None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:22.726236 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676a847-2f85-4db9-b6a6-3e75356a28cc None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:22.758506 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826829d-81cd-458b-ae93-330d65ecca8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:22.759293 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826829d-81cd-458b-ae93-330d65ecca8d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:22.759576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826829d-81cd-458b-ae93-330d65ecca8d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:22.759854 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826829d-81cd-458b-ae93-330d65ecca8d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:22.760506 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826829d-81cd-458b-ae93-330d65ecca8d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:22.762421 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826829d-81cd-458b-ae93-330d65ecca8d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:22.773925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-f826829d-81cd-458b-ae93-330d65ecca8d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 15:05:22.773925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:22.773925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 15:05:22.773925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 15:05:22.773925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 15:05:22.773925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 15:05:22.773925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 15:05:22.773925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:05:22.773925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 15:05:22.773925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:05:22.773925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:05:22.773925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:05:22.773925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:22.773925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:22.773925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:22.773925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:22.773925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:22.775204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:22.775204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:22.775204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:22.775204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:22.775204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:22.775204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:22.775204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 15:05:22.775204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 15:05:22.775204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 15:05:22.775204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 15:05:22.775204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:22.775204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:22.775204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:22.775204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:22.775204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:22.775204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:22.776101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:22.776101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:05:22.776101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:22.776101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:22.776101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:22.776101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:22.776101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:22.776101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:22.776101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:22.776101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:22.776101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 15:05:22.776101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:05:22.776101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 15:05:22.776101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:05:22.776101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 642/1290] 10.222.0.76 () {56 vars in 1117 bytes} [Mon May 16 15:05:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:05:22.781580 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a9227-3871-4361-95bf-0a30f555ecaf None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:22.881271 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a9227-3871-4361-95bf-0a30f555ecaf None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:22.914448 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253557e-3d99-4945-aa84-5516100823c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:22.915112 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253557e-3d99-4945-aa84-5516100823c8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:22.915391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253557e-3d99-4945-aa84-5516100823c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:22.915665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253557e-3d99-4945-aa84-5516100823c8 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:22.916367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253557e-3d99-4945-aa84-5516100823c8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:22.916670 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253557e-3d99-4945-aa84-5516100823c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:22.918034 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253557e-3d99-4945-aa84-5516100823c8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:22.922744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 649/1291] 10.222.0.76 () {56 vars in 1116 bytes} [Mon May 16 15:05:22 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:22.928568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826829d-81cd-458b-ae93-330d65ecca8d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:23.024444 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826829d-81cd-458b-ae93-330d65ecca8d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:23.056046 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a35c95-5749-4ffa-bc2c-ea899aed951f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:23.056694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a35c95-5749-4ffa-bc2c-ea899aed951f None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:23.056979 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a35c95-5749-4ffa-bc2c-ea899aed951f None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:23.057253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a35c95-5749-4ffa-bc2c-ea899aed951f None admin] PATH_INFO: `/v3/services` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:23.057950 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a35c95-5749-4ffa-bc2c-ea899aed951f None admin] RBAC: Adding query filter params (type=placement) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:23.058291 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a35c95-5749-4ffa-bc2c-ea899aed951f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:23.060195 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a35c95-5749-4ffa-bc2c-ea899aed951f None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:23.064598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 643/1292] 10.222.0.76 () {56 vars in 1116 bytes} [Mon May 16 15:05:22 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:25.236549 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb9366-ac4a-4c57-b700-f21678efc075 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:25.237072 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb9366-ac4a-4c57-b700-f21678efc075 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:25.237164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb9366-ac4a-4c57-b700-f21678efc075 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:25.238543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 650/1293] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:05:25.243745 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dacfd-a3fb-4193-bba0-c9163064d7d1 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:25.244115 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dacfd-a3fb-4193-bba0-c9163064d7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:25.244305 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dacfd-a3fb-4193-bba0-c9163064d7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:25.261403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-265dacfd-a3fb-4193-bba0-c9163064d7d1 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:05:25.263259 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-265dacfd-a3fb-4193-bba0-c9163064d7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:05:25.326662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 644/1294] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:05:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:05:25.348430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb9366-ac4a-4c57-b700-f21678efc075 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:25.446520 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb9366-ac4a-4c57-b700-f21678efc075 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:25.478262 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772489f-c5f6-4a33-84ca-26fa15f75a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:25.478913 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772489f-c5f6-4a33-84ca-26fa15f75a9a None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:25.479194 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772489f-c5f6-4a33-84ca-26fa15f75a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:25.479467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772489f-c5f6-4a33-84ca-26fa15f75a9a None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:25.480190 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772489f-c5f6-4a33-84ca-26fa15f75a9a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:25.482101 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772489f-c5f6-4a33-84ca-26fa15f75a9a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:25.608172 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 651/1295] 10.222.0.76 () {60 vars in 1141 bytes} [Mon May 16 15:05:25 2022] POST /identity/v3/services => generated 246 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:05:27.817925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86861f4-d3e7-4676-bee0-5741b81a20d1 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:27.818544 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86861f4-d3e7-4676-bee0-5741b81a20d1 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:27.818544 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86861f4-d3e7-4676-bee0-5741b81a20d1 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:27.819896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 645/1296] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:05:27.825190 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100240e2-7d05-4d94-a080-1c1494f9297d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:27.825571 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100240e2-7d05-4d94-a080-1c1494f9297d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:27.825748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100240e2-7d05-4d94-a080-1c1494f9297d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:27.842099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-100240e2-7d05-4d94-a080-1c1494f9297d None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:05:27.843235 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-100240e2-7d05-4d94-a080-1c1494f9297d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:05:27.912537 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 652/1297] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:05:27 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:05:27.935781 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86861f4-d3e7-4676-bee0-5741b81a20d1 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:28.035733 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86861f4-d3e7-4676-bee0-5741b81a20d1 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:28.068088 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92212bc-babc-44b3-beb6-4b9f4e89a54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:28.068882 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92212bc-babc-44b3-beb6-4b9f4e89a54d None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:28.069167 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92212bc-babc-44b3-beb6-4b9f4e89a54d None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:28.069442 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92212bc-babc-44b3-beb6-4b9f4e89a54d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:28.070099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92212bc-babc-44b3-beb6-4b9f4e89a54d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:28.071499 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92212bc-babc-44b3-beb6-4b9f4e89a54d None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:28.083538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-b92212bc-babc-44b3-beb6-4b9f4e89a54d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 15:05:28.083538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:28.083538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 15:05:28.083538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 15:05:28.083538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 15:05:28.083538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 15:05:28.083538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 15:05:28.083538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:05:28.083538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 15:05:28.083538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:05:28.083538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:05:28.083538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:05:28.083538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:28.083538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:28.083538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:28.083538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:28.083538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:28.089213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:28.089213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:28.089213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:28.089213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:28.089213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:28.089213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:28.089213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 15:05:28.089213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 15:05:28.089213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 15:05:28.089213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 15:05:28.089213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:28.089213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:28.089213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:28.089213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:28.089213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:28.089213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:28.090448 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:28.090448 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:05:28.090448 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:28.090448 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:28.090448 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:28.090448 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:28.090448 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:28.090448 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:28.090448 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:28.090448 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:28.090448 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 15:05:28.090448 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:05:28.090448 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 15:05:28.090448 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:05:28.090448 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 646/1298] 10.222.0.76 () {56 vars in 1117 bytes} [Mon May 16 15:05:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:05:28.091531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100240e2-7d05-4d94-a080-1c1494f9297d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:28.184702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100240e2-7d05-4d94-a080-1c1494f9297d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:28.218022 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f13978-b1d0-41a0-b011-97b91cdbe244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:28.218831 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f13978-b1d0-41a0-b011-97b91cdbe244 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:28.219114 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f13978-b1d0-41a0-b011-97b91cdbe244 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:28.219388 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f13978-b1d0-41a0-b011-97b91cdbe244 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:28.220087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f13978-b1d0-41a0-b011-97b91cdbe244 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:28.220388 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f13978-b1d0-41a0-b011-97b91cdbe244 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:28.221760 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f13978-b1d0-41a0-b011-97b91cdbe244 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:28.226776 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 653/1299] 10.222.0.76 () {56 vars in 1116 bytes} [Mon May 16 15:05:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:05:28.232662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92212bc-babc-44b3-beb6-4b9f4e89a54d None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:28.326806 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92212bc-babc-44b3-beb6-4b9f4e89a54d None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:28.358483 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da369a52-7108-433e-afc7-71fda79bfc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:28.359134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da369a52-7108-433e-afc7-71fda79bfc7a None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:28.359418 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da369a52-7108-433e-afc7-71fda79bfc7a None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:28.359697 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da369a52-7108-433e-afc7-71fda79bfc7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:28.360484 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da369a52-7108-433e-afc7-71fda79bfc7a None admin] RBAC: Adding query filter params (interface=public, service_id=ff5ce7faffb444d7b3ba0392392d80a5, region_id=RegionOne) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:28.360799 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da369a52-7108-433e-afc7-71fda79bfc7a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:28.362192 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da369a52-7108-433e-afc7-71fda79bfc7a None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:28.367251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 647/1300] 10.222.0.76 () {56 vars in 1251 bytes} [Mon May 16 15:05:28 2022] GET /identity/v3/endpoints?service_id=ff5ce7faffb444d7b3ba0392392d80a5&interface=public®ion_id=RegionOne => generated 194 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:28.373653 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f13978-b1d0-41a0-b011-97b91cdbe244 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:28.467148 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f13978-b1d0-41a0-b011-97b91cdbe244 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:28.500246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d933c2-0308-4e3e-b3d3-60f6347efd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:28.500895 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d933c2-0308-4e3e-b3d3-60f6347efd41 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:28.501172 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d933c2-0308-4e3e-b3d3-60f6347efd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:28.501442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d933c2-0308-4e3e-b3d3-60f6347efd41 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:28.502109 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d933c2-0308-4e3e-b3d3-60f6347efd41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:28.503498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d933c2-0308-4e3e-b3d3-60f6347efd41 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:28.509967 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 654/1301] 10.222.0.76 () {56 vars in 1087 bytes} [Mon May 16 15:05:28 2022] GET /identity/v3/services => generated 2191 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:05:30.708679 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0864c-540e-403a-b83f-362a5e3cabbb None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:30.709201 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0864c-540e-403a-b83f-362a5e3cabbb None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:30.709293 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0864c-540e-403a-b83f-362a5e3cabbb None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:30.710615 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 648/1302] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:05:30.716011 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb992311-4a59-4c5c-9dc6-0a4c8aed6b2e None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:30.716435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb992311-4a59-4c5c-9dc6-0a4c8aed6b2e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:30.716565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb992311-4a59-4c5c-9dc6-0a4c8aed6b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:30.733471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-eb992311-4a59-4c5c-9dc6-0a4c8aed6b2e None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:05:30.740176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-eb992311-4a59-4c5c-9dc6-0a4c8aed6b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:05:30.802932 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 655/1303] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:05:30 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 15:05:30.826083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0864c-540e-403a-b83f-362a5e3cabbb None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:30.924595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0864c-540e-403a-b83f-362a5e3cabbb None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:30.956647 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8930c63-a6da-4771-ad0f-db5e33297c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:30.957428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8930c63-a6da-4771-ad0f-db5e33297c32 None admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:30.957706 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8930c63-a6da-4771-ad0f-db5e33297c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:30.957978 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8930c63-a6da-4771-ad0f-db5e33297c32 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:30.958653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8930c63-a6da-4771-ad0f-db5e33297c32 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:30.960011 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8930c63-a6da-4771-ad0f-db5e33297c32 None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:30.971619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application [None req-b8930c63-a6da-4771-ad0f-db5e33297c32 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 15:05:30.971619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:30.971619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 15:05:30.971619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 15:05:30.971619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 15:05:30.971619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 15:05:30.971619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 15:05:30.971619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:05:30.971619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 15:05:30.971619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:05:30.971619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 15:05:30.971619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:05:30.971619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 15:05:30.971619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 15:05:30.971619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 15:05:30.971619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 15:05:30.971619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 15:05:30.972896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 15:05:30.972896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 15:05:30.972896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 15:05:30.972896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 15:05:30.972896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 15:05:30.972896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 15:05:30.972896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 15:05:30.972896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 15:05:30.972896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 15:05:30.972896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 15:05:30.972896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 15:05:30.972896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 15:05:30.972896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 15:05:30.972896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 15:05:30.972896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 15:05:30.972896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.get_or_create( May 16 15:05:30.979897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 15:05:30.979897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application with Lock( May 16 15:05:30.979897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 15:05:30.979897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self._enter() May 16 15:05:30.979897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 15:05:30.979897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 15:05:30.979897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 15:05:30.979897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application return self.creator() May 16 15:05:30.979897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 15:05:30.979897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application created_value = creator( May 16 15:05:30.979897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 15:05:30.979897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 15:05:30.979897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 15:05:30.979897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: ERROR keystone.server.flask.application May 16 15:05:30.979897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 649/1304] 10.222.0.76 () {56 vars in 1117 bytes} [Mon May 16 15:05:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 15:05:30.981430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb992311-4a59-4c5c-9dc6-0a4c8aed6b2e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:31.074084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb992311-4a59-4c5c-9dc6-0a4c8aed6b2e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:31.106985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18b93f-b2a8-4277-9664-809a05e10107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:31.107638 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18b93f-b2a8-4277-9664-809a05e10107 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:31.107915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18b93f-b2a8-4277-9664-809a05e10107 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:31.108191 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18b93f-b2a8-4277-9664-809a05e10107 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:31.108878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18b93f-b2a8-4277-9664-809a05e10107 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:05:31.109178 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18b93f-b2a8-4277-9664-809a05e10107 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:31.110559 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18b93f-b2a8-4277-9664-809a05e10107 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:31.115707 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 656/1305] 10.222.0.76 () {56 vars in 1116 bytes} [Mon May 16 15:05:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:05:31.121679 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8930c63-a6da-4771-ad0f-db5e33297c32 None admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:05:31.216696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8930c63-a6da-4771-ad0f-db5e33297c32 None admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:05:31.249030 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4ab12-b893-443b-bc27-fa43ad26f4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:05:31.249725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4ab12-b893-443b-bc27-fa43ad26f4ea None admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:31.250006 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4ab12-b893-443b-bc27-fa43ad26f4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:31.250318 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4ab12-b893-443b-bc27-fa43ad26f4ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:31.251062 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4ab12-b893-443b-bc27-fa43ad26f4ea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:05:31.252428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4ab12-b893-443b-bc27-fa43ad26f4ea None admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:05:31.383840 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 650/1306] 10.222.0.76 () {60 vars in 1144 bytes} [Mon May 16 15:05:31 2022] POST /identity/v3/endpoints => generated 331 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:12:25.534446 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848bfd1-179f-445a-a165-abd436d6bf8a None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:25.534951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848bfd1-179f-445a-a165-abd436d6bf8a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:25.535379 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848bfd1-179f-445a-a165-abd436d6bf8a None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:25.541484 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5ecff-e3c8-4554-b926-6b794d3e184d None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:25.541932 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5ecff-e3c8-4554-b926-6b794d3e184d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:25.542409 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5ecff-e3c8-4554-b926-6b794d3e184d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:25.545603 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 657/1307] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:12:25 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:12:25.629589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-c0b5ecff-e3c8-4554-b926-6b794d3e184d None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:12:25.630935 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c0b5ecff-e3c8-4554-b926-6b794d3e184d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:25.736809 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 651/1308] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:12:25.786610 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2c513-6912-4763-9950-3b146d7ec64e None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:25.786891 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2c513-6912-4763-9950-3b146d7ec64e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:25.787165 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2c513-6912-4763-9950-3b146d7ec64e None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:25.788541 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 658/1309] 10.222.0.76 () {54 vars in 964 bytes} [Mon May 16 15:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:12:25.794556 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b976e66-0598-4190-9824-68e207b8599c None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:25.794968 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b976e66-0598-4190-9824-68e207b8599c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:25.795318 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b976e66-0598-4190-9824-68e207b8599c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:25.870345 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9b976e66-0598-4190-9824-68e207b8599c None None] MFA Rules not processed for user `15ff90527ece4406be62f449bdf71d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:12:25.872235 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9b976e66-0598-4190-9824-68e207b8599c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:25.952331 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 652/1310] 10.222.0.76 () {58 vars in 1061 bytes} [Mon May 16 15:12:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:12:25.961280 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2c513-6912-4763-9950-3b146d7ec64e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:12:25.963151 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c7a2c513-6912-4763-9950-3b146d7ec64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:26.069761 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2c513-6912-4763-9950-3b146d7ec64e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:12:26.143299 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841c44d-ef81-4db6-9680-e6e85cc6e26a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:12:26.143877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841c44d-ef81-4db6-9680-e6e85cc6e26a service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:26.144164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841c44d-ef81-4db6-9680-e6e85cc6e26a service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:26.144430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841c44d-ef81-4db6-9680-e6e85cc6e26a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:26.146109 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8841c44d-ef81-4db6-9680-e6e85cc6e26a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:26.258485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841c44d-ef81-4db6-9680-e6e85cc6e26a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:12:26.259922 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841c44d-ef81-4db6-9680-e6e85cc6e26a service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:12:26.279065 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 659/1311] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:12:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:12:28.805808 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de427aa-2089-4df4-809a-63fc3f137f67 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:28.806362 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de427aa-2089-4df4-809a-63fc3f137f67 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:28.806478 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de427aa-2089-4df4-809a-63fc3f137f67 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:28.807958 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 653/1312] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:12:28.813095 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34d442-a379-4932-abcf-ba4d2c64d421 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:28.813566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34d442-a379-4932-abcf-ba4d2c64d421 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:28.813687 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34d442-a379-4932-abcf-ba4d2c64d421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:28.882219 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ff34d442-a379-4932-abcf-ba4d2c64d421 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:12:28.883430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ff34d442-a379-4932-abcf-ba4d2c64d421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:28.990156 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 660/1313] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:12:29.027574 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de427aa-2089-4df4-809a-63fc3f137f67 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:12:29.030018 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6de427aa-2089-4df4-809a-63fc3f137f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:29.130120 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de427aa-2089-4df4-809a-63fc3f137f67 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:12:29.207410 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037bcbd-2c3b-4d6b-8c16-cdcababd865e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:12:29.208080 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037bcbd-2c3b-4d6b-8c16-cdcababd865e service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:29.208359 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037bcbd-2c3b-4d6b-8c16-cdcababd865e service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:29.208637 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037bcbd-2c3b-4d6b-8c16-cdcababd865e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:29.210348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c037bcbd-2c3b-4d6b-8c16-cdcababd865e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:29.327056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037bcbd-2c3b-4d6b-8c16-cdcababd865e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:12:29.328717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037bcbd-2c3b-4d6b-8c16-cdcababd865e service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:12:29.348054 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 654/1314] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:12:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:12:32.215848 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd275d-3831-4a12-a23c-6a799f72dc5b None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:32.216335 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd275d-3831-4a12-a23c-6a799f72dc5b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:32.216335 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd275d-3831-4a12-a23c-6a799f72dc5b None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:32.217717 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 661/1315] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:12:32.223092 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41394f-d160-4834-934b-eceea94c5037 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:32.223521 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41394f-d160-4834-934b-eceea94c5037 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:32.223652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41394f-d160-4834-934b-eceea94c5037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:32.285983 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-6a41394f-d160-4834-934b-eceea94c5037 None None] MFA Rules not processed for user `f5d2bf1ef38b459e901ca8c53d1dc02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:12:32.287142 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6a41394f-d160-4834-934b-eceea94c5037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:32.379482 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 655/1316] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:12:32 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:12:32.418588 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd275d-3831-4a12-a23c-6a799f72dc5b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:12:32.420144 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ffcd275d-3831-4a12-a23c-6a799f72dc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:32.521281 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd275d-3831-4a12-a23c-6a799f72dc5b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:12:32.601973 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94da6a-3388-4166-aea2-6eaef4c246b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:12:32.602645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94da6a-3388-4166-aea2-6eaef4c246b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:32.602926 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94da6a-3388-4166-aea2-6eaef4c246b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:32.603200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94da6a-3388-4166-aea2-6eaef4c246b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:32.604808 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7c94da6a-3388-4166-aea2-6eaef4c246b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:32.709639 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94da6a-3388-4166-aea2-6eaef4c246b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:12:32.711124 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94da6a-3388-4166-aea2-6eaef4c246b2 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:12:32.729278 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 662/1317] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:12:32 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:12:35.756946 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b02d6-edf5-4ee2-a80e-941077ead324 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:35.757495 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b02d6-edf5-4ee2-a80e-941077ead324 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:35.757495 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b02d6-edf5-4ee2-a80e-941077ead324 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:35.758938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 656/1318] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:12:35.764572 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52307c-47f5-4981-a1d6-029e6fa4b7ca None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:35.764996 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52307c-47f5-4981-a1d6-029e6fa4b7ca None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:35.765120 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52307c-47f5-4981-a1d6-029e6fa4b7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:35.828039 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-3c52307c-47f5-4981-a1d6-029e6fa4b7ca None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:12:35.829239 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3c52307c-47f5-4981-a1d6-029e6fa4b7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:35.926071 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 663/1319] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:12:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:12:35.985374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb250b3-75a8-47c6-bd39-db5756fe7656 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:35.985684 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb250b3-75a8-47c6-bd39-db5756fe7656 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:35.985965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb250b3-75a8-47c6-bd39-db5756fe7656 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:35.987369 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 657/1320] 10.222.0.76 () {54 vars in 964 bytes} [Mon May 16 15:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:12:35.993506 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b307c76-fac1-411c-832d-3748aa055a4b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:35.993791 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b307c76-fac1-411c-832d-3748aa055a4b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:35.994065 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b307c76-fac1-411c-832d-3748aa055a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:36.067360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7b307c76-fac1-411c-832d-3748aa055a4b None None] MFA Rules not processed for user `15ff90527ece4406be62f449bdf71d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:12:36.068560 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7b307c76-fac1-411c-832d-3748aa055a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:36.140916 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 664/1321] 10.222.0.76 () {58 vars in 1061 bytes} [Mon May 16 15:12:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:12:36.150335 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb250b3-75a8-47c6-bd39-db5756fe7656 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:12:36.151824 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6bb250b3-75a8-47c6-bd39-db5756fe7656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:36.250729 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb250b3-75a8-47c6-bd39-db5756fe7656 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:12:36.320772 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ede8f-5e4a-465c-9203-a0d34941b873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:12:36.321438 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ede8f-5e4a-465c-9203-a0d34941b873 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:36.321723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ede8f-5e4a-465c-9203-a0d34941b873 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:36.322007 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ede8f-5e4a-465c-9203-a0d34941b873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:36.323690 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-068ede8f-5e4a-465c-9203-a0d34941b873 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:36.433220 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ede8f-5e4a-465c-9203-a0d34941b873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:12:36.435297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ede8f-5e4a-465c-9203-a0d34941b873 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:12:36.452492 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 658/1322] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:12:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:12:40.113613 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b47ca-9743-43a9-9159-400b70b2fa49 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:40.114218 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b47ca-9743-43a9-9159-400b70b2fa49 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:40.114218 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b47ca-9743-43a9-9159-400b70b2fa49 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:40.115571 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 665/1323] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:12:40.120923 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568d9d8-cf19-421a-b3b6-bdefcf868604 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:40.121349 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568d9d8-cf19-421a-b3b6-bdefcf868604 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:40.121678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568d9d8-cf19-421a-b3b6-bdefcf868604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:40.184170 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5568d9d8-cf19-421a-b3b6-bdefcf868604 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:12:40.185359 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5568d9d8-cf19-421a-b3b6-bdefcf868604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:40.277862 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 659/1324] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:12:40.313732 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b47ca-9743-43a9-9159-400b70b2fa49 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:12:40.315313 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c53b47ca-9743-43a9-9159-400b70b2fa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:40.414778 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b47ca-9743-43a9-9159-400b70b2fa49 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:12:40.487484 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d86cf3-6e23-45ed-8ca2-63dabe286ae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:12:40.488138 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d86cf3-6e23-45ed-8ca2-63dabe286ae5 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:40.488422 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d86cf3-6e23-45ed-8ca2-63dabe286ae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:40.488699 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d86cf3-6e23-45ed-8ca2-63dabe286ae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:40.490356 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b6d86cf3-6e23-45ed-8ca2-63dabe286ae5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:40.597368 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d86cf3-6e23-45ed-8ca2-63dabe286ae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:12:40.598925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d86cf3-6e23-45ed-8ca2-63dabe286ae5 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:12:40.616952 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 666/1325] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:12:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:12:42.895313 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9763536-a18a-411f-b881-974343fdfb44 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:42.895873 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9763536-a18a-411f-b881-974343fdfb44 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:42.895873 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9763536-a18a-411f-b881-974343fdfb44 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:42.897411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 660/1326] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:12:42.902463 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35df4b6-41cf-427a-950f-d564c598da06 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:42.902857 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35df4b6-41cf-427a-950f-d564c598da06 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:42.903021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35df4b6-41cf-427a-950f-d564c598da06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:42.968407 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c35df4b6-41cf-427a-950f-d564c598da06 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:12:42.969605 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c35df4b6-41cf-427a-950f-d564c598da06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:43.062017 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 667/1327] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:12:43.097141 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9763536-a18a-411f-b881-974343fdfb44 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:12:43.098714 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e9763536-a18a-411f-b881-974343fdfb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:43.198308 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9763536-a18a-411f-b881-974343fdfb44 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:12:43.268257 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16941442-3bbb-4903-b38e-efde5029a751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:12:43.268897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16941442-3bbb-4903-b38e-efde5029a751 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:43.269177 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16941442-3bbb-4903-b38e-efde5029a751 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:43.269450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16941442-3bbb-4903-b38e-efde5029a751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:43.271117 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-16941442-3bbb-4903-b38e-efde5029a751 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:43.373934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16941442-3bbb-4903-b38e-efde5029a751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:12:43.375674 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16941442-3bbb-4903-b38e-efde5029a751 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:12:43.392957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 661/1328] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:12:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:12:45.675164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad510bf-d79c-4878-adc6-19587f4a9bde None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:45.675750 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad510bf-d79c-4878-adc6-19587f4a9bde None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:45.675750 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad510bf-d79c-4878-adc6-19587f4a9bde None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:45.677076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 668/1329] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:12:45.682187 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483ffd7-86d1-4875-8627-a9058aa3d5f9 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:45.682619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483ffd7-86d1-4875-8627-a9058aa3d5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:45.682751 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483ffd7-86d1-4875-8627-a9058aa3d5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:45.745856 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9483ffd7-86d1-4875-8627-a9058aa3d5f9 None None] MFA Rules not processed for user `f5d2bf1ef38b459e901ca8c53d1dc02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:12:45.747111 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9483ffd7-86d1-4875-8627-a9058aa3d5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:45.838531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 662/1330] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:12:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:12:45.875535 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad510bf-d79c-4878-adc6-19587f4a9bde None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:12:45.877043 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2ad510bf-d79c-4878-adc6-19587f4a9bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:45.977973 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad510bf-d79c-4878-adc6-19587f4a9bde None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:12:46.050766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c135695-0a4f-489a-b36f-a790810f9a8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:12:46.051422 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c135695-0a4f-489a-b36f-a790810f9a8e service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:46.051701 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c135695-0a4f-489a-b36f-a790810f9a8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:46.051971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c135695-0a4f-489a-b36f-a790810f9a8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:46.053600 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5c135695-0a4f-489a-b36f-a790810f9a8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:46.160303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c135695-0a4f-489a-b36f-a790810f9a8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:12:46.161753 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c135695-0a4f-489a-b36f-a790810f9a8e service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:12:46.178876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 669/1331] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:12:45 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:12:48.841162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3ac61-f8de-4e1a-9939-37b9513e90cc None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:48.841675 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3ac61-f8de-4e1a-9939-37b9513e90cc None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:48.841763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3ac61-f8de-4e1a-9939-37b9513e90cc None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:48.843133 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 663/1332] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:12:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:12:48.848969 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2fa5b-e159-46d7-b516-74c90744aae1 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:48.849437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2fa5b-e159-46d7-b516-74c90744aae1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:48.849542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2fa5b-e159-46d7-b516-74c90744aae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:48.913003 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-90b2fa5b-e159-46d7-b516-74c90744aae1 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:12:48.914175 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-90b2fa5b-e159-46d7-b516-74c90744aae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:49.009169 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 670/1333] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:12:49.049651 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3ac61-f8de-4e1a-9939-37b9513e90cc None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:12:49.051306 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2cc3ac61-f8de-4e1a-9939-37b9513e90cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:49.164668 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3ac61-f8de-4e1a-9939-37b9513e90cc None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:12:49.245620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d18700-af8a-432e-96e5-46f84df3c510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:12:49.246343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d18700-af8a-432e-96e5-46f84df3c510 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:49.246625 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d18700-af8a-432e-96e5-46f84df3c510 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:49.246900 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d18700-af8a-432e-96e5-46f84df3c510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:49.248542 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-84d18700-af8a-432e-96e5-46f84df3c510 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:49.353868 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d18700-af8a-432e-96e5-46f84df3c510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:12:49.355380 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d18700-af8a-432e-96e5-46f84df3c510 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:12:49.373426 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 664/1334] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:12:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:12:51.656686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c748aae-0925-4ed5-900b-5b2a1dfbb16b None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:51.657219 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c748aae-0925-4ed5-900b-5b2a1dfbb16b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:51.657219 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c748aae-0925-4ed5-900b-5b2a1dfbb16b None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:51.658652 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 671/1335] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:12:51.663823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c301a-25ea-451b-8449-1f3e7809f25c None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:51.664265 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c301a-25ea-451b-8449-1f3e7809f25c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:51.664373 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c301a-25ea-451b-8449-1f3e7809f25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:51.728257 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-aa4c301a-25ea-451b-8449-1f3e7809f25c None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:12:51.729464 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-aa4c301a-25ea-451b-8449-1f3e7809f25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:51.822695 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 665/1336] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:12:51.862896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c748aae-0925-4ed5-900b-5b2a1dfbb16b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:12:51.864429 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7c748aae-0925-4ed5-900b-5b2a1dfbb16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:51.963195 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c748aae-0925-4ed5-900b-5b2a1dfbb16b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:12:52.034984 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0c768-58c4-4f3e-974f-d3d1abef7f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:12:52.035500 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0c768-58c4-4f3e-974f-d3d1abef7f44 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:52.035712 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0c768-58c4-4f3e-974f-d3d1abef7f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:52.035992 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0c768-58c4-4f3e-974f-d3d1abef7f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:52.037638 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-69f0c768-58c4-4f3e-974f-d3d1abef7f44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:52.145523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0c768-58c4-4f3e-974f-d3d1abef7f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:12:52.147010 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0c768-58c4-4f3e-974f-d3d1abef7f44 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:12:52.164832 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 672/1337] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:12:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:12:55.157672 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae2faa-24b0-4edb-a54f-44b908345f8e None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:55.158262 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae2faa-24b0-4edb-a54f-44b908345f8e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:55.158262 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae2faa-24b0-4edb-a54f-44b908345f8e None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:55.159611 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 666/1338] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:12:55.164902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03104ff4-8b8c-4d2c-b3aa-07528c64e892 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:55.165305 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03104ff4-8b8c-4d2c-b3aa-07528c64e892 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:55.165451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03104ff4-8b8c-4d2c-b3aa-07528c64e892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:55.230975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-03104ff4-8b8c-4d2c-b3aa-07528c64e892 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:12:55.232139 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-03104ff4-8b8c-4d2c-b3aa-07528c64e892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:55.332710 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 673/1339] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:12:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:12:55.367796 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae2faa-24b0-4edb-a54f-44b908345f8e None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:12:55.369343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b6ae2faa-24b0-4edb-a54f-44b908345f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:55.467193 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae2faa-24b0-4edb-a54f-44b908345f8e None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:12:55.552011 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4c89f-d5d9-44f3-b5d3-2af52872bd4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:12:55.552763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4c89f-d5d9-44f3-b5d3-2af52872bd4d service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:12:55.553096 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4c89f-d5d9-44f3-b5d3-2af52872bd4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:12:55.553419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4c89f-d5d9-44f3-b5d3-2af52872bd4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:12:55.556553 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f4e4c89f-d5d9-44f3-b5d3-2af52872bd4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:12:55.668690 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4c89f-d5d9-44f3-b5d3-2af52872bd4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:12:55.670152 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4c89f-d5d9-44f3-b5d3-2af52872bd4d service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:12:55.687620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 667/1340] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:12:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:13:00.119508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c6426-b556-4f1b-a5ce-a6a3352c1be7 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:00.120038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c6426-b556-4f1b-a5ce-a6a3352c1be7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:00.120151 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c6426-b556-4f1b-a5ce-a6a3352c1be7 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:00.121969 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 674/1341] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:13:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:00.127510 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2916d6-e1bf-479c-b127-1885b2491128 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:00.127973 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2916d6-e1bf-479c-b127-1885b2491128 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:00.128137 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2916d6-e1bf-479c-b127-1885b2491128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:00.195355 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-4b2916d6-e1bf-479c-b127-1885b2491128 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:00.196439 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4b2916d6-e1bf-479c-b127-1885b2491128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:00.297301 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 668/1342] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:00.339418 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c6426-b556-4f1b-a5ce-a6a3352c1be7 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:00.341599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3f3c6426-b556-4f1b-a5ce-a6a3352c1be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:00.434743 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c6426-b556-4f1b-a5ce-a6a3352c1be7 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:00.438388 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55265476-6548-45c6-b74c-c8e65afb9915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:00.439033 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55265476-6548-45c6-b74c-c8e65afb9915 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:00.439316 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55265476-6548-45c6-b74c-c8e65afb9915 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:00.439592 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55265476-6548-45c6-b74c-c8e65afb9915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:00.448592 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55265476-6548-45c6-b74c-c8e65afb9915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:00.450015 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55265476-6548-45c6-b74c-c8e65afb9915 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:00.459401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 675/1343] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:13:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:13:03.710543 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf5731-a353-4d6b-a084-2274a37d5716 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:03.711097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf5731-a353-4d6b-a084-2274a37d5716 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:03.711097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf5731-a353-4d6b-a084-2274a37d5716 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:03.712448 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 669/1344] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:03.717725 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a0055-1a3c-4fd3-8d51-337e8afcb639 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:03.720936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a0055-1a3c-4fd3-8d51-337e8afcb639 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:03.720936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a0055-1a3c-4fd3-8d51-337e8afcb639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:03.746763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-847a0055-1a3c-4fd3-8d51-337e8afcb639 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:03.747973 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-847a0055-1a3c-4fd3-8d51-337e8afcb639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:03.823584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 676/1345] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:13:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:03.860757 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf5731-a353-4d6b-a084-2274a37d5716 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:03.871930 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf5731-a353-4d6b-a084-2274a37d5716 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:03.875775 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f8c5f-a2c6-488c-9fc6-012cfd4d08b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:03.876487 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f8c5f-a2c6-488c-9fc6-012cfd4d08b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:03.876842 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f8c5f-a2c6-488c-9fc6-012cfd4d08b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:03.877190 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f8c5f-a2c6-488c-9fc6-012cfd4d08b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:03.887013 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f8c5f-a2c6-488c-9fc6-012cfd4d08b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:03.888452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f8c5f-a2c6-488c-9fc6-012cfd4d08b0 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:03.898223 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 670/1346] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:13:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:13:08.385565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28aa1b-5dd9-4d91-9452-14bac4cd5746 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:08.386148 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28aa1b-5dd9-4d91-9452-14bac4cd5746 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:08.386148 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28aa1b-5dd9-4d91-9452-14bac4cd5746 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:08.387541 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 677/1347] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:08.393016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02064f-e580-4233-b462-b210ac04bedd None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:08.393405 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02064f-e580-4233-b462-b210ac04bedd None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:08.393569 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02064f-e580-4233-b462-b210ac04bedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:08.412688 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-bf02064f-e580-4233-b462-b210ac04bedd None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:08.413879 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-bf02064f-e580-4233-b462-b210ac04bedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:08.422500 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 671/1348] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:13:08.459195 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28aa1b-5dd9-4d91-9452-14bac4cd5746 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:08.470202 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28aa1b-5dd9-4d91-9452-14bac4cd5746 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:08.473611 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709accb-a665-4d45-8be1-e779b0e32e6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:08.474276 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709accb-a665-4d45-8be1-e779b0e32e6d service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:08.474553 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709accb-a665-4d45-8be1-e779b0e32e6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:08.474829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709accb-a665-4d45-8be1-e779b0e32e6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:08.483820 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709accb-a665-4d45-8be1-e779b0e32e6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:08.485344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709accb-a665-4d45-8be1-e779b0e32e6d service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:08.494805 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 678/1349] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:13:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:13:13.937831 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0f549-4223-4c22-b6b2-fede888cde47 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:13.938355 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0f549-4223-4c22-b6b2-fede888cde47 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:13.938435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0f549-4223-4c22-b6b2-fede888cde47 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:13.940058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 672/1350] 10.222.0.76 () {54 vars in 921 bytes} [Mon May 16 15:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:13.945372 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8eb47-f8a2-40ef-893c-0fbafbd8e5d3 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:13.945813 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8eb47-f8a2-40ef-893c-0fbafbd8e5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:13.945920 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8eb47-f8a2-40ef-893c-0fbafbd8e5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:14.018755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e0c8eb47-f8a2-40ef-893c-0fbafbd8e5d3 None None] MFA Rules not processed for user `1f231aa78ac84054b06a2126e1a11f31`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:14.020182 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e0c8eb47-f8a2-40ef-893c-0fbafbd8e5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:14.129859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 679/1351] 10.222.0.76 () {58 vars in 1018 bytes} [Mon May 16 15:13:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:18.449384 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a78db6-7e49-48c5-97ac-a4f5fc73f59e None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:18.449944 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a78db6-7e49-48c5-97ac-a4f5fc73f59e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:18.449944 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a78db6-7e49-48c5-97ac-a4f5fc73f59e None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:18.451533 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 673/1352] 10.222.0.76 () {54 vars in 921 bytes} [Mon May 16 15:13:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:18.456719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b508a-98f5-4e3f-9f24-298540d767fe None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:18.457748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b508a-98f5-4e3f-9f24-298540d767fe None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:18.458321 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b508a-98f5-4e3f-9f24-298540d767fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:18.477102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-798b508a-98f5-4e3f-9f24-298540d767fe None None] MFA Rules not processed for user `1f231aa78ac84054b06a2126e1a11f31`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:18.478341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-798b508a-98f5-4e3f-9f24-298540d767fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:18.487146 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 680/1353] 10.222.0.76 () {58 vars in 1018 bytes} [Mon May 16 15:13:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:19.989139 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b9249-1fd8-4fa0-ad0b-e077891915cf None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:19.989718 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b9249-1fd8-4fa0-ad0b-e077891915cf None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:19.989718 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b9249-1fd8-4fa0-ad0b-e077891915cf None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:19.991154 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 674/1354] 10.222.0.76 () {54 vars in 921 bytes} [Mon May 16 15:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:19.996275 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38833a2-70f1-4fe8-9d72-a5b30b20e91e None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:19.996703 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38833a2-70f1-4fe8-9d72-a5b30b20e91e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:20.000221 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38833a2-70f1-4fe8-9d72-a5b30b20e91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:20.016229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e38833a2-70f1-4fe8-9d72-a5b30b20e91e None None] MFA Rules not processed for user `1f231aa78ac84054b06a2126e1a11f31`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:20.017466 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e38833a2-70f1-4fe8-9d72-a5b30b20e91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:20.026041 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 681/1355] 10.222.0.76 () {58 vars in 1018 bytes} [Mon May 16 15:13:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:23.986352 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a052fcc-6eaf-47c3-a1be-1230ba580438 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:23.986924 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a052fcc-6eaf-47c3-a1be-1230ba580438 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:23.987202 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a052fcc-6eaf-47c3-a1be-1230ba580438 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:23.988665 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 675/1356] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:23.993893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28df6a-1dd6-4b4c-9acb-581f6415f6ee None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:23.994355 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28df6a-1dd6-4b4c-9acb-581f6415f6ee None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:23.994541 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28df6a-1dd6-4b4c-9acb-581f6415f6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:24.013432 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-fa28df6a-1dd6-4b4c-9acb-581f6415f6ee None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:24.014778 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fa28df6a-1dd6-4b4c-9acb-581f6415f6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:24.026119 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 682/1357] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:24.074808 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67ba9a-a932-4c12-83d0-92a69dd25d1c None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:24.075242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67ba9a-a932-4c12-83d0-92a69dd25d1c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:24.075624 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67ba9a-a932-4c12-83d0-92a69dd25d1c None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:24.077259 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 676/1358] 10.222.0.76 () {54 vars in 961 bytes} [Mon May 16 15:13:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:24.082694 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fe83b-7b4e-497c-a11e-98dabf894bd7 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:24.083142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fe83b-7b4e-497c-a11e-98dabf894bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:24.083516 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fe83b-7b4e-497c-a11e-98dabf894bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:24.133036 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-877fe83b-7b4e-497c-a11e-98dabf894bd7 None None] MFA Rules not processed for user `9d85024f010c40129d79543b3ec4cfae`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:24.134468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-877fe83b-7b4e-497c-a11e-98dabf894bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:24.220748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 683/1359] 10.222.0.76 () {58 vars in 1058 bytes} [Mon May 16 15:13:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:24.228856 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67ba9a-a932-4c12-83d0-92a69dd25d1c None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:24.273758 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67ba9a-a932-4c12-83d0-92a69dd25d1c None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:24.273758 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a330e-bb70-4dc5-a2e1-5fc4520b784b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:24.273758 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a330e-bb70-4dc5-a2e1-5fc4520b784b service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:24.273758 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a330e-bb70-4dc5-a2e1-5fc4520b784b service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:24.274201 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a330e-bb70-4dc5-a2e1-5fc4520b784b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:24.274201 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a330e-bb70-4dc5-a2e1-5fc4520b784b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:24.274201 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a330e-bb70-4dc5-a2e1-5fc4520b784b service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:24.274201 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 677/1360] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:13:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:13:26.719541 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101666f1-ea4d-4951-a642-077f2309666a None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:26.720098 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101666f1-ea4d-4951-a642-077f2309666a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:26.720214 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101666f1-ea4d-4951-a642-077f2309666a None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:26.721803 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 684/1361] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:26.727189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3156582-3d2e-4277-8ef5-6f3c7f046f53 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:26.727613 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3156582-3d2e-4277-8ef5-6f3c7f046f53 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:26.727742 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3156582-3d2e-4277-8ef5-6f3c7f046f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:26.745547 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d3156582-3d2e-4277-8ef5-6f3c7f046f53 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:26.746838 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d3156582-3d2e-4277-8ef5-6f3c7f046f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:26.755127 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 678/1362] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:26.798666 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101666f1-ea4d-4951-a642-077f2309666a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:26.813362 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101666f1-ea4d-4951-a642-077f2309666a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:26.818909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d481d-5878-4174-bfef-1c3d51a4751a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:26.819531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d481d-5878-4174-bfef-1c3d51a4751a service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:26.819810 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d481d-5878-4174-bfef-1c3d51a4751a service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:26.820083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d481d-5878-4174-bfef-1c3d51a4751a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:26.828453 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d481d-5878-4174-bfef-1c3d51a4751a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:26.830054 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d481d-5878-4174-bfef-1c3d51a4751a service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:26.839701 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 685/1363] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:13:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:13:29.568224 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8622d66-843b-4a17-8602-4e756ff756c2 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:29.568724 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8622d66-843b-4a17-8602-4e756ff756c2 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:29.568840 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8622d66-843b-4a17-8602-4e756ff756c2 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:29.570178 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 679/1364] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:29.577253 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366fdd8-4549-4340-8993-27795fee5074 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:29.577713 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366fdd8-4549-4340-8993-27795fee5074 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:29.578811 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366fdd8-4549-4340-8993-27795fee5074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:29.599371 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7366fdd8-4549-4340-8993-27795fee5074 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:29.600947 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7366fdd8-4549-4340-8993-27795fee5074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:29.610215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 686/1365] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:29.657035 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ac032-83d5-4a21-829e-3f920d802102 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:29.657323 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ac032-83d5-4a21-829e-3f920d802102 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:29.657603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ac032-83d5-4a21-829e-3f920d802102 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:29.659012 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 680/1366] 10.222.0.76 () {54 vars in 961 bytes} [Mon May 16 15:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:29.664450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f5d95-2980-45f3-a140-8f7ffbeac2dd None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:29.664762 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f5d95-2980-45f3-a140-8f7ffbeac2dd None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:29.665040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f5d95-2980-45f3-a140-8f7ffbeac2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:29.684156 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a22f5d95-2980-45f3-a140-8f7ffbeac2dd None None] MFA Rules not processed for user `9d85024f010c40129d79543b3ec4cfae`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:29.685343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a22f5d95-2980-45f3-a140-8f7ffbeac2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:29.694653 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 687/1367] 10.222.0.76 () {58 vars in 1058 bytes} [Mon May 16 15:13:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:13:29.702182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ac032-83d5-4a21-829e-3f920d802102 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:29.716277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ac032-83d5-4a21-829e-3f920d802102 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:29.721642 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a2a5e-13da-4346-9c4c-2c6b4f8a52fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:29.722299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a2a5e-13da-4346-9c4c-2c6b4f8a52fe service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:29.722576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a2a5e-13da-4346-9c4c-2c6b4f8a52fe service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:29.722844 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a2a5e-13da-4346-9c4c-2c6b4f8a52fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:29.731123 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a2a5e-13da-4346-9c4c-2c6b4f8a52fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:29.732689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a2a5e-13da-4346-9c4c-2c6b4f8a52fe service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:29.741719 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 681/1368] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:13:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:13:32.136765 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebb995-649e-4ea2-83d0-90ae32bd0bc4 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:32.137651 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebb995-649e-4ea2-83d0-90ae32bd0bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:32.137930 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebb995-649e-4ea2-83d0-90ae32bd0bc4 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:32.139440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 688/1369] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:13:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:32.145594 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0e2df-5a89-43fb-85ad-2528804a2f73 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:32.146172 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0e2df-5a89-43fb-85ad-2528804a2f73 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:32.146540 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0e2df-5a89-43fb-85ad-2528804a2f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:32.165947 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-05e0e2df-5a89-43fb-85ad-2528804a2f73 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:32.168041 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-05e0e2df-5a89-43fb-85ad-2528804a2f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:32.176934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 682/1370] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:32.231275 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebb995-649e-4ea2-83d0-90ae32bd0bc4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:32.245998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebb995-649e-4ea2-83d0-90ae32bd0bc4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:32.251811 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e962dd6-2a16-4230-bee7-20fc81d85430 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:32.252475 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e962dd6-2a16-4230-bee7-20fc81d85430 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:32.252760 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e962dd6-2a16-4230-bee7-20fc81d85430 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:32.253040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e962dd6-2a16-4230-bee7-20fc81d85430 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:32.261568 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e962dd6-2a16-4230-bee7-20fc81d85430 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:32.263241 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e962dd6-2a16-4230-bee7-20fc81d85430 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:32.272958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 689/1371] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:13:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:13:32.314521 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe639dc9-6b88-43c1-bab1-77607d12f7ed None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:32.314720 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe639dc9-6b88-43c1-bab1-77607d12f7ed None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:32.314990 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe639dc9-6b88-43c1-bab1-77607d12f7ed None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:32.316521 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 683/1372] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:32.321993 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e66eb-a069-4378-b5e3-944fe7d18a05 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:32.322322 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e66eb-a069-4378-b5e3-944fe7d18a05 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:32.322608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e66eb-a069-4378-b5e3-944fe7d18a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:32.340996 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-8f4e66eb-a069-4378-b5e3-944fe7d18a05 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:32.342319 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8f4e66eb-a069-4378-b5e3-944fe7d18a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:32.350535 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 690/1373] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:32.675346 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ed259-2450-4725-8ff3-4c69cbf1c2f3 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:32.675346 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ed259-2450-4725-8ff3-4c69cbf1c2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:32.675346 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ed259-2450-4725-8ff3-4c69cbf1c2f3 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:32.677707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 684/1374] 10.222.0.76 () {54 vars in 963 bytes} [Mon May 16 15:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:32.681791 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2079e24-8c59-4f56-8345-26494b93841c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:32.682078 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2079e24-8c59-4f56-8345-26494b93841c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:32.682988 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2079e24-8c59-4f56-8345-26494b93841c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:32.734335 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f2079e24-8c59-4f56-8345-26494b93841c None None] MFA Rules not processed for user `496e1178104d468e9b7ce53ea754ec74`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:32.736687 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f2079e24-8c59-4f56-8345-26494b93841c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:32.802291 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 691/1375] 10.222.0.76 () {58 vars in 1060 bytes} [Mon May 16 15:13:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:32.808978 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ed259-2450-4725-8ff3-4c69cbf1c2f3 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:32.819802 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ed259-2450-4725-8ff3-4c69cbf1c2f3 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:32.823583 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70115019-f050-4f7b-89ef-e3a2176c908e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:32.824221 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70115019-f050-4f7b-89ef-e3a2176c908e service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:32.824499 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70115019-f050-4f7b-89ef-e3a2176c908e service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:32.824773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70115019-f050-4f7b-89ef-e3a2176c908e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:32.834854 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70115019-f050-4f7b-89ef-e3a2176c908e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:32.836404 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70115019-f050-4f7b-89ef-e3a2176c908e service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:32.848660 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 685/1376] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:13:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:13:34.669825 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ababd-651b-4062-ad00-a899bf7df717 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:34.670464 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ababd-651b-4062-ad00-a899bf7df717 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:34.670464 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ababd-651b-4062-ad00-a899bf7df717 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:34.671806 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 692/1377] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:34.677643 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3ff9e-f2a3-45e1-b37e-6d325251f6ff None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:34.678288 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3ff9e-f2a3-45e1-b37e-6d325251f6ff None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:34.678288 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3ff9e-f2a3-45e1-b37e-6d325251f6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:34.696970 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-3ed3ff9e-f2a3-45e1-b37e-6d325251f6ff None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:34.698220 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3ed3ff9e-f2a3-45e1-b37e-6d325251f6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:34.706361 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 686/1378] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:34.752033 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ababd-651b-4062-ad00-a899bf7df717 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:34.766647 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ababd-651b-4062-ad00-a899bf7df717 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:34.772616 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2f4b4-9c41-4ab2-aa9e-fbb237bd6f13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:34.773427 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2f4b4-9c41-4ab2-aa9e-fbb237bd6f13 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:34.773791 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2f4b4-9c41-4ab2-aa9e-fbb237bd6f13 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:34.774070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2f4b4-9c41-4ab2-aa9e-fbb237bd6f13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:34.783360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2f4b4-9c41-4ab2-aa9e-fbb237bd6f13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:34.785074 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2f4b4-9c41-4ab2-aa9e-fbb237bd6f13 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:34.794560 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 693/1379] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:13:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:13:37.371731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48262e-5644-4229-b8f5-63a3a9e3328c None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:37.372303 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48262e-5644-4229-b8f5-63a3a9e3328c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:37.372714 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48262e-5644-4229-b8f5-63a3a9e3328c None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:37.374724 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 687/1380] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:13:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:37.380422 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce06ae1-615a-46ed-8c64-6a83ac2e7008 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:37.380869 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce06ae1-615a-46ed-8c64-6a83ac2e7008 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:37.381071 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce06ae1-615a-46ed-8c64-6a83ac2e7008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:37.403460 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-4ce06ae1-615a-46ed-8c64-6a83ac2e7008 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:37.405173 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4ce06ae1-615a-46ed-8c64-6a83ac2e7008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:37.415380 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 694/1381] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:37.466648 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48262e-5644-4229-b8f5-63a3a9e3328c None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:37.484826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48262e-5644-4229-b8f5-63a3a9e3328c None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:37.491274 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4dc10b-eae8-49fb-b7bd-0d48e4d94dfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:37.492164 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dc10b-eae8-49fb-b7bd-0d48e4d94dfd service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:37.492643 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dc10b-eae8-49fb-b7bd-0d48e4d94dfd service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:37.493121 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dc10b-eae8-49fb-b7bd-0d48e4d94dfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:37.502615 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4dc10b-eae8-49fb-b7bd-0d48e4d94dfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:37.504660 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4dc10b-eae8-49fb-b7bd-0d48e4d94dfd service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:37.514906 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 688/1382] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:13:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:13:39.921386 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525fff5-27a6-4ce7-8de8-c1f0b920ed6a None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:39.921955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525fff5-27a6-4ce7-8de8-c1f0b920ed6a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:39.921955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525fff5-27a6-4ce7-8de8-c1f0b920ed6a None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:39.923354 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 695/1383] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:39.929095 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b155414-b0a1-4617-a4e2-6e64f5714947 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:39.929533 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b155414-b0a1-4617-a4e2-6e64f5714947 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:39.929645 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b155414-b0a1-4617-a4e2-6e64f5714947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:39.948286 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0b155414-b0a1-4617-a4e2-6e64f5714947 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:39.950261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0b155414-b0a1-4617-a4e2-6e64f5714947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:39.960005 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 689/1384] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:40.003116 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525fff5-27a6-4ce7-8de8-c1f0b920ed6a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:40.017915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525fff5-27a6-4ce7-8de8-c1f0b920ed6a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:40.023518 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b265b-637b-4697-b2e5-76d3f9457baf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:40.024299 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b265b-637b-4697-b2e5-76d3f9457baf service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:40.024645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b265b-637b-4697-b2e5-76d3f9457baf service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:40.024988 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b265b-637b-4697-b2e5-76d3f9457baf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:40.034292 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b265b-637b-4697-b2e5-76d3f9457baf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:40.035987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b265b-637b-4697-b2e5-76d3f9457baf service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:40.046336 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 696/1385] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:13:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:13:42.806169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67c132-9541-46c0-9e5b-682705b5091a None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:42.806728 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67c132-9541-46c0-9e5b-682705b5091a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:42.806885 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67c132-9541-46c0-9e5b-682705b5091a None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:42.808864 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 690/1386] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:13:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:13:42.815209 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818b671-c287-4ac5-ac44-5da0ff739c52 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:42.815673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818b671-c287-4ac5-ac44-5da0ff739c52 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:42.815822 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818b671-c287-4ac5-ac44-5da0ff739c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:42.835777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6818b671-c287-4ac5-ac44-5da0ff739c52 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:42.837024 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6818b671-c287-4ac5-ac44-5da0ff739c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:42.845766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 697/1387] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:13:42.889654 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67c132-9541-46c0-9e5b-682705b5091a None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:42.907741 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67c132-9541-46c0-9e5b-682705b5091a None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:42.915420 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f82f23-58a9-4b9c-9f52-e3b668355756 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:42.916515 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f82f23-58a9-4b9c-9f52-e3b668355756 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:42.916982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f82f23-58a9-4b9c-9f52-e3b668355756 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:42.917344 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f82f23-58a9-4b9c-9f52-e3b668355756 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:42.930931 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f82f23-58a9-4b9c-9f52-e3b668355756 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:42.932963 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f82f23-58a9-4b9c-9f52-e3b668355756 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:42.948678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 691/1388] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:13:45.661095 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018700e-14b2-4ed6-8b2a-12c8fbb02002 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:45.665389 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018700e-14b2-4ed6-8b2a-12c8fbb02002 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:45.665389 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018700e-14b2-4ed6-8b2a-12c8fbb02002 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:45.665389 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 698/1389] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:45.670321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fddc83-329a-4758-a0ce-c5d7434043f1 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:45.670795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fddc83-329a-4758-a0ce-c5d7434043f1 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:45.670946 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fddc83-329a-4758-a0ce-c5d7434043f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:45.690622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a1fddc83-329a-4758-a0ce-c5d7434043f1 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:45.691840 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a1fddc83-329a-4758-a0ce-c5d7434043f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:45.700337 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 692/1390] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:45.746267 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018700e-14b2-4ed6-8b2a-12c8fbb02002 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:45.764719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018700e-14b2-4ed6-8b2a-12c8fbb02002 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:45.771994 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c219c1-c615-40bc-badd-e4b940a89c49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:45.772773 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c219c1-c615-40bc-badd-e4b940a89c49 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:45.773363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c219c1-c615-40bc-badd-e4b940a89c49 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:45.773707 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c219c1-c615-40bc-badd-e4b940a89c49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:45.784164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c219c1-c615-40bc-badd-e4b940a89c49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:45.786240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c219c1-c615-40bc-badd-e4b940a89c49 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:45.798797 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 699/1391] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:13:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:13:48.233332 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bf290-dd63-49a4-985f-a02c4573e9a6 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:48.233940 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bf290-dd63-49a4-985f-a02c4573e9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:48.233940 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bf290-dd63-49a4-985f-a02c4573e9a6 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:48.235672 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 693/1392] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:48.241532 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b00c5-c748-4589-8c12-791a45d08d33 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:48.241955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b00c5-c748-4589-8c12-791a45d08d33 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:48.242214 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b00c5-c748-4589-8c12-791a45d08d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:48.260633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6f4b00c5-c748-4589-8c12-791a45d08d33 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:48.261817 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6f4b00c5-c748-4589-8c12-791a45d08d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:48.269879 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 700/1393] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:48.313172 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bf290-dd63-49a4-985f-a02c4573e9a6 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:48.327404 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bf290-dd63-49a4-985f-a02c4573e9a6 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:48.332688 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52bbe3-275a-4662-86ef-d7b545054a54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:48.333313 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52bbe3-275a-4662-86ef-d7b545054a54 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:48.333591 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52bbe3-275a-4662-86ef-d7b545054a54 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:48.333863 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52bbe3-275a-4662-86ef-d7b545054a54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:48.342554 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52bbe3-275a-4662-86ef-d7b545054a54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:48.344186 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52bbe3-275a-4662-86ef-d7b545054a54 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:48.353525 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 694/1394] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:13:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:13:49.060351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0f348-08cf-41fc-ac50-ef088d3306b7 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:49.060667 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0f348-08cf-41fc-ac50-ef088d3306b7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:49.060921 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0f348-08cf-41fc-ac50-ef088d3306b7 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:49.062380 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 701/1395] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:49.067508 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004077f9-092d-40cb-9f89-2a961573f7af None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:49.067805 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004077f9-092d-40cb-9f89-2a961573f7af None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:49.068086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004077f9-092d-40cb-9f89-2a961573f7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:49.085415 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-004077f9-092d-40cb-9f89-2a961573f7af None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:49.086718 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-004077f9-092d-40cb-9f89-2a961573f7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:49.094568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 695/1396] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:49.149835 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9bdf8-9cc1-40ba-8e33-41289db0c650 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:49.150232 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9bdf8-9cc1-40ba-8e33-41289db0c650 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:49.151090 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9bdf8-9cc1-40ba-8e33-41289db0c650 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:49.152556 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 702/1397] 10.222.0.76 () {54 vars in 962 bytes} [Mon May 16 15:13:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:49.157502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ed492-f3a7-4774-b046-2b086082495f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:49.157796 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ed492-f3a7-4774-b046-2b086082495f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:49.158079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ed492-f3a7-4774-b046-2b086082495f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:49.205505 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-805ed492-f3a7-4774-b046-2b086082495f None None] MFA Rules not processed for user `2d1e67aa4370453fafb5b6525ba13cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:49.206849 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-805ed492-f3a7-4774-b046-2b086082495f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:49.264483 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 696/1398] 10.222.0.76 () {58 vars in 1059 bytes} [Mon May 16 15:13:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:49.271984 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9bdf8-9cc1-40ba-8e33-41289db0c650 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:49.282489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9bdf8-9cc1-40ba-8e33-41289db0c650 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:49.286052 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffd6e6-0a31-4444-9db5-5fa5c7f74889 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1e67aa4370453fafb5b6525ba13cd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:49.286818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffd6e6-0a31-4444-9db5-5fa5c7f74889 service glance] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:49.287147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffd6e6-0a31-4444-9db5-5fa5c7f74889 service glance] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:49.287511 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffd6e6-0a31-4444-9db5-5fa5c7f74889 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:49.300975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffd6e6-0a31-4444-9db5-5fa5c7f74889 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:49.302526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffd6e6-0a31-4444-9db5-5fa5c7f74889 service glance] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:49.312641 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 703/1399] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:13:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:13:49.894873 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3df064-36f3-4276-ab08-22dfc900ec30 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:49.895165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3df064-36f3-4276-ab08-22dfc900ec30 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:49.895474 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3df064-36f3-4276-ab08-22dfc900ec30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:49.945521 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5a3df064-36f3-4276-ab08-22dfc900ec30 None None] MFA Rules not processed for user `1a7181297bf14a57b3bf1f3c8b178d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:49.946741 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5a3df064-36f3-4276-ab08-22dfc900ec30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:50.009910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 697/1400] 10.222.0.76 () {58 vars in 1009 bytes} [Mon May 16 15:13:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:50.055681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d25b4c-1642-4217-a6d5-3f7ef73be61f None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:50.055976 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d25b4c-1642-4217-a6d5-3f7ef73be61f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:50.056256 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d25b4c-1642-4217-a6d5-3f7ef73be61f None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:50.057652 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 704/1401] 10.222.0.76 () {54 vars in 942 bytes} [Mon May 16 15:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:50.063947 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7294211-a52c-46f4-86b6-56272ebb4829 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:50.065059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7294211-a52c-46f4-86b6-56272ebb4829 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:50.065523 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7294211-a52c-46f4-86b6-56272ebb4829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:50.113388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-c7294211-a52c-46f4-86b6-56272ebb4829 None None] MFA Rules not processed for user `33470e30760842ca9e96bb7f0cf9f07d`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:50.114687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c7294211-a52c-46f4-86b6-56272ebb4829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:50.184168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 698/1402] 10.222.0.76 () {58 vars in 1039 bytes} [Mon May 16 15:13:50 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:50.193472 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d25b4c-1642-4217-a6d5-3f7ef73be61f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:50.206566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d25b4c-1642-4217-a6d5-3f7ef73be61f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:50.211654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbbedd-8135-47b6-8025-29cd6d1dc9c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33470e30760842ca9e96bb7f0cf9f07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:50.212293 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbbedd-8135-47b6-8025-29cd6d1dc9c2 service swift] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:50.212573 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbbedd-8135-47b6-8025-29cd6d1dc9c2 service swift] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:50.212849 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbbedd-8135-47b6-8025-29cd6d1dc9c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:50.221544 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbbedd-8135-47b6-8025-29cd6d1dc9c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:50.223187 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbbedd-8135-47b6-8025-29cd6d1dc9c2 service swift] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:50.231734 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 705/1403] 10.222.0.76 () {60 vars in 1384 bytes} [Mon May 16 15:13:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:13:50.725278 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932e7bd-17eb-43a1-a4c3-164e8fb89dbf None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:50.726205 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932e7bd-17eb-43a1-a4c3-164e8fb89dbf None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:50.726493 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932e7bd-17eb-43a1-a4c3-164e8fb89dbf None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:50.727877 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 699/1404] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:13:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:50.733143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a31ef-8457-4f2c-84db-bab578af32bc None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:50.733577 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a31ef-8457-4f2c-84db-bab578af32bc None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:50.733702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a31ef-8457-4f2c-84db-bab578af32bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:50.753370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9f1a31ef-8457-4f2c-84db-bab578af32bc None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:50.754620 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9f1a31ef-8457-4f2c-84db-bab578af32bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:50.771448 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 706/1405] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:50.806213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932e7bd-17eb-43a1-a4c3-164e8fb89dbf None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:50.824610 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932e7bd-17eb-43a1-a4c3-164e8fb89dbf None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:50.830415 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785638d-b9fb-421a-a414-405fe0c0bc06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:50.831183 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785638d-b9fb-421a-a414-405fe0c0bc06 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:50.831468 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785638d-b9fb-421a-a414-405fe0c0bc06 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:50.831749 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785638d-b9fb-421a-a414-405fe0c0bc06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:50.841078 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785638d-b9fb-421a-a414-405fe0c0bc06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:50.842501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785638d-b9fb-421a-a414-405fe0c0bc06 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:50.852760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 700/1406] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:13:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:13:53.358887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f93d35-340b-43a6-bb14-26307bafb074 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:53.359442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f93d35-340b-43a6-bb14-26307bafb074 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:53.359591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f93d35-340b-43a6-bb14-26307bafb074 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:53.361260 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 707/1407] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:53.367019 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52929e25-376f-4290-bb36-76860d405c66 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:53.367488 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52929e25-376f-4290-bb36-76860d405c66 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:53.367585 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52929e25-376f-4290-bb36-76860d405c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:53.387439 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-52929e25-376f-4290-bb36-76860d405c66 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:53.389416 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-52929e25-376f-4290-bb36-76860d405c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:53.398007 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 701/1408] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:53.442236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f93d35-340b-43a6-bb14-26307bafb074 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:53.457998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f93d35-340b-43a6-bb14-26307bafb074 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:53.464273 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19821d18-1991-4f93-959e-6dcc894ef1e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:53.465187 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19821d18-1991-4f93-959e-6dcc894ef1e1 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:53.465472 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19821d18-1991-4f93-959e-6dcc894ef1e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:53.465744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19821d18-1991-4f93-959e-6dcc894ef1e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:53.474232 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19821d18-1991-4f93-959e-6dcc894ef1e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:53.475909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19821d18-1991-4f93-959e-6dcc894ef1e1 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:53.486374 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 708/1409] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:13:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:14:14.696521 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86507126-fc6b-40b0-8f8a-554019f2f869 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:14.697689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86507126-fc6b-40b0-8f8a-554019f2f869 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:14.697689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86507126-fc6b-40b0-8f8a-554019f2f869 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:14.699058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 702/1410] 10.222.0.76 () {54 vars in 918 bytes} [Mon May 16 15:14:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:14:14.704132 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908572b-4c79-47f9-b67a-b51e481c2f04 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:14.704584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908572b-4c79-47f9-b67a-b51e481c2f04 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:14.704678 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908572b-4c79-47f9-b67a-b51e481c2f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:14.724474 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9908572b-4c79-47f9-b67a-b51e481c2f04 None None] MFA Rules not processed for user `1f231aa78ac84054b06a2126e1a11f31`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:14:14.725672 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9908572b-4c79-47f9-b67a-b51e481c2f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:14:14.734048 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 709/1411] 10.222.0.76 () {58 vars in 1015 bytes} [Mon May 16 15:14:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:14:14.748636 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e18f35-1400-45f1-8b48-3c0280424b81 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:14.748927 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e18f35-1400-45f1-8b48-3c0280424b81 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:14.749209 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e18f35-1400-45f1-8b48-3c0280424b81 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:14.750847 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 703/1412] 10.222.0.76 () {54 vars in 918 bytes} [Mon May 16 15:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:14:14.755359 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7cd5a-5319-4df7-b108-a79971843bef None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:14.755647 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7cd5a-5319-4df7-b108-a79971843bef None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:14.755925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7cd5a-5319-4df7-b108-a79971843bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:14.773889 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6cf7cd5a-5319-4df7-b108-a79971843bef None None] MFA Rules not processed for user `9d85024f010c40129d79543b3ec4cfae`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:14:14.775136 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6cf7cd5a-5319-4df7-b108-a79971843bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:14:14.784115 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 710/1413] 10.222.0.76 () {58 vars in 1015 bytes} [Mon May 16 15:14:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:14:17.438720 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23369d-b2af-4537-83ef-1886f1fab855 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:17.439335 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23369d-b2af-4537-83ef-1886f1fab855 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:17.439335 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23369d-b2af-4537-83ef-1886f1fab855 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:17.440687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:14:17.446269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc946e8-dd43-4d02-86b9-8197a26a0b7d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:17.447254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc946e8-dd43-4d02-86b9-8197a26a0b7d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:17.447373 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc946e8-dd43-4d02-86b9-8197a26a0b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:17.465029 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-8bc946e8-dd43-4d02-86b9-8197a26a0b7d None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:14:17.466251 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8bc946e8-dd43-4d02-86b9-8197a26a0b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:14:17.473991 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:14:17.515015 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23369d-b2af-4537-83ef-1886f1fab855 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:14:17.529339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23369d-b2af-4537-83ef-1886f1fab855 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:14:17.534890 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceac182-7f18-4b53-9b3c-47d6c9c7e200 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:14:17.535517 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceac182-7f18-4b53-9b3c-47d6c9c7e200 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:17.535794 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceac182-7f18-4b53-9b3c-47d6c9c7e200 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:17.536067 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceac182-7f18-4b53-9b3c-47d6c9c7e200 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:17.547333 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceac182-7f18-4b53-9b3c-47d6c9c7e200 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:14:17.549588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceac182-7f18-4b53-9b3c-47d6c9c7e200 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:14:17.559483 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 705/1416] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:14:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:14:18.541486 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d5328-1d40-4940-9381-7becd5f3545e None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:18.542059 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d5328-1d40-4940-9381-7becd5f3545e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:18.542059 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d5328-1d40-4940-9381-7becd5f3545e None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:18.543435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 15:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:14:18.548358 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a5a83-ecfe-452e-a92d-16bb4b6a038d None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:18.548767 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a5a83-ecfe-452e-a92d-16bb4b6a038d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:18.548919 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a5a83-ecfe-452e-a92d-16bb4b6a038d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:18.567097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a38a5a83-ecfe-452e-a92d-16bb4b6a038d None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:14:18.568277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a38a5a83-ecfe-452e-a92d-16bb4b6a038d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:14:18.576697 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 15:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:14:18.730099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d5328-1d40-4940-9381-7becd5f3545e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:14:18.744820 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d5328-1d40-4940-9381-7becd5f3545e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:14:18.750433 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2df07-b12c-4784-9978-49f757b151de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:14:18.751067 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2df07-b12c-4784-9978-49f757b151de service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:18.751348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2df07-b12c-4784-9978-49f757b151de service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:18.751633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2df07-b12c-4784-9978-49f757b151de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:18.760321 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2df07-b12c-4784-9978-49f757b151de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:14:18.763006 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2df07-b12c-4784-9978-49f757b151de service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:14:18.775503 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 713/1419] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:14:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:14:19.716841 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb34922-01ba-4829-bbc0-aaf856fd80c2 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:19.717396 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb34922-01ba-4829-bbc0-aaf856fd80c2 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:19.717396 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb34922-01ba-4829-bbc0-aaf856fd80c2 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:19.718830 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 15:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:14:19.723597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e9686-7eb5-4a2a-839f-04573b9d0ce7 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:19.724017 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e9686-7eb5-4a2a-839f-04573b9d0ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:19.724140 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e9686-7eb5-4a2a-839f-04573b9d0ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:19.741882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-296e9686-7eb5-4a2a-839f-04573b9d0ce7 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:14:19.743152 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-296e9686-7eb5-4a2a-839f-04573b9d0ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:14:19.751523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 15:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:14:19.897665 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb34922-01ba-4829-bbc0-aaf856fd80c2 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:14:19.912662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb34922-01ba-4829-bbc0-aaf856fd80c2 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:14:19.918597 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef4f17-9176-4453-9aed-2207cc0ab635 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:14:19.919234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef4f17-9176-4453-9aed-2207cc0ab635 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:19.919515 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef4f17-9176-4453-9aed-2207cc0ab635 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:19.919791 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef4f17-9176-4453-9aed-2207cc0ab635 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:19.927783 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef4f17-9176-4453-9aed-2207cc0ab635 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:14:19.929366 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef4f17-9176-4453-9aed-2207cc0ab635 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:14:19.938672 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 708/1422] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:14:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:14:20.859950 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082ce50-3a78-4579-9ebe-bb2641fa6519 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:20.860489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082ce50-3a78-4579-9ebe-bb2641fa6519 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:20.860489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082ce50-3a78-4579-9ebe-bb2641fa6519 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:20.861889 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 15:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:14:20.866794 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c943175-93be-42b2-80ac-ce1e9411c835 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:20.867243 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c943175-93be-42b2-80ac-ce1e9411c835 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:20.867351 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c943175-93be-42b2-80ac-ce1e9411c835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:20.885136 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-1c943175-93be-42b2-80ac-ce1e9411c835 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:14:20.886386 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1c943175-93be-42b2-80ac-ce1e9411c835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:14:20.894027 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 15:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:14:21.044184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082ce50-3a78-4579-9ebe-bb2641fa6519 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:14:21.058232 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082ce50-3a78-4579-9ebe-bb2641fa6519 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:14:21.063578 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542a92b-3d17-4164-984b-ef30c01551d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:14:21.064202 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542a92b-3d17-4164-984b-ef30c01551d1 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:21.064481 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542a92b-3d17-4164-984b-ef30c01551d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:21.064754 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542a92b-3d17-4164-984b-ef30c01551d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:21.073219 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542a92b-3d17-4164-984b-ef30c01551d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:14:21.074841 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542a92b-3d17-4164-984b-ef30c01551d1 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:14:21.083966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 716/1425] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:14:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:14:22.011261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca79e0-fea2-4ffc-8355-9ad34a96c607 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:22.011832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca79e0-fea2-4ffc-8355-9ad34a96c607 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:22.011832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca79e0-fea2-4ffc-8355-9ad34a96c607 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:22.013188 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 15:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:14:22.018030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2587db4-73f6-4683-81fc-b70ed351cfbd None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:22.018500 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2587db4-73f6-4683-81fc-b70ed351cfbd None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:22.018616 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2587db4-73f6-4683-81fc-b70ed351cfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:22.036095 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c2587db4-73f6-4683-81fc-b70ed351cfbd None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:14:22.037273 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c2587db4-73f6-4683-81fc-b70ed351cfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:14:22.045414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 15:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:14:22.194695 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca79e0-fea2-4ffc-8355-9ad34a96c607 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:14:22.208595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca79e0-fea2-4ffc-8355-9ad34a96c607 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:14:22.214403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11ae03-a8d2-4234-8b1b-0c72f728b637 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:14:22.215034 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11ae03-a8d2-4234-8b1b-0c72f728b637 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:22.215317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11ae03-a8d2-4234-8b1b-0c72f728b637 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:22.215595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11ae03-a8d2-4234-8b1b-0c72f728b637 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:22.223406 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11ae03-a8d2-4234-8b1b-0c72f728b637 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:14:22.224996 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11ae03-a8d2-4234-8b1b-0c72f728b637 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:14:22.234668 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 711/1428] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:14:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:14:23.248370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbe91a-806b-4df2-9bac-1f2a0f9d19af None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:23.248943 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbe91a-806b-4df2-9bac-1f2a0f9d19af None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:23.248943 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbe91a-806b-4df2-9bac-1f2a0f9d19af None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:23.250627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 15:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:14:23.255686 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212cee4-0db8-4d21-99db-aa18c32ea1a4 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:23.256133 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212cee4-0db8-4d21-99db-aa18c32ea1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:23.256244 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212cee4-0db8-4d21-99db-aa18c32ea1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:23.274383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-2212cee4-0db8-4d21-99db-aa18c32ea1a4 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:14:23.275588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2212cee4-0db8-4d21-99db-aa18c32ea1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:14:23.283302 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 15:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:14:23.429988 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbe91a-806b-4df2-9bac-1f2a0f9d19af None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:14:23.444300 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbe91a-806b-4df2-9bac-1f2a0f9d19af None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:14:23.450662 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0781385-4984-4fbb-b61f-dc76aefc9eb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:14:23.451302 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0781385-4984-4fbb-b61f-dc76aefc9eb0 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:23.451695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0781385-4984-4fbb-b61f-dc76aefc9eb0 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:23.451980 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0781385-4984-4fbb-b61f-dc76aefc9eb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:23.460176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0781385-4984-4fbb-b61f-dc76aefc9eb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:14:23.461794 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0781385-4984-4fbb-b61f-dc76aefc9eb0 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:14:23.471598 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 719/1431] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:14:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:14:24.420604 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727599a-35bb-4e70-9cae-2ffe4fda84ee None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:24.421124 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727599a-35bb-4e70-9cae-2ffe4fda84ee None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:24.421239 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727599a-35bb-4e70-9cae-2ffe4fda84ee None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:24.422576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 15:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:14:24.427577 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d39657-5e24-42a1-8658-39992637063f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:24.427993 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d39657-5e24-42a1-8658-39992637063f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:24.428127 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d39657-5e24-42a1-8658-39992637063f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:24.446304 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-d8d39657-5e24-42a1-8658-39992637063f None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:14:24.447568 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d8d39657-5e24-42a1-8658-39992637063f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:14:24.455302 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 15:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:14:24.604833 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727599a-35bb-4e70-9cae-2ffe4fda84ee None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:14:24.618626 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727599a-35bb-4e70-9cae-2ffe4fda84ee None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:14:24.623846 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6664ae2-6030-4d41-8be6-9571d06552c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:14:24.624467 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6664ae2-6030-4d41-8be6-9571d06552c8 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:24.624815 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6664ae2-6030-4d41-8be6-9571d06552c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:24.625343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6664ae2-6030-4d41-8be6-9571d06552c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:24.633360 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6664ae2-6030-4d41-8be6-9571d06552c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:14:24.634976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6664ae2-6030-4d41-8be6-9571d06552c8 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:14:24.645749 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 714/1434] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:14:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:14:25.604279 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b790d-df39-479f-8023-392a90626f8d None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:25.604843 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b790d-df39-479f-8023-392a90626f8d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:25.604843 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b790d-df39-479f-8023-392a90626f8d None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:25.606205 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 15:14:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:14:25.611129 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1130f32-9bd3-4513-b60f-cb7f0904a7cc None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:25.611570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1130f32-9bd3-4513-b60f-cb7f0904a7cc None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:25.611686 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1130f32-9bd3-4513-b60f-cb7f0904a7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:25.630244 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-b1130f32-9bd3-4513-b60f-cb7f0904a7cc None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:14:25.631436 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b1130f32-9bd3-4513-b60f-cb7f0904a7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:14:25.639622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 15:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:14:25.789741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b790d-df39-479f-8023-392a90626f8d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:14:25.804779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b790d-df39-479f-8023-392a90626f8d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:14:25.810963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd8744-6100-4125-b70e-2b273600248a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:14:25.811597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd8744-6100-4125-b70e-2b273600248a service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:25.811874 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd8744-6100-4125-b70e-2b273600248a service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:25.812144 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd8744-6100-4125-b70e-2b273600248a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:25.820218 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd8744-6100-4125-b70e-2b273600248a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:14:25.822356 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd8744-6100-4125-b70e-2b273600248a service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:14:25.831540 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 722/1437] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:14:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:14:26.797560 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5bb46-6ef6-4fc7-bdc7-6c272e4676c8 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:26.798110 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5bb46-6ef6-4fc7-bdc7-6c272e4676c8 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:26.798110 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5bb46-6ef6-4fc7-bdc7-6c272e4676c8 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:26.799510 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 15:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:14:26.804307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73061fde-43c7-49ae-a459-b2de5b8743df None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:26.804737 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73061fde-43c7-49ae-a459-b2de5b8743df None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:26.804866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73061fde-43c7-49ae-a459-b2de5b8743df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:26.822606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-73061fde-43c7-49ae-a459-b2de5b8743df None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:14:26.823790 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-73061fde-43c7-49ae-a459-b2de5b8743df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:14:26.831554 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 15:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:14:26.992679 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5bb46-6ef6-4fc7-bdc7-6c272e4676c8 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:14:27.007144 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5bb46-6ef6-4fc7-bdc7-6c272e4676c8 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:14:27.012569 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14233048-8445-4d41-b047-80e560cbdbba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:14:27.013204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14233048-8445-4d41-b047-80e560cbdbba service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:27.013486 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14233048-8445-4d41-b047-80e560cbdbba service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:27.013763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14233048-8445-4d41-b047-80e560cbdbba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:27.021721 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14233048-8445-4d41-b047-80e560cbdbba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:14:27.023381 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14233048-8445-4d41-b047-80e560cbdbba service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:14:27.032972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 717/1440] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:14:29.122012 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa584ac1-bc68-4410-b7c5-4588588d3d4a None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:29.122618 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa584ac1-bc68-4410-b7c5-4588588d3d4a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:29.122618 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa584ac1-bc68-4410-b7c5-4588588d3d4a None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:29.123964 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:14:29.129653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c0669-8ca1-408b-8ebe-2d881f7c0639 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:29.130055 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c0669-8ca1-408b-8ebe-2d881f7c0639 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:29.130249 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c0669-8ca1-408b-8ebe-2d881f7c0639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:29.147375 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-818c0669-8ca1-408b-8ebe-2d881f7c0639 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:14:29.148564 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-818c0669-8ca1-408b-8ebe-2d881f7c0639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:14:29.156791 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:14:29.194207 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa584ac1-bc68-4410-b7c5-4588588d3d4a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:14:29.205472 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa584ac1-bc68-4410-b7c5-4588588d3d4a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:14:29.208993 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90c5ab-8db8-4c1b-9fad-20c553c5e3f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:14:29.209623 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90c5ab-8db8-4c1b-9fad-20c553c5e3f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:29.209905 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90c5ab-8db8-4c1b-9fad-20c553c5e3f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:29.210218 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90c5ab-8db8-4c1b-9fad-20c553c5e3f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:29.219440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90c5ab-8db8-4c1b-9fad-20c553c5e3f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:14:29.220874 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90c5ab-8db8-4c1b-9fad-20c553c5e3f5 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:14:29.230730 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 725/1443] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:14:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:14:31.598238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22699f4-3f46-420c-b2a5-bb5d080996c8 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:31.598683 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22699f4-3f46-420c-b2a5-bb5d080996c8 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:31.598788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22699f4-3f46-420c-b2a5-bb5d080996c8 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:31.600141 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:14:31.605597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c49dc7-2ebc-4987-85db-fd873b8c7646 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:31.606033 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c49dc7-2ebc-4987-85db-fd873b8c7646 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:31.606167 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c49dc7-2ebc-4987-85db-fd873b8c7646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:31.623727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-81c49dc7-2ebc-4987-85db-fd873b8c7646 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:14:31.625180 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-81c49dc7-2ebc-4987-85db-fd873b8c7646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:14:31.633072 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:14:31.671038 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22699f4-3f46-420c-b2a5-bb5d080996c8 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:14:31.681503 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22699f4-3f46-420c-b2a5-bb5d080996c8 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:14:31.685013 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018411f2-2283-4426-91bb-fab2d3b4fb50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:14:31.685642 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018411f2-2283-4426-91bb-fab2d3b4fb50 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:31.685923 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018411f2-2283-4426-91bb-fab2d3b4fb50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:31.686236 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018411f2-2283-4426-91bb-fab2d3b4fb50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:31.694812 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018411f2-2283-4426-91bb-fab2d3b4fb50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:14:31.696862 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018411f2-2283-4426-91bb-fab2d3b4fb50 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:14:31.705919 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 720/1446] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:14:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:14:34.270505 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaec317-ed49-4f83-b568-1ec4ddaef981 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:34.271037 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaec317-ed49-4f83-b568-1ec4ddaef981 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:34.271037 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaec317-ed49-4f83-b568-1ec4ddaef981 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:34.272456 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:14:34.277878 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002651a-b2d2-4fb5-a133-6464fe1381a1 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:34.278309 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002651a-b2d2-4fb5-a133-6464fe1381a1 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:34.278478 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002651a-b2d2-4fb5-a133-6464fe1381a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:34.295658 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-f002651a-b2d2-4fb5-a133-6464fe1381a1 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:14:34.296841 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f002651a-b2d2-4fb5-a133-6464fe1381a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:14:34.304860 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:14:34.343177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaec317-ed49-4f83-b568-1ec4ddaef981 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:14:34.367396 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaec317-ed49-4f83-b568-1ec4ddaef981 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:14:34.372121 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958c865-20d2-41b0-a4f3-4421448c1a84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:14:34.372853 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958c865-20d2-41b0-a4f3-4421448c1a84 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:34.373146 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958c865-20d2-41b0-a4f3-4421448c1a84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:34.373419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958c865-20d2-41b0-a4f3-4421448c1a84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:34.383266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958c865-20d2-41b0-a4f3-4421448c1a84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:14:34.385380 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958c865-20d2-41b0-a4f3-4421448c1a84 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:14:34.394786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 728/1449] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:14:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:14:36.730235 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a9960-a896-447c-a1d4-c961ea6a6624 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:36.730849 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a9960-a896-447c-a1d4-c961ea6a6624 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:36.730849 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a9960-a896-447c-a1d4-c961ea6a6624 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:36.732170 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:14:36.737433 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e2ec0-0342-4dc7-b2b7-fd8f03646085 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:36.737852 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e2ec0-0342-4dc7-b2b7-fd8f03646085 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:36.737967 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e2ec0-0342-4dc7-b2b7-fd8f03646085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:36.755966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c29e2ec0-0342-4dc7-b2b7-fd8f03646085 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:14:36.757142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c29e2ec0-0342-4dc7-b2b7-fd8f03646085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:14:36.765403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:14:36.802816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a9960-a896-447c-a1d4-c961ea6a6624 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:14:36.813784 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a9960-a896-447c-a1d4-c961ea6a6624 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:14:36.817282 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469e76c-0cc9-4e0a-9747-bbd96dd3d3c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:14:36.817909 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469e76c-0cc9-4e0a-9747-bbd96dd3d3c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:36.818225 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469e76c-0cc9-4e0a-9747-bbd96dd3d3c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:36.818506 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469e76c-0cc9-4e0a-9747-bbd96dd3d3c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:36.827139 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469e76c-0cc9-4e0a-9747-bbd96dd3d3c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:14:36.828570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469e76c-0cc9-4e0a-9747-bbd96dd3d3c2 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:14:36.837750 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 723/1452] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:14:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:14:39.133771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44f860-2eb6-4a95-ad9e-9dc83f99941e None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:39.134378 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44f860-2eb6-4a95-ad9e-9dc83f99941e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:39.134486 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44f860-2eb6-4a95-ad9e-9dc83f99941e None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:39.135834 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:14:39.141015 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d38315-a915-4add-a9ad-6aa9a615c693 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:39.141439 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d38315-a915-4add-a9ad-6aa9a615c693 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:39.141565 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d38315-a915-4add-a9ad-6aa9a615c693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:39.158877 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-11d38315-a915-4add-a9ad-6aa9a615c693 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:14:39.160072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-11d38315-a915-4add-a9ad-6aa9a615c693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:14:39.168382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:14:39.205411 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44f860-2eb6-4a95-ad9e-9dc83f99941e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:14:39.216162 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44f860-2eb6-4a95-ad9e-9dc83f99941e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:14:39.219590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c181232-476e-4649-b467-ea1e54d074e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:14:39.220217 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c181232-476e-4649-b467-ea1e54d074e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:39.220501 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c181232-476e-4649-b467-ea1e54d074e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:39.220771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c181232-476e-4649-b467-ea1e54d074e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:39.229871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c181232-476e-4649-b467-ea1e54d074e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:14:39.231423 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c181232-476e-4649-b467-ea1e54d074e8 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:14:39.240591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 731/1455] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:14:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:14:41.534539 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b020e-108f-45c7-b3b1-54b632864da3 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:41.535103 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b020e-108f-45c7-b3b1-54b632864da3 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:41.535103 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b020e-108f-45c7-b3b1-54b632864da3 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:41.536464 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:14:41.541818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc57dee-2649-4811-bfdd-23d3608ec633 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:41.542261 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc57dee-2649-4811-bfdd-23d3608ec633 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:41.542415 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc57dee-2649-4811-bfdd-23d3608ec633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:41.559658 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-2cc57dee-2649-4811-bfdd-23d3608ec633 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:14:41.560844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2cc57dee-2649-4811-bfdd-23d3608ec633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:14:41.568691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:14:41.606166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b020e-108f-45c7-b3b1-54b632864da3 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:14:41.616526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b020e-108f-45c7-b3b1-54b632864da3 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:14:41.619955 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2f3cc-4fe5-40e5-8d3b-03e16612f184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:14:41.620579 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2f3cc-4fe5-40e5-8d3b-03e16612f184 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:41.620856 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2f3cc-4fe5-40e5-8d3b-03e16612f184 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:41.621129 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2f3cc-4fe5-40e5-8d3b-03e16612f184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:41.629874 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2f3cc-4fe5-40e5-8d3b-03e16612f184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:14:41.631363 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2f3cc-4fe5-40e5-8d3b-03e16612f184 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:14:41.641387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 726/1458] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:14:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:14:43.887139 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e47a3-fce0-40e8-850a-fd3c238987b6 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:43.887693 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e47a3-fce0-40e8-850a-fd3c238987b6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:43.887788 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e47a3-fce0-40e8-850a-fd3c238987b6 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:43.889174 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:14:43.894658 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b82efc-f5bc-4e29-b94d-cbf66b249cd4 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:43.895123 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b82efc-f5bc-4e29-b94d-cbf66b249cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:43.895233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b82efc-f5bc-4e29-b94d-cbf66b249cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:43.913523 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-c8b82efc-f5bc-4e29-b94d-cbf66b249cd4 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:14:43.915286 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c8b82efc-f5bc-4e29-b94d-cbf66b249cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:14:43.923122 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:14:43.960373 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e47a3-fce0-40e8-850a-fd3c238987b6 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:14:43.962646 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7a8e47a3-fce0-40e8-850a-fd3c238987b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:14:43.975257 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e47a3-fce0-40e8-850a-fd3c238987b6 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:14:43.979425 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0336d-572a-4d96-a7c6-a3bcc435b3d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:14:43.980056 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0336d-572a-4d96-a7c6-a3bcc435b3d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:43.980341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0336d-572a-4d96-a7c6-a3bcc435b3d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:43.980619 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0336d-572a-4d96-a7c6-a3bcc435b3d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:43.989313 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0336d-572a-4d96-a7c6-a3bcc435b3d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:14:43.990772 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0336d-572a-4d96-a7c6-a3bcc435b3d7 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:14:44.000260 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 734/1461] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:14:46.292509 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdf856-4abb-45b4-a8a9-0b85a1b0bc43 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:46.293066 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdf856-4abb-45b4-a8a9-0b85a1b0bc43 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:46.293066 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdf856-4abb-45b4-a8a9-0b85a1b0bc43 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:46.294462 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:14:46.299700 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6148d2b-5bb7-4966-a2a1-cac755548319 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:46.300094 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6148d2b-5bb7-4966-a2a1-cac755548319 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:46.300261 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6148d2b-5bb7-4966-a2a1-cac755548319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:46.317414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-d6148d2b-5bb7-4966-a2a1-cac755548319 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:14:46.318642 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d6148d2b-5bb7-4966-a2a1-cac755548319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:14:46.326392 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:14:46.362567 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bdf856-4abb-45b4-a8a9-0b85a1b0bc43 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:14:46.373614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bdf856-4abb-45b4-a8a9-0b85a1b0bc43 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:14:46.377369 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167a2b9-99f4-4415-91e8-91a99f8de871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:14:46.377996 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167a2b9-99f4-4415-91e8-91a99f8de871 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:46.378318 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167a2b9-99f4-4415-91e8-91a99f8de871 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:46.378598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167a2b9-99f4-4415-91e8-91a99f8de871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:46.387975 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167a2b9-99f4-4415-91e8-91a99f8de871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:14:46.389412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167a2b9-99f4-4415-91e8-91a99f8de871 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:14:46.398648 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 729/1464] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:14:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:14:48.582613 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06edb3-643f-4a33-a8c5-2490eeece7a6 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:48.583172 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06edb3-643f-4a33-a8c5-2490eeece7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:48.583172 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06edb3-643f-4a33-a8c5-2490eeece7a6 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:48.584645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:14:48.590149 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d187b-8fd3-4ba8-88a0-7f6de8344e29 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:48.590559 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d187b-8fd3-4ba8-88a0-7f6de8344e29 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:48.590710 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d187b-8fd3-4ba8-88a0-7f6de8344e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:48.611273 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-ac7d187b-8fd3-4ba8-88a0-7f6de8344e29 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:14:48.612456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ac7d187b-8fd3-4ba8-88a0-7f6de8344e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:14:48.620712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:14:48.656974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06edb3-643f-4a33-a8c5-2490eeece7a6 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:14:48.667265 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06edb3-643f-4a33-a8c5-2490eeece7a6 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:14:48.670681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f954e-42d7-4488-a0e5-f01e31062fad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:14:48.671310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f954e-42d7-4488-a0e5-f01e31062fad service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:48.671587 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f954e-42d7-4488-a0e5-f01e31062fad service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:48.671856 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f954e-42d7-4488-a0e5-f01e31062fad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:48.680814 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f954e-42d7-4488-a0e5-f01e31062fad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:14:48.682290 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f954e-42d7-4488-a0e5-f01e31062fad service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:14:48.691225 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 737/1467] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:14:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:14:50.924429 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea09bf-af6f-47c1-9ef2-981ba5d66dc9 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:50.924996 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea09bf-af6f-47c1-9ef2-981ba5d66dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:50.924996 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea09bf-af6f-47c1-9ef2-981ba5d66dc9 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:50.926370 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:14:50.932218 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212829b8-b868-4f5b-b9a0-19b9125af013 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:50.932665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212829b8-b868-4f5b-b9a0-19b9125af013 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:50.932788 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212829b8-b868-4f5b-b9a0-19b9125af013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:50.950791 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-212829b8-b868-4f5b-b9a0-19b9125af013 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:14:50.951987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-212829b8-b868-4f5b-b9a0-19b9125af013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:14:50.959726 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:14:50.995057 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea09bf-af6f-47c1-9ef2-981ba5d66dc9 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:14:51.005582 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea09bf-af6f-47c1-9ef2-981ba5d66dc9 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:14:51.009910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1695385-c668-44bb-8480-5d5a9be95486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:14:51.010590 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1695385-c668-44bb-8480-5d5a9be95486 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:14:51.010874 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1695385-c668-44bb-8480-5d5a9be95486 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:14:51.011153 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1695385-c668-44bb-8480-5d5a9be95486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:14:51.019953 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1695385-c668-44bb-8480-5d5a9be95486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:14:51.021394 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1695385-c668-44bb-8480-5d5a9be95486 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:14:51.030487 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 732/1470] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:14:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:27.813998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16ef47-963d-4a74-b4a0-797279ee6cdf None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:27.814645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16ef47-963d-4a74-b4a0-797279ee6cdf None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:27.814645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16ef47-963d-4a74-b4a0-797279ee6cdf None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:27.816039 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 739/1471] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:15:27.821076 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcc104-223d-49bf-9a9d-e68d76103cc0 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:27.821537 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcc104-223d-49bf-9a9d-e68d76103cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:27.821642 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcc104-223d-49bf-9a9d-e68d76103cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:27.838849 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-7adcc104-223d-49bf-9a9d-e68d76103cc0 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:27.839954 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7adcc104-223d-49bf-9a9d-e68d76103cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:27.847520 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 733/1472] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:27.896432 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b7a33-dd7e-4ae4-a3f7-f27eaa577f47 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:27.896721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b7a33-dd7e-4ae4-a3f7-f27eaa577f47 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:27.896996 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b7a33-dd7e-4ae4-a3f7-f27eaa577f47 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:27.898447 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 740/1473] 10.222.0.76 () {54 vars in 962 bytes} [Mon May 16 15:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:15:27.903062 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc0fa1-42b0-47a9-acaa-f3188fb61cff None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:27.903345 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc0fa1-42b0-47a9-acaa-f3188fb61cff None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:27.903618 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc0fa1-42b0-47a9-acaa-f3188fb61cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:27.921524 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-73dc0fa1-42b0-47a9-acaa-f3188fb61cff None None] MFA Rules not processed for user `2d1e67aa4370453fafb5b6525ba13cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:27.922724 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-73dc0fa1-42b0-47a9-acaa-f3188fb61cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:27.929608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 734/1474] 10.222.0.76 () {58 vars in 1059 bytes} [Mon May 16 15:15:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:27.936465 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b7a33-dd7e-4ae4-a3f7-f27eaa577f47 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:27.946886 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b7a33-dd7e-4ae4-a3f7-f27eaa577f47 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:27.950612 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edeb0b-4469-4fee-884e-a4bae8c8906d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1e67aa4370453fafb5b6525ba13cd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:27.951237 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edeb0b-4469-4fee-884e-a4bae8c8906d service glance] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:27.951551 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edeb0b-4469-4fee-884e-a4bae8c8906d service glance] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:27.951826 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edeb0b-4469-4fee-884e-a4bae8c8906d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:27.960780 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edeb0b-4469-4fee-884e-a4bae8c8906d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:27.962278 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edeb0b-4469-4fee-884e-a4bae8c8906d service glance] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:27.971476 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 741/1475] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:15:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:15:30.280884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c2d0d-159d-4c40-b392-23582521a2be None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:30.281451 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c2d0d-159d-4c40-b392-23582521a2be None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:30.281451 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c2d0d-159d-4c40-b392-23582521a2be None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:30.282868 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 735/1476] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:15:30.288379 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6705af-3213-4715-9cc3-677a1a72e62d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:30.289506 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6705af-3213-4715-9cc3-677a1a72e62d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:30.289506 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6705af-3213-4715-9cc3-677a1a72e62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:30.309887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-fb6705af-3213-4715-9cc3-677a1a72e62d None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:30.311133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fb6705af-3213-4715-9cc3-677a1a72e62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:30.319199 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 742/1477] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:30.342197 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c2d0d-159d-4c40-b392-23582521a2be None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:30.354960 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c2d0d-159d-4c40-b392-23582521a2be None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:30.359388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c09ee-8edc-4ce0-a5e9-d46b2c9df1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:30.360030 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c09ee-8edc-4ce0-a5e9-d46b2c9df1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:30.360343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c09ee-8edc-4ce0-a5e9-d46b2c9df1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:30.360620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c09ee-8edc-4ce0-a5e9-d46b2c9df1f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:30.361353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c09ee-8edc-4ce0-a5e9-d46b2c9df1f6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:30.363163 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: WARNING py.warnings [None req-1f9c09ee-8edc-4ce0-a5e9-d46b2c9df1f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 15:15:30.363163 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: warnings.warn(msg) May 16 15:15:30.363163 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: May 16 15:15:30.364324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c09ee-8edc-4ce0-a5e9-d46b2c9df1f6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:30.383784 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 736/1478] 10.222.0.76 () {56 vars in 1108 bytes} [Mon May 16 15:15:30 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:32.630607 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432bb30-4009-4fe7-a3a3-58fe5bd3a434 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:32.631139 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432bb30-4009-4fe7-a3a3-58fe5bd3a434 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:32.631139 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432bb30-4009-4fe7-a3a3-58fe5bd3a434 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:32.633050 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 743/1479] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:15:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:15:32.638492 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806221b6-5025-4f14-807b-ff740b37d190 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:32.641062 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806221b6-5025-4f14-807b-ff740b37d190 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:32.641062 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806221b6-5025-4f14-807b-ff740b37d190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:32.657064 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-806221b6-5025-4f14-807b-ff740b37d190 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:32.658297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-806221b6-5025-4f14-807b-ff740b37d190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:32.666065 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 737/1480] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:32.712300 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432bb30-4009-4fe7-a3a3-58fe5bd3a434 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:32.726570 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432bb30-4009-4fe7-a3a3-58fe5bd3a434 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:32.731994 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96882a49-43a6-4880-a4fc-fb349e3f8ba1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:32.732627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96882a49-43a6-4880-a4fc-fb349e3f8ba1 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:32.733667 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96882a49-43a6-4880-a4fc-fb349e3f8ba1 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:32.733667 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96882a49-43a6-4880-a4fc-fb349e3f8ba1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:32.741589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96882a49-43a6-4880-a4fc-fb349e3f8ba1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:32.743802 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96882a49-43a6-4880-a4fc-fb349e3f8ba1 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:32.753837 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 744/1481] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:15:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:35.127738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a1e76-6486-4a44-88cd-8acd4fd590b8 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:35.128309 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a1e76-6486-4a44-88cd-8acd4fd590b8 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:35.128309 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a1e76-6486-4a44-88cd-8acd4fd590b8 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:35.129664 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 738/1482] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:15:35.134955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db254f79-7815-4553-a1f9-48c0ed4ac0af None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:35.135403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db254f79-7815-4553-a1f9-48c0ed4ac0af None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:35.135562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db254f79-7815-4553-a1f9-48c0ed4ac0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:35.153451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-db254f79-7815-4553-a1f9-48c0ed4ac0af None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:35.154699 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-db254f79-7815-4553-a1f9-48c0ed4ac0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:35.162463 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 745/1483] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:35.197814 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a1e76-6486-4a44-88cd-8acd4fd590b8 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:35.208230 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a1e76-6486-4a44-88cd-8acd4fd590b8 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:35.212308 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1edd5e-1e45-4c04-addf-b01e2661273f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:35.212967 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1edd5e-1e45-4c04-addf-b01e2661273f service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:35.213251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1edd5e-1e45-4c04-addf-b01e2661273f service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:35.213529 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1edd5e-1e45-4c04-addf-b01e2661273f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:35.222229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1edd5e-1e45-4c04-addf-b01e2661273f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:35.223663 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1edd5e-1e45-4c04-addf-b01e2661273f service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:35.233374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 739/1484] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:15:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:37.502550 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d21c01-d54f-45fd-97a1-1a6b0c9c1072 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:37.503130 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d21c01-d54f-45fd-97a1-1a6b0c9c1072 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:37.503130 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d21c01-d54f-45fd-97a1-1a6b0c9c1072 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:37.504494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 746/1485] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:15:37.510182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada6090-80f7-4931-8a1f-08c70098625b None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:37.510623 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada6090-80f7-4931-8a1f-08c70098625b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:37.510731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada6090-80f7-4931-8a1f-08c70098625b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:37.528123 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-eada6090-80f7-4931-8a1f-08c70098625b None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:37.529412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-eada6090-80f7-4931-8a1f-08c70098625b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:37.537048 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 740/1486] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:37.574641 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d21c01-d54f-45fd-97a1-1a6b0c9c1072 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:37.585502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d21c01-d54f-45fd-97a1-1a6b0c9c1072 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:37.589198 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62db62-7cf9-4ad9-834d-618044ff9585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:37.589865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62db62-7cf9-4ad9-834d-618044ff9585 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:37.590170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62db62-7cf9-4ad9-834d-618044ff9585 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:37.590448 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62db62-7cf9-4ad9-834d-618044ff9585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:37.599372 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62db62-7cf9-4ad9-834d-618044ff9585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:37.600800 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62db62-7cf9-4ad9-834d-618044ff9585 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:37.610608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 747/1487] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:15:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:39.933641 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8dbe7-22e7-4a5e-a3c0-c6501800625a None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:39.934243 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8dbe7-22e7-4a5e-a3c0-c6501800625a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:39.934243 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8dbe7-22e7-4a5e-a3c0-c6501800625a None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:39.935607 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 741/1488] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:15:39.941079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541b6f6-4da7-4f3c-bf9d-ade36575ec21 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:39.941521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541b6f6-4da7-4f3c-bf9d-ade36575ec21 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:39.941665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541b6f6-4da7-4f3c-bf9d-ade36575ec21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:39.959408 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c541b6f6-4da7-4f3c-bf9d-ade36575ec21 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:39.960585 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c541b6f6-4da7-4f3c-bf9d-ade36575ec21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:39.968328 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 748/1489] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:15:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:40.008464 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8dbe7-22e7-4a5e-a3c0-c6501800625a None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:40.018865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8dbe7-22e7-4a5e-a3c0-c6501800625a None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:40.022433 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e5a55-24b8-43cd-9dd4-651c14d3ab40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:40.023165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e5a55-24b8-43cd-9dd4-651c14d3ab40 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:40.023446 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e5a55-24b8-43cd-9dd4-651c14d3ab40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:40.023726 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e5a55-24b8-43cd-9dd4-651c14d3ab40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:40.032495 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e5a55-24b8-43cd-9dd4-651c14d3ab40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:40.033919 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e5a55-24b8-43cd-9dd4-651c14d3ab40 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:40.043532 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 742/1490] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:15:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:42.691968 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0e5a4-6943-4aab-afc8-34a1600956b0 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:42.692527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0e5a4-6943-4aab-afc8-34a1600956b0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:42.692527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0e5a4-6943-4aab-afc8-34a1600956b0 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:42.693895 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 749/1491] 10.222.0.76 () {54 vars in 926 bytes} [Mon May 16 15:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:15:42.699696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf18381-264a-4397-b621-43b5540b807c None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:42.700081 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf18381-264a-4397-b621-43b5540b807c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:42.700282 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf18381-264a-4397-b621-43b5540b807c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:42.717697 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-3cf18381-264a-4397-b621-43b5540b807c None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:42.718941 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3cf18381-264a-4397-b621-43b5540b807c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:42.726779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 743/1492] 10.222.0.76 () {58 vars in 1023 bytes} [Mon May 16 15:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:42.769235 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0e5a4-6943-4aab-afc8-34a1600956b0 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:42.780331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0e5a4-6943-4aab-afc8-34a1600956b0 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:42.783941 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8de4a-78d6-4f21-8f2b-f699fc75b8d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:42.784603 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8de4a-78d6-4f21-8f2b-f699fc75b8d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:42.784887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8de4a-78d6-4f21-8f2b-f699fc75b8d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:42.785164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8de4a-78d6-4f21-8f2b-f699fc75b8d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:42.795783 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8de4a-78d6-4f21-8f2b-f699fc75b8d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:42.797224 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8de4a-78d6-4f21-8f2b-f699fc75b8d8 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:42.807129 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 750/1493] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:15:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:17:21.324367 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e750d0b-cf63-487f-9ca1-53f2b88da88d None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:21.324975 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e750d0b-cf63-487f-9ca1-53f2b88da88d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:21.324975 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e750d0b-cf63-487f-9ca1-53f2b88da88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:21.342396 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-7e750d0b-cf63-487f-9ca1-53f2b88da88d None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:21.343845 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7e750d0b-cf63-487f-9ca1-53f2b88da88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:21.351955 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 744/1494] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:21.361000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fd6ad-0b42-4f89-bdab-5cfa07f44ca6 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:21.361517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fd6ad-0b42-4f89-bdab-5cfa07f44ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:21.361627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fd6ad-0b42-4f89-bdab-5cfa07f44ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:21.379755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-037fd6ad-0b42-4f89-bdab-5cfa07f44ca6 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:21.380916 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-037fd6ad-0b42-4f89-bdab-5cfa07f44ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:21.388669 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 751/1495] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:21.393056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e750d0b-cf63-487f-9ca1-53f2b88da88d None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:21.402931 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e750d0b-cf63-487f-9ca1-53f2b88da88d None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:21.407450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b67a14-4a55-4725-ae15-263995f67fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:21.408094 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b67a14-4a55-4725-ae15-263995f67fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:21.408375 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b67a14-4a55-4725-ae15-263995f67fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:21.408650 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b67a14-4a55-4725-ae15-263995f67fd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:21.409374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b67a14-4a55-4725-ae15-263995f67fd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:17:21.410314 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b67a14-4a55-4725-ae15-263995f67fd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:21.411335 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: WARNING py.warnings [None req-25b67a14-4a55-4725-ae15-263995f67fd1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:17:21.411335 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: warnings.warn(msg) May 16 15:17:21.411335 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: May 16 15:17:21.412214 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b67a14-4a55-4725-ae15-263995f67fd1 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:21.423325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 745/1496] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:17:21.431218 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037fd6ad-0b42-4f89-bdab-5cfa07f44ca6 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:21.440231 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037fd6ad-0b42-4f89-bdab-5cfa07f44ca6 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:21.444987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3721e94-d483-4d1d-a833-f8771e62097e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:21.445641 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3721e94-d483-4d1d-a833-f8771e62097e admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:21.445924 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3721e94-d483-4d1d-a833-f8771e62097e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:21.446242 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3721e94-d483-4d1d-a833-f8771e62097e admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:21.446935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3721e94-d483-4d1d-a833-f8771e62097e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:21.448725 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: WARNING py.warnings [None req-d3721e94-d483-4d1d-a833-f8771e62097e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 15:17:21.448725 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: warnings.warn(msg) May 16 15:17:21.448725 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: May 16 15:17:21.449926 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3721e94-d483-4d1d-a833-f8771e62097e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:21.555192 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 752/1497] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:17:21 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:17:21.559383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b67a14-4a55-4725-ae15-263995f67fd1 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:21.569584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b67a14-4a55-4725-ae15-263995f67fd1 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:21.623525 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf9dde-ecd1-410f-8f95-8ca383c7609c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:21.624194 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf9dde-ecd1-410f-8f95-8ca383c7609c admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:21.624731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf9dde-ecd1-410f-8f95-8ca383c7609c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:21.625009 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf9dde-ecd1-410f-8f95-8ca383c7609c admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:21.625733 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf9dde-ecd1-410f-8f95-8ca383c7609c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:21.626787 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: WARNING py.warnings [None req-e6cf9dde-ecd1-410f-8f95-8ca383c7609c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 15:17:21.626787 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: warnings.warn(msg) May 16 15:17:21.626787 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: May 16 15:17:21.628039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf9dde-ecd1-410f-8f95-8ca383c7609c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:21.734606 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 746/1498] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:17:21 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:17:21.738800 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3721e94-d483-4d1d-a833-f8771e62097e admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:21.748772 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3721e94-d483-4d1d-a833-f8771e62097e admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:21.753957 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48555e22-3a59-4949-81d0-56d92cb58a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:21.754640 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48555e22-3a59-4949-81d0-56d92cb58a14 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:21.754918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48555e22-3a59-4949-81d0-56d92cb58a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:21.755188 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48555e22-3a59-4949-81d0-56d92cb58a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:21.755915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48555e22-3a59-4949-81d0-56d92cb58a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:21.756955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: WARNING py.warnings [None req-48555e22-3a59-4949-81d0-56d92cb58a14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:17:21.756955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: warnings.warn(msg) May 16 15:17:21.756955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: May 16 15:17:21.757823 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48555e22-3a59-4949-81d0-56d92cb58a14 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:21.772094 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 753/1499] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:17:21.776322 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf9dde-ecd1-410f-8f95-8ca383c7609c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:21.785951 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf9dde-ecd1-410f-8f95-8ca383c7609c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:21.790430 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66e53d-1655-4669-a720-f479562abf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:21.791097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66e53d-1655-4669-a720-f479562abf52 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:21.791361 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66e53d-1655-4669-a720-f479562abf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:21.791640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66e53d-1655-4669-a720-f479562abf52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:21.792364 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66e53d-1655-4669-a720-f479562abf52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:21.793373 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: WARNING py.warnings [None req-0a66e53d-1655-4669-a720-f479562abf52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:17:21.793373 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: warnings.warn(msg) May 16 15:17:21.793373 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: May 16 15:17:21.794298 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66e53d-1655-4669-a720-f479562abf52 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:21.807252 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 747/1500] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:17:21.811210 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48555e22-3a59-4949-81d0-56d92cb58a14 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:21.821266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48555e22-3a59-4949-81d0-56d92cb58a14 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:21.825740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a664b-89eb-41cf-8eee-221b7234be58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:21.826631 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a664b-89eb-41cf-8eee-221b7234be58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:21.826912 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a664b-89eb-41cf-8eee-221b7234be58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:21.827184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a664b-89eb-41cf-8eee-221b7234be58 admin admin] PATH_INFO: `/v3/projects/8337e155fd0141dbab05be998628204f/users/6d482f431c5b47aea8342409e4ab99ba/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:21.841797 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a664b-89eb-41cf-8eee-221b7234be58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8337e155fd0141dbab05be998628204f, user_id=6d482f431c5b47aea8342409e4ab99ba, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:21.842810 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: WARNING py.warnings [None req-375a664b-89eb-41cf-8eee-221b7234be58 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 15:17:21.842810 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: warnings.warn(msg) May 16 15:17:21.842810 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: May 16 15:17:21.844731 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a664b-89eb-41cf-8eee-221b7234be58 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:21.961157 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 754/1501] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:17:21 2022] PUT /identity/v3/projects/8337e155fd0141dbab05be998628204f/users/6d482f431c5b47aea8342409e4ab99ba/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:21.972413 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3beebb-b036-4ca3-91a8-66ed3278f421 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:21.972711 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3beebb-b036-4ca3-91a8-66ed3278f421 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:21.972998 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3beebb-b036-4ca3-91a8-66ed3278f421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:21.998840 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-3c3beebb-b036-4ca3-91a8-66ed3278f421 None None] MFA Rules not processed for user `6d482f431c5b47aea8342409e4ab99ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:22.000306 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3c3beebb-b036-4ca3-91a8-66ed3278f421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:22.062194 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 748/1502] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:17:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:22.075522 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84be7c4-f1a7-4064-ac37-d442421f5f13 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:22.075809 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84be7c4-f1a7-4064-ac37-d442421f5f13 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:22.076085 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84be7c4-f1a7-4064-ac37-d442421f5f13 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:22.077461 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 755/1503] 10.222.0.76 () {54 vars in 963 bytes} [Mon May 16 15:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:17:22.082950 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a55e3-f9e9-4f1d-b841-47f6475f4787 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:22.083241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a55e3-f9e9-4f1d-b841-47f6475f4787 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:22.083520 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a55e3-f9e9-4f1d-b841-47f6475f4787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:22.101141 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-399a55e3-f9e9-4f1d-b841-47f6475f4787 None None] MFA Rules not processed for user `496e1178104d468e9b7ce53ea754ec74`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:22.102291 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-399a55e3-f9e9-4f1d-b841-47f6475f4787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:22.151070 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 749/1504] 10.222.0.76 () {58 vars in 1060 bytes} [Mon May 16 15:17:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:17:22.158052 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84be7c4-f1a7-4064-ac37-d442421f5f13 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:22.169055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84be7c4-f1a7-4064-ac37-d442421f5f13 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:22.172609 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33409a0-9fe9-41c1-95f5-c790fc6a9b53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:22.173233 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33409a0-9fe9-41c1-95f5-c790fc6a9b53 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:22.173513 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33409a0-9fe9-41c1-95f5-c790fc6a9b53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:22.173791 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33409a0-9fe9-41c1-95f5-c790fc6a9b53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:22.182436 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33409a0-9fe9-41c1-95f5-c790fc6a9b53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:22.183867 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33409a0-9fe9-41c1-95f5-c790fc6a9b53 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:22.192550 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 756/1505] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:17:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:17:22.234296 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac94e3-d5e9-4121-a0c2-7bc779936bd9 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:22.234587 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac94e3-d5e9-4121-a0c2-7bc779936bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:22.234867 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac94e3-d5e9-4121-a0c2-7bc779936bd9 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:22.236140 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 750/1506] 10.222.0.76 () {52 vars in 829 bytes} [Mon May 16 15:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:17:22.239752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33409a0-9fe9-41c1-95f5-c790fc6a9b53 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:22.299104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33409a0-9fe9-41c1-95f5-c790fc6a9b53 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:22.304160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9e52c-99cd-4661-9b03-8b6ff82ab525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:22.305020 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9e52c-99cd-4661-9b03-8b6ff82ab525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:22.305304 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9e52c-99cd-4661-9b03-8b6ff82ab525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:22.305577 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9e52c-99cd-4661-9b03-8b6ff82ab525 admin admin] PATH_INFO: `/v3/users/6d482f431c5b47aea8342409e4ab99ba` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:22.306764 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9e52c-99cd-4661-9b03-8b6ff82ab525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d482f431c5b47aea8342409e4ab99ba)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:22.307795 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: WARNING py.warnings [None req-98f9e52c-99cd-4661-9b03-8b6ff82ab525 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 15:17:22.307795 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: warnings.warn(msg) May 16 15:17:22.307795 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: May 16 15:17:22.308991 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9e52c-99cd-4661-9b03-8b6ff82ab525 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:22.542093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-98f9e52c-99cd-4661-9b03-8b6ff82ab525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d482f431c5b47aea8342409e4ab99ba'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:22.560713 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-98f9e52c-99cd-4661-9b03-8b6ff82ab525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d482f431c5b47aea8342409e4ab99ba'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:22.561389 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-98f9e52c-99cd-4661-9b03-8b6ff82ab525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d482f431c5b47aea8342409e4ab99ba'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:22.562102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-98f9e52c-99cd-4661-9b03-8b6ff82ab525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d482f431c5b47aea8342409e4ab99ba'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:22.574402 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-98f9e52c-99cd-4661-9b03-8b6ff82ab525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d482f431c5b47aea8342409e4ab99ba'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:22.674698 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 757/1507] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:17:22 2022] DELETE /identity/v3/users/6d482f431c5b47aea8342409e4ab99ba => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:22.679656 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ee579-09cd-4fe4-a1a6-999c395b148c None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:22.680099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ee579-09cd-4fe4-a1a6-999c395b148c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:22.680243 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ee579-09cd-4fe4-a1a6-999c395b148c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:22.698521 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-2f1ee579-09cd-4fe4-a1a6-999c395b148c None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:22.699724 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2f1ee579-09cd-4fe4-a1a6-999c395b148c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:22.757468 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 751/1508] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:22.766993 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9e52c-99cd-4661-9b03-8b6ff82ab525 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:22.768403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-98f9e52c-99cd-4661-9b03-8b6ff82ab525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:22.824503 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9e52c-99cd-4661-9b03-8b6ff82ab525 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:22.828037 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670ef57-19dc-460f-9e7a-d109ec9e8111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:22.828676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670ef57-19dc-460f-9e7a-d109ec9e8111 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:22.828960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670ef57-19dc-460f-9e7a-d109ec9e8111 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:22.829238 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670ef57-19dc-460f-9e7a-d109ec9e8111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:22.838587 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670ef57-19dc-460f-9e7a-d109ec9e8111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:22.840024 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670ef57-19dc-460f-9e7a-d109ec9e8111 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:22.849766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 758/1509] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:17:23.310168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ee579-09cd-4fe4-a1a6-999c395b148c None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:23.311796 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2f1ee579-09cd-4fe4-a1a6-999c395b148c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:23.323314 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ee579-09cd-4fe4-a1a6-999c395b148c None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:23.329327 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc17032-edf0-4ef7-a284-094849ac3f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:23.330221 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc17032-edf0-4ef7-a284-094849ac3f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:23.330498 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc17032-edf0-4ef7-a284-094849ac3f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:23.331398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc17032-edf0-4ef7-a284-094849ac3f47 admin admin] PATH_INFO: `/v3/projects/8337e155fd0141dbab05be998628204f` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:23.331964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc17032-edf0-4ef7-a284-094849ac3f47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8337e155fd0141dbab05be998628204f)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:23.334333 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: WARNING py.warnings [None req-6dc17032-edf0-4ef7-a284-094849ac3f47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 15:17:23.334333 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: warnings.warn(msg) May 16 15:17:23.334333 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: May 16 15:17:23.335545 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc17032-edf0-4ef7-a284-094849ac3f47 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:23.479104 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6dc17032-edf0-4ef7-a284-094849ac3f47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8337e155fd0141dbab05be998628204f', 'request_id': 'req-6dc17032-edf0-4ef7-a284-094849ac3f47'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:23.543036 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6dc17032-edf0-4ef7-a284-094849ac3f47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8337e155fd0141dbab05be998628204f', 'request_id': 'req-6dc17032-edf0-4ef7-a284-094849ac3f47'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:23.557383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6dc17032-edf0-4ef7-a284-094849ac3f47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8337e155fd0141dbab05be998628204f', 'request_id': 'req-6dc17032-edf0-4ef7-a284-094849ac3f47'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:23.568287 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6dc17032-edf0-4ef7-a284-094849ac3f47 admin admin] The token cache is being invalidate because project 8337e155fd0141dbab05be998628204f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:17:23.568575 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6dc17032-edf0-4ef7-a284-094849ac3f47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:23.569383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6dc17032-edf0-4ef7-a284-094849ac3f47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:23.571035 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 752/1510] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:17:23 2022] DELETE /identity/v3/projects/8337e155fd0141dbab05be998628204f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:19:06.707528 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d076dd-045a-494e-87aa-e96793c56706 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:06.708167 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d076dd-045a-494e-87aa-e96793c56706 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:06.708167 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d076dd-045a-494e-87aa-e96793c56706 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:06.709543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 15:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:19:06.714533 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cd702-cd48-404c-b240-4636d756d2e4 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:06.714985 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cd702-cd48-404c-b240-4636d756d2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:06.715097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cd702-cd48-404c-b240-4636d756d2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:06.733465 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9e8cd702-cd48-404c-b240-4636d756d2e4 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:06.734827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9e8cd702-cd48-404c-b240-4636d756d2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:06.792733 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 15:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:19:06.958010 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d076dd-045a-494e-87aa-e96793c56706 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:06.959715 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f9d076dd-045a-494e-87aa-e96793c56706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:07.030593 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d076dd-045a-494e-87aa-e96793c56706 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:07.036035 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d878cf-ac16-481c-8e50-46b19fe07616 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:07.036674 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d878cf-ac16-481c-8e50-46b19fe07616 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:07.036960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d878cf-ac16-481c-8e50-46b19fe07616 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:07.037240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d878cf-ac16-481c-8e50-46b19fe07616 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:07.045679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d878cf-ac16-481c-8e50-46b19fe07616 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:07.047498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d878cf-ac16-481c-8e50-46b19fe07616 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:07.057064 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 760/1513] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:19:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:19:07.698880 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8fde0-9243-453c-b903-5d71d4fd41d3 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:07.699185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8fde0-9243-453c-b903-5d71d4fd41d3 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:07.699450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8fde0-9243-453c-b903-5d71d4fd41d3 None None] PATH_INFO: `/v3` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:07.700797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 754/1514] 10.222.0.79 () {54 vars in 925 bytes} [Mon May 16 15:19:07 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:19:07.713438 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1315a7-0890-4739-91f8-e70c305ee3af None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:07.713961 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1315a7-0890-4739-91f8-e70c305ee3af None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:07.713961 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1315a7-0890-4739-91f8-e70c305ee3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:07.733124 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-5c1315a7-0890-4739-91f8-e70c305ee3af None None] MFA Rules not processed for user `1f231aa78ac84054b06a2126e1a11f31`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:07.734427 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5c1315a7-0890-4739-91f8-e70c305ee3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:07.802357 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 761/1515] 10.222.0.79 () {58 vars in 1015 bytes} [Mon May 16 15:19:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:19:08.044974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c7919-0b68-4ff8-8223-281818faaf27 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:08.045557 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c7919-0b68-4ff8-8223-281818faaf27 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:08.045557 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c7919-0b68-4ff8-8223-281818faaf27 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:08.047404 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 755/1516] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 15:19:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:19:08.052399 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3ce91-9f2d-4e3a-9e45-bc5285fd9de5 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:08.052683 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3ce91-9f2d-4e3a-9e45-bc5285fd9de5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:08.052960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3ce91-9f2d-4e3a-9e45-bc5285fd9de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:08.073347 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-19f3ce91-9f2d-4e3a-9e45-bc5285fd9de5 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:08.074568 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-19f3ce91-9f2d-4e3a-9e45-bc5285fd9de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:08.082674 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 762/1517] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 15:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:19:08.238196 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c7919-0b68-4ff8-8223-281818faaf27 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:08.252839 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c7919-0b68-4ff8-8223-281818faaf27 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:08.258114 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998dca0-22d4-4921-a50b-620442da8b31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:08.258793 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998dca0-22d4-4921-a50b-620442da8b31 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:08.259046 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998dca0-22d4-4921-a50b-620442da8b31 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:08.259316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998dca0-22d4-4921-a50b-620442da8b31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:08.267155 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998dca0-22d4-4921-a50b-620442da8b31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:08.268748 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998dca0-22d4-4921-a50b-620442da8b31 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:08.277699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 756/1518] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:19:11.949609 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedbbf2-b17c-4a4f-8efc-dff95b15ff7f None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:11.950263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedbbf2-b17c-4a4f-8efc-dff95b15ff7f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:11.950370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedbbf2-b17c-4a4f-8efc-dff95b15ff7f None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:11.952492 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 763/1519] 10.222.0.76 () {54 vars in 960 bytes} [Mon May 16 15:19:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:19:11.957608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed628f4-2771-4f83-bb0c-4cb09f5a8c73 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:11.958041 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed628f4-2771-4f83-bb0c-4cb09f5a8c73 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:11.958159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed628f4-2771-4f83-bb0c-4cb09f5a8c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:11.978669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5ed628f4-2771-4f83-bb0c-4cb09f5a8c73 None None] MFA Rules not processed for user `1f231aa78ac84054b06a2126e1a11f31`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:11.979867 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5ed628f4-2771-4f83-bb0c-4cb09f5a8c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:11.990524 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 757/1520] 10.222.0.76 () {58 vars in 1057 bytes} [Mon May 16 15:19:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:19:11.998112 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eedbbf2-b17c-4a4f-8efc-dff95b15ff7f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:12.011705 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eedbbf2-b17c-4a4f-8efc-dff95b15ff7f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:12.017076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35dff1-6f70-42d7-be31-17d5c0bc6afd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f231aa78ac84054b06a2126e1a11f31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:12.017703 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35dff1-6f70-42d7-be31-17d5c0bc6afd service placement] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:12.017983 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35dff1-6f70-42d7-be31-17d5c0bc6afd service placement] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:12.018294 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35dff1-6f70-42d7-be31-17d5c0bc6afd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:12.026667 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35dff1-6f70-42d7-be31-17d5c0bc6afd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:12.028275 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35dff1-6f70-42d7-be31-17d5c0bc6afd service placement] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:12.038288 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 764/1521] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:19:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:19:19.616698 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398856f-9112-4a31-adb0-42d21561ab06 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:19.617188 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398856f-9112-4a31-adb0-42d21561ab06 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:19.617316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398856f-9112-4a31-adb0-42d21561ab06 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:19.618768 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 15:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:19:19.623975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208371f-b4a1-4d9b-9738-df16113bd6ac None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:19.624385 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208371f-b4a1-4d9b-9738-df16113bd6ac None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:19.624532 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208371f-b4a1-4d9b-9738-df16113bd6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:19.642418 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6208371f-b4a1-4d9b-9738-df16113bd6ac None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:19.643600 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6208371f-b4a1-4d9b-9738-df16113bd6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:19.651297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 15:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:19:19.801115 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398856f-9112-4a31-adb0-42d21561ab06 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:19.815084 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398856f-9112-4a31-adb0-42d21561ab06 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:19.820446 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d774a-bded-4675-a5e3-b6dac8f8978e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:19.821074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d774a-bded-4675-a5e3-b6dac8f8978e service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:19.821353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d774a-bded-4675-a5e3-b6dac8f8978e service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:19.821627 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d774a-bded-4675-a5e3-b6dac8f8978e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:19.829932 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d774a-bded-4675-a5e3-b6dac8f8978e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:19.831568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d774a-bded-4675-a5e3-b6dac8f8978e service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:19.840666 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 759/1524] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:19:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:19:20.725175 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44670013-e6df-4ec0-b68c-d9e7b0b284a4 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:20.725713 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44670013-e6df-4ec0-b68c-d9e7b0b284a4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:20.725836 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44670013-e6df-4ec0-b68c-d9e7b0b284a4 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:20.727175 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 15:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:19:20.733201 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea28fe-700f-428e-acc4-27dcb249b33d None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:20.734205 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea28fe-700f-428e-acc4-27dcb249b33d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:20.734305 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea28fe-700f-428e-acc4-27dcb249b33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:20.752035 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-1fea28fe-700f-428e-acc4-27dcb249b33d None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:20.753226 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1fea28fe-700f-428e-acc4-27dcb249b33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:20.760965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 15:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:19:20.910865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44670013-e6df-4ec0-b68c-d9e7b0b284a4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:20.925639 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44670013-e6df-4ec0-b68c-d9e7b0b284a4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:20.931080 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a04851-7e8f-4c53-a5a3-1202e6f18eb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:20.931717 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a04851-7e8f-4c53-a5a3-1202e6f18eb2 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:20.932002 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a04851-7e8f-4c53-a5a3-1202e6f18eb2 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:20.932279 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a04851-7e8f-4c53-a5a3-1202e6f18eb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:20.940278 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a04851-7e8f-4c53-a5a3-1202e6f18eb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:20.941857 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a04851-7e8f-4c53-a5a3-1202e6f18eb2 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:20.950999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 767/1527] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:19:25.084386 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d8b9c-10f2-4ff4-b703-08eafa3df7a7 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:25.084929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d8b9c-10f2-4ff4-b703-08eafa3df7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:25.084929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d8b9c-10f2-4ff4-b703-08eafa3df7a7 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:25.086349 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:19:25.091480 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a56f02-7b2a-47e9-9f01-c4b98e119dbe None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:25.091917 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a56f02-7b2a-47e9-9f01-c4b98e119dbe None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:25.092056 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a56f02-7b2a-47e9-9f01-c4b98e119dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:25.109822 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-17a56f02-7b2a-47e9-9f01-c4b98e119dbe None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:25.111034 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-17a56f02-7b2a-47e9-9f01-c4b98e119dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:25.118632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:19:25.154589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d8b9c-10f2-4ff4-b703-08eafa3df7a7 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:25.156821 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b47d8b9c-10f2-4ff4-b703-08eafa3df7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:25.213897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d8b9c-10f2-4ff4-b703-08eafa3df7a7 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:25.217666 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc57ea-3216-40c5-beac-a312dd06a6e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:25.218333 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc57ea-3216-40c5-beac-a312dd06a6e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:25.218612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc57ea-3216-40c5-beac-a312dd06a6e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:25.218882 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc57ea-3216-40c5-beac-a312dd06a6e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:25.227614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc57ea-3216-40c5-beac-a312dd06a6e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:25.229036 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc57ea-3216-40c5-beac-a312dd06a6e6 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:25.238037 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 762/1530] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:19:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:19:27.435601 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abc765-0a18-40d1-b9fe-167b44b79622 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:27.436724 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abc765-0a18-40d1-b9fe-167b44b79622 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:27.436724 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abc765-0a18-40d1-b9fe-167b44b79622 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:27.438052 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:19:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:19:27.443569 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686ce5b-d789-46c6-a019-3ef788a0a850 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:27.444028 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686ce5b-d789-46c6-a019-3ef788a0a850 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:27.444142 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686ce5b-d789-46c6-a019-3ef788a0a850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:27.462662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9686ce5b-d789-46c6-a019-3ef788a0a850 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:27.463870 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9686ce5b-d789-46c6-a019-3ef788a0a850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:27.472030 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:19:27.506743 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abc765-0a18-40d1-b9fe-167b44b79622 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:27.517658 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abc765-0a18-40d1-b9fe-167b44b79622 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:27.521147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2a4a9-b09f-45c1-a428-3545b1671fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:27.521770 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2a4a9-b09f-45c1-a428-3545b1671fca service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:27.522049 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2a4a9-b09f-45c1-a428-3545b1671fca service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:27.522359 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2a4a9-b09f-45c1-a428-3545b1671fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:27.530948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2a4a9-b09f-45c1-a428-3545b1671fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:27.532382 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2a4a9-b09f-45c1-a428-3545b1671fca service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:27.541559 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 770/1533] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:19:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:19:31.394504 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab637a-2591-4d9d-93d2-356beeb95d34 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:31.395075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab637a-2591-4d9d-93d2-356beeb95d34 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:31.395075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab637a-2591-4d9d-93d2-356beeb95d34 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:31.396437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:19:31.401574 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473cbbe-0f3c-4327-8115-096fc7963f15 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:31.402000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473cbbe-0f3c-4327-8115-096fc7963f15 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:31.402151 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473cbbe-0f3c-4327-8115-096fc7963f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:31.420079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c473cbbe-0f3c-4327-8115-096fc7963f15 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:31.421817 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c473cbbe-0f3c-4327-8115-096fc7963f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:31.429463 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:19:31.710444 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab637a-2591-4d9d-93d2-356beeb95d34 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:31.712106 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8dab637a-2591-4d9d-93d2-356beeb95d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:31.767982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab637a-2591-4d9d-93d2-356beeb95d34 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:31.771475 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7c2b7-d328-429b-9487-aad59ef4254a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:31.772107 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7c2b7-d328-429b-9487-aad59ef4254a service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:31.772382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7c2b7-d328-429b-9487-aad59ef4254a service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:31.772652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7c2b7-d328-429b-9487-aad59ef4254a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:31.781801 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff7c2b7-d328-429b-9487-aad59ef4254a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:31.783274 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff7c2b7-d328-429b-9487-aad59ef4254a service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:31.792308 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 765/1536] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:19:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:19:34.074966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95587f-40a9-484f-a6c5-0fbc793274f1 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:34.075543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95587f-40a9-484f-a6c5-0fbc793274f1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:34.075543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95587f-40a9-484f-a6c5-0fbc793274f1 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:34.077548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:19:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:19:34.082560 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005dc6a-7b03-45ce-b9d4-7c23363288e4 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:34.082962 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005dc6a-7b03-45ce-b9d4-7c23363288e4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:34.083115 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005dc6a-7b03-45ce-b9d4-7c23363288e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:34.101180 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9005dc6a-7b03-45ce-b9d4-7c23363288e4 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:34.102403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9005dc6a-7b03-45ce-b9d4-7c23363288e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:34.110752 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:19:34.384594 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95587f-40a9-484f-a6c5-0fbc793274f1 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:34.386385 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ea95587f-40a9-484f-a6c5-0fbc793274f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:34.399044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95587f-40a9-484f-a6c5-0fbc793274f1 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:34.402545 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bae491-3bac-4cc2-ba2b-0ffedb271481 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:34.403165 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bae491-3bac-4cc2-ba2b-0ffedb271481 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:34.403442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bae491-3bac-4cc2-ba2b-0ffedb271481 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:34.403712 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bae491-3bac-4cc2-ba2b-0ffedb271481 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:34.412934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bae491-3bac-4cc2-ba2b-0ffedb271481 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:34.414401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bae491-3bac-4cc2-ba2b-0ffedb271481 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:34.424168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 773/1539] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:19:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:06.088269 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146bb21-4f4d-4a34-8df0-a856ce0599fe None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.089443 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146bb21-4f4d-4a34-8df0-a856ce0599fe None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.089959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146bb21-4f4d-4a34-8df0-a856ce0599fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.125179 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0146bb21-4f4d-4a34-8df0-a856ce0599fe None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:06.126842 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0146bb21-4f4d-4a34-8df0-a856ce0599fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:06.141649 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 767/1540] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:06.153433 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e87c0-f4f9-4d47-8991-e52527814b0e None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.154539 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e87c0-f4f9-4d47-8991-e52527814b0e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.155108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e87c0-f4f9-4d47-8991-e52527814b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.178548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e22e87c0-f4f9-4d47-8991-e52527814b0e None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:06.180748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e22e87c0-f4f9-4d47-8991-e52527814b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:06.194076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 774/1541] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:06.199590 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146bb21-4f4d-4a34-8df0-a856ce0599fe None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:06.212069 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146bb21-4f4d-4a34-8df0-a856ce0599fe None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:06.220246 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf2da0-d1f0-4a21-aa02-96f2660f91c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:06.221899 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf2da0-d1f0-4a21-aa02-96f2660f91c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.222566 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf2da0-d1f0-4a21-aa02-96f2660f91c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.223080 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf2da0-d1f0-4a21-aa02-96f2660f91c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.224166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf2da0-d1f0-4a21-aa02-96f2660f91c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:21:06.224765 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf2da0-d1f0-4a21-aa02-96f2660f91c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:06.226739 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf2da0-d1f0-4a21-aa02-96f2660f91c1 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:06.236087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5447a7-a89e-4e98-9ac1-7bb0452889da None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.236748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5447a7-a89e-4e98-9ac1-7bb0452889da None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.237284 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5447a7-a89e-4e98-9ac1-7bb0452889da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.262387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 768/1542] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:21:06.268431 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-0d5447a7-a89e-4e98-9ac1-7bb0452889da None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:06.269939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0d5447a7-a89e-4e98-9ac1-7bb0452889da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:06.286435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 775/1543] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:21:06.288585 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf2da0-d1f0-4a21-aa02-96f2660f91c1 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:06.298016 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1e23d-52e9-47ec-9057-e3c7e117de52 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.298336 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1e23d-52e9-47ec-9057-e3c7e117de52 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.298614 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1e23d-52e9-47ec-9057-e3c7e117de52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.307802 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf2da0-d1f0-4a21-aa02-96f2660f91c1 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:06.318645 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c4b10-cf1a-4d0e-a6db-555291765ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:06.318645 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c4b10-cf1a-4d0e-a6db-555291765ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.318645 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c4b10-cf1a-4d0e-a6db-555291765ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.318645 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c4b10-cf1a-4d0e-a6db-555291765ea4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.320387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c4b10-cf1a-4d0e-a6db-555291765ea4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:06.321382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: WARNING py.warnings [None req-bb3c4b10-cf1a-4d0e-a6db-555291765ea4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 15:21:06.321382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: warnings.warn(msg) May 16 15:21:06.321382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: May 16 15:21:06.323797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c4b10-cf1a-4d0e-a6db-555291765ea4 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:06.347998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-44d1e23d-52e9-47ec-9057-e3c7e117de52 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:06.349144 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-44d1e23d-52e9-47ec-9057-e3c7e117de52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:06.368673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 776/1544] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:06.370384 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ae54f-8f7c-43f4-a52d-a199ee1f540d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.370676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ae54f-8f7c-43f4-a52d-a199ee1f540d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.370951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ae54f-8f7c-43f4-a52d-a199ee1f540d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.398077 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c22ae54f-8f7c-43f4-a52d-a199ee1f540d None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:06.399312 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c22ae54f-8f7c-43f4-a52d-a199ee1f540d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:06.409750 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 777/1545] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:06.412376 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64b7f1-9646-4082-be9c-0da709ba7074 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.412376 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64b7f1-9646-4082-be9c-0da709ba7074 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.412376 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64b7f1-9646-4082-be9c-0da709ba7074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.436140 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-dc64b7f1-9646-4082-be9c-0da709ba7074 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:06.437861 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-dc64b7f1-9646-4082-be9c-0da709ba7074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:06.447507 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 778/1546] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:06.448291 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64b7f1-9646-4082-be9c-0da709ba7074 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:06.459858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64b7f1-9646-4082-be9c-0da709ba7074 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:06.464929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f2f2c-13da-4962-abc4-9200a8d01e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:06.469887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f2f2c-13da-4962-abc4-9200a8d01e51 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.469887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f2f2c-13da-4962-abc4-9200a8d01e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.469887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f2f2c-13da-4962-abc4-9200a8d01e51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.469887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f2f2c-13da-4962-abc4-9200a8d01e51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:21:06.469887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f2f2c-13da-4962-abc4-9200a8d01e51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:06.470373 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: WARNING py.warnings [None req-881f2f2c-13da-4962-abc4-9200a8d01e51 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:21:06.470373 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: warnings.warn(msg) May 16 15:21:06.470373 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: May 16 15:21:06.470373 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f2f2c-13da-4962-abc4-9200a8d01e51 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:06.470794 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 769/1547] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:21:06 2022] POST /identity/v3/projects => generated 377 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:06.472093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a552bc-db24-4374-97a1-05a2f017ed16 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.472389 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a552bc-db24-4374-97a1-05a2f017ed16 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.472675 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a552bc-db24-4374-97a1-05a2f017ed16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.483040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 779/1548] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:21:06.484582 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410e47a-465b-40ca-b660-7dd8bb76028a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.484985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410e47a-465b-40ca-b660-7dd8bb76028a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.485265 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410e47a-465b-40ca-b660-7dd8bb76028a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.490668 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a7a552bc-db24-4374-97a1-05a2f017ed16 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:06.492032 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a7a552bc-db24-4374-97a1-05a2f017ed16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:06.503986 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e410e47a-465b-40ca-b660-7dd8bb76028a None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:06.505172 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e410e47a-465b-40ca-b660-7dd8bb76028a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:06.549947 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 770/1549] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:06.551321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108aa54-9c6f-4260-af66-72e2c5b3d108 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.551612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108aa54-9c6f-4260-af66-72e2c5b3d108 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.551889 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108aa54-9c6f-4260-af66-72e2c5b3d108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.561170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 780/1550] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:06.565077 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51220f7c-6d68-435b-a32c-7e7dc63880f8 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.565077 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51220f7c-6d68-435b-a32c-7e7dc63880f8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.565077 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51220f7c-6d68-435b-a32c-7e7dc63880f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.571812 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-c108aa54-9c6f-4260-af66-72e2c5b3d108 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:06.573033 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c108aa54-9c6f-4260-af66-72e2c5b3d108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:06.581534 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 771/1551] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:06.582154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-51220f7c-6d68-435b-a32c-7e7dc63880f8 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:06.583234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27d9a0-405b-4a0b-9ce8-524450c6ad4d None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.583365 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-51220f7c-6d68-435b-a32c-7e7dc63880f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:06.583538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27d9a0-405b-4a0b-9ce8-524450c6ad4d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.583797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27d9a0-405b-4a0b-9ce8-524450c6ad4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.591461 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 781/1552] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:06.592748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bfd5b-1c91-4be5-8a91-f9d5ab953982 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.593078 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bfd5b-1c91-4be5-8a91-f9d5ab953982 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.593309 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bfd5b-1c91-4be5-8a91-f9d5ab953982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.603318 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-8c27d9a0-405b-4a0b-9ce8-524450c6ad4d None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:06.604474 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8c27d9a0-405b-4a0b-9ce8-524450c6ad4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:06.612389 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 772/1553] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:06.612527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-239bfd5b-1c91-4be5-8a91-f9d5ab953982 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:06.613270 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27d9a0-405b-4a0b-9ce8-524450c6ad4d None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:06.613683 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-239bfd5b-1c91-4be5-8a91-f9d5ab953982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:06.621532 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 782/1554] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:06.622390 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bfd5b-1c91-4be5-8a91-f9d5ab953982 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:06.622518 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27d9a0-405b-4a0b-9ce8-524450c6ad4d None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:06.629767 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea5a01-d67e-4ea5-a6b5-c0178e7b2294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:06.630540 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea5a01-d67e-4ea5-a6b5-c0178e7b2294 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.630829 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea5a01-d67e-4ea5-a6b5-c0178e7b2294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.631101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea5a01-d67e-4ea5-a6b5-c0178e7b2294 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.631806 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea5a01-d67e-4ea5-a6b5-c0178e7b2294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:06.633753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea5a01-d67e-4ea5-a6b5-c0178e7b2294 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:06.637857 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bfd5b-1c91-4be5-8a91-f9d5ab953982 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:06.643168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2a100-859c-4a10-828e-575c2a961b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:06.643835 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2a100-859c-4a10-828e-575c2a961b3f admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.644118 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2a100-859c-4a10-828e-575c2a961b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.644396 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2a100-859c-4a10-828e-575c2a961b3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.645088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2a100-859c-4a10-828e-575c2a961b3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:06.647064 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2a100-859c-4a10-828e-575c2a961b3f admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:06.749546 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 773/1555] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:21:06 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:06.750994 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ab305-48dc-4716-94a6-0f0ef2ff30a3 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.751292 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ab305-48dc-4716-94a6-0f0ef2ff30a3 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.751576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ab305-48dc-4716-94a6-0f0ef2ff30a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.761059 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 783/1556] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:21:06 2022] POST /identity/v3/projects => generated 405 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:06.762074 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2a100-859c-4a10-828e-575c2a961b3f admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:06.769509 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-652ab305-48dc-4716-94a6-0f0ef2ff30a3 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:06.770729 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-652ab305-48dc-4716-94a6-0f0ef2ff30a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:06.821296 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2a100-859c-4a10-828e-575c2a961b3f admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:06.826034 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f06854-86a0-4a2b-85d7-c02dde166105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:06.826720 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f06854-86a0-4a2b-85d7-c02dde166105 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.827034 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f06854-86a0-4a2b-85d7-c02dde166105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.827313 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f06854-86a0-4a2b-85d7-c02dde166105 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.827667 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 774/1557] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:06.828041 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f06854-86a0-4a2b-85d7-c02dde166105 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:21:06.828375 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f06854-86a0-4a2b-85d7-c02dde166105 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:06.828940 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33bcee-38b3-4d93-95b6-0f667e817485 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.829227 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33bcee-38b3-4d93-95b6-0f667e817485 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.829502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33bcee-38b3-4d93-95b6-0f667e817485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.829944 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f06854-86a0-4a2b-85d7-c02dde166105 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:06.841357 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 784/1558] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:21:06.842674 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd39fb-b105-424e-8f75-4a6ee62f4089 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.842967 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd39fb-b105-424e-8f75-4a6ee62f4089 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.843250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd39fb-b105-424e-8f75-4a6ee62f4089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.848419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-7b33bcee-38b3-4d93-95b6-0f667e817485 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:06.849870 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7b33bcee-38b3-4d93-95b6-0f667e817485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:06.857847 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 775/1559] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:06.859176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33bcee-38b3-4d93-95b6-0f667e817485 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:06.861144 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f9bd39fb-b105-424e-8f75-4a6ee62f4089 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:06.862985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f9bd39fb-b105-424e-8f75-4a6ee62f4089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:06.868445 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33bcee-38b3-4d93-95b6-0f667e817485 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:06.870923 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 785/1560] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:06.872137 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c524d5a-51b2-4eb6-9971-32e51ce13843 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.872425 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c524d5a-51b2-4eb6-9971-32e51ce13843 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.872969 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c524d5a-51b2-4eb6-9971-32e51ce13843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.873478 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ae0af-321b-4066-82b0-8cc547a0e3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:06.874772 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ae0af-321b-4066-82b0-8cc547a0e3da admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.874985 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ae0af-321b-4066-82b0-8cc547a0e3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.875408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ae0af-321b-4066-82b0-8cc547a0e3da admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.876214 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ae0af-321b-4066-82b0-8cc547a0e3da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:21:06.876519 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ae0af-321b-4066-82b0-8cc547a0e3da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:06.878151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ae0af-321b-4066-82b0-8cc547a0e3da admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:06.889591 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 776/1561] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:21:06.890474 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ae0af-321b-4066-82b0-8cc547a0e3da admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:06.892915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6c524d5a-51b2-4eb6-9971-32e51ce13843 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:06.894101 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6c524d5a-51b2-4eb6-9971-32e51ce13843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:06.901613 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ae0af-321b-4066-82b0-8cc547a0e3da admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:06.902262 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 786/1562] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:06.903009 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c524d5a-51b2-4eb6-9971-32e51ce13843 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:06.906880 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41d4bc-df02-4aac-abb0-19b69f4e750f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:06.907534 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41d4bc-df02-4aac-abb0-19b69f4e750f admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.907816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41d4bc-df02-4aac-abb0-19b69f4e750f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.908095 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41d4bc-df02-4aac-abb0-19b69f4e750f admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.908816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41d4bc-df02-4aac-abb0-19b69f4e750f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:06.910518 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41d4bc-df02-4aac-abb0-19b69f4e750f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:06.912075 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c524d5a-51b2-4eb6-9971-32e51ce13843 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:06.916624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbaece-7fee-4ab4-9b34-cc54930a5d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:06.917282 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbaece-7fee-4ab4-9b34-cc54930a5d4a admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.917559 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbaece-7fee-4ab4-9b34-cc54930a5d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.917841 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbaece-7fee-4ab4-9b34-cc54930a5d4a admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.918558 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbaece-7fee-4ab4-9b34-cc54930a5d4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:06.919589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: WARNING py.warnings [None req-65dbaece-7fee-4ab4-9b34-cc54930a5d4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 15:21:06.919589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: warnings.warn(msg) May 16 15:21:06.919589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: May 16 15:21:06.921309 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbaece-7fee-4ab4-9b34-cc54930a5d4a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:06.922816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 777/1563] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:06.925747 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41d4bc-df02-4aac-abb0-19b69f4e750f admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:06.933157 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41d4bc-df02-4aac-abb0-19b69f4e750f admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:06.938387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c483c1-bd77-423c-860a-96342a72778b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:06.943785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c483c1-bd77-423c-860a-96342a72778b admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.943785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c483c1-bd77-423c-860a-96342a72778b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.943785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c483c1-bd77-423c-860a-96342a72778b admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.943785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c483c1-bd77-423c-860a-96342a72778b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:21:06.943785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c483c1-bd77-423c-860a-96342a72778b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:06.943785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c483c1-bd77-423c-860a-96342a72778b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:06.953792 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 778/1564] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:21:06.954733 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c483c1-bd77-423c-860a-96342a72778b admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:06.963934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c483c1-bd77-423c-860a-96342a72778b admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:06.968727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe48be-a3b8-4c2f-9811-eb9e9e7dc938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:06.969394 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe48be-a3b8-4c2f-9811-eb9e9e7dc938 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.969744 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe48be-a3b8-4c2f-9811-eb9e9e7dc938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.969996 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe48be-a3b8-4c2f-9811-eb9e9e7dc938 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.970731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe48be-a3b8-4c2f-9811-eb9e9e7dc938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:06.972600 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe48be-a3b8-4c2f-9811-eb9e9e7dc938 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:07.029204 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 787/1565] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:21:06 2022] POST /identity/v3/users => generated 303 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:07.030110 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbaece-7fee-4ab4-9b34-cc54930a5d4a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:07.039799 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbaece-7fee-4ab4-9b34-cc54930a5d4a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:07.044370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc809efd-ea70-45c8-b301-371737cb5eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:07.045002 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc809efd-ea70-45c8-b301-371737cb5eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:07.045285 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc809efd-ea70-45c8-b301-371737cb5eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:07.045561 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc809efd-ea70-45c8-b301-371737cb5eb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:07.046821 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc809efd-ea70-45c8-b301-371737cb5eb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:21:07.047127 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc809efd-ea70-45c8-b301-371737cb5eb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:07.048722 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc809efd-ea70-45c8-b301-371737cb5eb8 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:07.060337 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 788/1566] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:21:07.061114 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc809efd-ea70-45c8-b301-371737cb5eb8 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:07.071101 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc809efd-ea70-45c8-b301-371737cb5eb8 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:07.075708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b2376-6af3-4487-ae82-17ce096a5fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:07.076318 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b2376-6af3-4487-ae82-17ce096a5fae admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:07.076603 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b2376-6af3-4487-ae82-17ce096a5fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:07.076878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b2376-6af3-4487-ae82-17ce096a5fae admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:07.077573 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b2376-6af3-4487-ae82-17ce096a5fae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:21:07.077880 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b2376-6af3-4487-ae82-17ce096a5fae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:07.079519 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b2376-6af3-4487-ae82-17ce096a5fae admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:07.090617 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 789/1567] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:21:07.091367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b2376-6af3-4487-ae82-17ce096a5fae admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:07.100996 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b2376-6af3-4487-ae82-17ce096a5fae admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:07.107072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 779/1568] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:21:06 2022] POST /identity/v3/projects => generated 393 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:07.107072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe48be-a3b8-4c2f-9811-eb9e9e7dc938 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:07.107677 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106727e1-460e-42ab-a721-bae5c41ada87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:07.107677 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106727e1-460e-42ab-a721-bae5c41ada87 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:07.107677 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106727e1-460e-42ab-a721-bae5c41ada87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:07.107677 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106727e1-460e-42ab-a721-bae5c41ada87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:07.108090 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106727e1-460e-42ab-a721-bae5c41ada87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:07.110024 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106727e1-460e-42ab-a721-bae5c41ada87 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:07.163591 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe48be-a3b8-4c2f-9811-eb9e9e7dc938 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:07.168145 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1708b19-62a7-44c0-8756-45b5b3697a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:07.168803 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1708b19-62a7-44c0-8756-45b5b3697a0d admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:07.169086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1708b19-62a7-44c0-8756-45b5b3697a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:07.169363 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1708b19-62a7-44c0-8756-45b5b3697a0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:07.170095 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1708b19-62a7-44c0-8756-45b5b3697a0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:21:07.170431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1708b19-62a7-44c0-8756-45b5b3697a0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:07.172598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1708b19-62a7-44c0-8756-45b5b3697a0d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:07.183552 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 780/1569] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:21:07.185037 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1708b19-62a7-44c0-8756-45b5b3697a0d admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:07.194148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1708b19-62a7-44c0-8756-45b5b3697a0d admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:07.198551 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded96a54-d549-4225-99aa-af613ee6f4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:07.206546 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded96a54-d549-4225-99aa-af613ee6f4bf admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:07.206546 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded96a54-d549-4225-99aa-af613ee6f4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:07.206546 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded96a54-d549-4225-99aa-af613ee6f4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:07.206546 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded96a54-d549-4225-99aa-af613ee6f4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:07.206546 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded96a54-d549-4225-99aa-af613ee6f4bf admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:07.211208 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 781/1570] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:07.211936 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded96a54-d549-4225-99aa-af613ee6f4bf admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:07.221156 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded96a54-d549-4225-99aa-af613ee6f4bf admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:07.225555 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e639483-cb16-4b2d-9e0c-6aed2f88c989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:07.226154 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e639483-cb16-4b2d-9e0c-6aed2f88c989 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:07.226432 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e639483-cb16-4b2d-9e0c-6aed2f88c989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:07.226729 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e639483-cb16-4b2d-9e0c-6aed2f88c989 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:07.227373 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e639483-cb16-4b2d-9e0c-6aed2f88c989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:07.229182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e639483-cb16-4b2d-9e0c-6aed2f88c989 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:07.246743 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 790/1571] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:21:07 2022] POST /identity/v3/projects => generated 403 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:07.250472 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106727e1-460e-42ab-a721-bae5c41ada87 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:07.308690 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106727e1-460e-42ab-a721-bae5c41ada87 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:07.313261 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c93e9-82b3-4f86-b24b-a2268f9e34cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:07.313921 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c93e9-82b3-4f86-b24b-a2268f9e34cf admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:07.314241 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c93e9-82b3-4f86-b24b-a2268f9e34cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:07.314515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c93e9-82b3-4f86-b24b-a2268f9e34cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:07.315234 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c93e9-82b3-4f86-b24b-a2268f9e34cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:07.316821 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c93e9-82b3-4f86-b24b-a2268f9e34cf admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:07.321092 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 782/1572] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:21:07 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:07.321896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e639483-cb16-4b2d-9e0c-6aed2f88c989 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:07.329805 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 791/1573] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:07.330693 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c93e9-82b3-4f86-b24b-a2268f9e34cf admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:07.339882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c93e9-82b3-4f86-b24b-a2268f9e34cf admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:07.381662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e639483-cb16-4b2d-9e0c-6aed2f88c989 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:07.386280 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fe566-ff25-44bb-83f0-d87b17b40112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:07.386941 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fe566-ff25-44bb-83f0-d87b17b40112 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:07.387220 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fe566-ff25-44bb-83f0-d87b17b40112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:07.391592 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fe566-ff25-44bb-83f0-d87b17b40112 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:07.392311 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fe566-ff25-44bb-83f0-d87b17b40112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:07.394268 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fe566-ff25-44bb-83f0-d87b17b40112 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:07.396247 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6e171-3d0a-4c49-81e0-1ba03977c8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:07.396933 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6e171-3d0a-4c49-81e0-1ba03977c8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:07.397219 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6e171-3d0a-4c49-81e0-1ba03977c8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:07.397525 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6e171-3d0a-4c49-81e0-1ba03977c8a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:07.398218 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6e171-3d0a-4c49-81e0-1ba03977c8a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:07.400165 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6e171-3d0a-4c49-81e0-1ba03977c8a7 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:07.480586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 792/1574] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:21:07 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:07.483964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 783/1575] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:21:07 2022] POST /identity/v3/projects => generated 389 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:07.484082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6e171-3d0a-4c49-81e0-1ba03977c8a7 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:07.484175 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fe566-ff25-44bb-83f0-d87b17b40112 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:07.542059 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6e171-3d0a-4c49-81e0-1ba03977c8a7 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:07.543645 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fe566-ff25-44bb-83f0-d87b17b40112 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:07.546695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f42824-7524-474e-a0fb-befc3fea86d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:07.547352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f42824-7524-474e-a0fb-befc3fea86d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:07.547632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f42824-7524-474e-a0fb-befc3fea86d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:07.547905 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f42824-7524-474e-a0fb-befc3fea86d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:07.548206 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a405a8-46ae-4a00-972c-51b891a3812a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:07.548585 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f42824-7524-474e-a0fb-befc3fea86d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:07.548856 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a405a8-46ae-4a00-972c-51b891a3812a admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:07.549170 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a405a8-46ae-4a00-972c-51b891a3812a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:07.549446 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a405a8-46ae-4a00-972c-51b891a3812a admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:07.550144 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a405a8-46ae-4a00-972c-51b891a3812a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:07.550547 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f42824-7524-474e-a0fb-befc3fea86d6 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:07.552084 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a405a8-46ae-4a00-972c-51b891a3812a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:07.651481 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 793/1576] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:21:07 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:07.652216 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f42824-7524-474e-a0fb-befc3fea86d6 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:07.663688 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f42824-7524-474e-a0fb-befc3fea86d6 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:07.668509 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253a278-4df8-4532-86e8-199a1c7e98c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:07.669380 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253a278-4df8-4532-86e8-199a1c7e98c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:07.669661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253a278-4df8-4532-86e8-199a1c7e98c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:07.669938 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253a278-4df8-4532-86e8-199a1c7e98c4 admin admin] PATH_INFO: `/v3/projects/3733b202412047fa87928b2a71871f5e/users/6da6d35c6c78443ba0319643a5e219d9/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:07.685428 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253a278-4df8-4532-86e8-199a1c7e98c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3733b202412047fa87928b2a71871f5e, user_id=6da6d35c6c78443ba0319643a5e219d9, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:07.686948 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 784/1577] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:21:07 2022] POST /identity/v3/projects => generated 375 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:07.686948 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a405a8-46ae-4a00-972c-51b891a3812a admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:07.690992 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253a278-4df8-4532-86e8-199a1c7e98c4 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:07.746430 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a405a8-46ae-4a00-972c-51b891a3812a admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:07.751382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832ecd6-a1aa-475b-9284-0e831ffcc45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:07.752048 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832ecd6-a1aa-475b-9284-0e831ffcc45f admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:07.752310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832ecd6-a1aa-475b-9284-0e831ffcc45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:07.752583 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832ecd6-a1aa-475b-9284-0e831ffcc45f admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:07.753256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832ecd6-a1aa-475b-9284-0e831ffcc45f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:07.755217 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832ecd6-a1aa-475b-9284-0e831ffcc45f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:07.776653 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 794/1578] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:07 2022] PUT /identity/v3/projects/3733b202412047fa87928b2a71871f5e/users/6da6d35c6c78443ba0319643a5e219d9/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:07.780951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253a278-4df8-4532-86e8-199a1c7e98c4 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:07.835839 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253a278-4df8-4532-86e8-199a1c7e98c4 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:07.840427 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841df1f-3307-44b3-a873-ece6260131ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:07.841078 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841df1f-3307-44b3-a873-ece6260131ec admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:07.841357 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841df1f-3307-44b3-a873-ece6260131ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:07.841629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841df1f-3307-44b3-a873-ece6260131ec admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:07.842338 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841df1f-3307-44b3-a873-ece6260131ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:07.844328 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841df1f-3307-44b3-a873-ece6260131ec admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:07.851575 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 785/1579] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:21:07 2022] POST /identity/v3/users => generated 302 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:07.852638 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832ecd6-a1aa-475b-9284-0e831ffcc45f admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:07.862151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832ecd6-a1aa-475b-9284-0e831ffcc45f admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:07.866779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f884f-d0f0-44e7-a9be-06f9b08564c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:07.867443 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f884f-d0f0-44e7-a9be-06f9b08564c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:07.867728 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f884f-d0f0-44e7-a9be-06f9b08564c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:07.868008 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f884f-d0f0-44e7-a9be-06f9b08564c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:07.868733 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f884f-d0f0-44e7-a9be-06f9b08564c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:07.870368 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f884f-d0f0-44e7-a9be-06f9b08564c3 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:07.880956 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 786/1580] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:07.881737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f884f-d0f0-44e7-a9be-06f9b08564c3 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:07.891372 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f884f-d0f0-44e7-a9be-06f9b08564c3 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:07.895923 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094bb91-13f6-44ad-8a00-cdc22adc867b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:07.896533 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094bb91-13f6-44ad-8a00-cdc22adc867b admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:07.896816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094bb91-13f6-44ad-8a00-cdc22adc867b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:07.897094 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094bb91-13f6-44ad-8a00-cdc22adc867b admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:07.897789 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094bb91-13f6-44ad-8a00-cdc22adc867b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:07.899686 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094bb91-13f6-44ad-8a00-cdc22adc867b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:07.954985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 795/1581] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:21:07 2022] POST /identity/v3/users => generated 284 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:07.955892 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841df1f-3307-44b3-a873-ece6260131ec admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:07.965154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841df1f-3307-44b3-a873-ece6260131ec admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:07.970323 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d969246-f5a2-44fd-a4f8-7ea3788c4b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:07.970952 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d969246-f5a2-44fd-a4f8-7ea3788c4b81 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:07.971229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d969246-f5a2-44fd-a4f8-7ea3788c4b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:07.971503 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d969246-f5a2-44fd-a4f8-7ea3788c4b81 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:07.972167 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d969246-f5a2-44fd-a4f8-7ea3788c4b81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:07.974061 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d969246-f5a2-44fd-a4f8-7ea3788c4b81 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:07.997429 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 787/1582] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:21:07 2022] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:07.997429 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094bb91-13f6-44ad-8a00-cdc22adc867b admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.004747 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094bb91-13f6-44ad-8a00-cdc22adc867b admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.009284 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86eb8c-32cd-4dc0-995b-9e5ef7b782e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.009962 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86eb8c-32cd-4dc0-995b-9e5ef7b782e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.010273 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86eb8c-32cd-4dc0-995b-9e5ef7b782e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.010556 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86eb8c-32cd-4dc0-995b-9e5ef7b782e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.011266 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86eb8c-32cd-4dc0-995b-9e5ef7b782e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.012865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86eb8c-32cd-4dc0-995b-9e5ef7b782e5 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.023003 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 788/1583] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:08.023745 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86eb8c-32cd-4dc0-995b-9e5ef7b782e5 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.033245 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86eb8c-32cd-4dc0-995b-9e5ef7b782e5 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.037704 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2fc29-4998-47fa-ac9f-12b5422186e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.038362 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2fc29-4998-47fa-ac9f-12b5422186e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.038646 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2fc29-4998-47fa-ac9f-12b5422186e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.038927 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2fc29-4998-47fa-ac9f-12b5422186e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.039582 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2fc29-4998-47fa-ac9f-12b5422186e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.041458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2fc29-4998-47fa-ac9f-12b5422186e9 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.057155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 796/1584] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:21:07 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:08.058644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f63e5-7f36-459e-8b5a-bb8278d10073 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.062873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f63e5-7f36-459e-8b5a-bb8278d10073 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.062873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f63e5-7f36-459e-8b5a-bb8278d10073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.078786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-545f63e5-7f36-459e-8b5a-bb8278d10073 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:08.079965 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-545f63e5-7f36-459e-8b5a-bb8278d10073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:08.087381 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 797/1585] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:08.088260 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f63e5-7f36-459e-8b5a-bb8278d10073 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.098047 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f63e5-7f36-459e-8b5a-bb8278d10073 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.102714 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81ff5d-4c80-4aae-a333-ec83d36f7777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.103354 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81ff5d-4c80-4aae-a333-ec83d36f7777 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.103627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81ff5d-4c80-4aae-a333-ec83d36f7777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.103895 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81ff5d-4c80-4aae-a333-ec83d36f7777 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.104602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81ff5d-4c80-4aae-a333-ec83d36f7777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.106208 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81ff5d-4c80-4aae-a333-ec83d36f7777 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.116663 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 798/1586] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:08.117538 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81ff5d-4c80-4aae-a333-ec83d36f7777 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.126882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81ff5d-4c80-4aae-a333-ec83d36f7777 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.131391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be802ea7-e327-4229-b807-b41232e8be69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.132213 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be802ea7-e327-4229-b807-b41232e8be69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.132531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be802ea7-e327-4229-b807-b41232e8be69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.132802 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be802ea7-e327-4229-b807-b41232e8be69 admin admin] PATH_INFO: `/v3/projects/f2ff61b9286d438ea809a173ddf142ab/users/71ac420d8f7a4a95b325a1b46f46e378/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.146794 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be802ea7-e327-4229-b807-b41232e8be69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ff61b9286d438ea809a173ddf142ab, user_id=71ac420d8f7a4a95b325a1b46f46e378, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.151395 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 789/1587] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:21:08 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:08.151395 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2fc29-4998-47fa-ac9f-12b5422186e9 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.151986 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be802ea7-e327-4229-b807-b41232e8be69 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.159313 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2fc29-4998-47fa-ac9f-12b5422186e9 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.163941 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497786b6-3416-44a8-95d2-83ad85e85ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.164579 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497786b6-3416-44a8-95d2-83ad85e85ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.164863 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497786b6-3416-44a8-95d2-83ad85e85ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.165143 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497786b6-3416-44a8-95d2-83ad85e85ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.165860 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497786b6-3416-44a8-95d2-83ad85e85ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.167501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497786b6-3416-44a8-95d2-83ad85e85ee4 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.177774 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 790/1588] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:08.178580 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497786b6-3416-44a8-95d2-83ad85e85ee4 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.187748 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497786b6-3416-44a8-95d2-83ad85e85ee4 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.192369 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e285b-f3e8-413f-9e24-7835cadde024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.192971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e285b-f3e8-413f-9e24-7835cadde024 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.193421 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e285b-f3e8-413f-9e24-7835cadde024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.193702 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e285b-f3e8-413f-9e24-7835cadde024 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.194429 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e285b-f3e8-413f-9e24-7835cadde024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.195997 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e285b-f3e8-413f-9e24-7835cadde024 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.206470 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 791/1589] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:08.207170 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e285b-f3e8-413f-9e24-7835cadde024 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.216498 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e285b-f3e8-413f-9e24-7835cadde024 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.221668 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19851499-ff44-45ce-8bcc-1d9321257053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.223759 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19851499-ff44-45ce-8bcc-1d9321257053 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.223759 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19851499-ff44-45ce-8bcc-1d9321257053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.223759 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19851499-ff44-45ce-8bcc-1d9321257053 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.223759 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19851499-ff44-45ce-8bcc-1d9321257053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.225074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19851499-ff44-45ce-8bcc-1d9321257053 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.228689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 799/1590] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:08 2022] PUT /identity/v3/projects/f2ff61b9286d438ea809a173ddf142ab/users/71ac420d8f7a4a95b325a1b46f46e378/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:08.229628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be802ea7-e327-4229-b807-b41232e8be69 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.237686 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 792/1591] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:08.237686 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19851499-ff44-45ce-8bcc-1d9321257053 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.291267 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19851499-ff44-45ce-8bcc-1d9321257053 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.304466 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be802ea7-e327-4229-b807-b41232e8be69 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.309155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0db3f2-b63b-4a2b-a295-40831ef9b9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.309818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0db3f2-b63b-4a2b-a295-40831ef9b9fb admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.310103 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0db3f2-b63b-4a2b-a295-40831ef9b9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.310581 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0db3f2-b63b-4a2b-a295-40831ef9b9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.311354 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0db3f2-b63b-4a2b-a295-40831ef9b9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.312968 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0db3f2-b63b-4a2b-a295-40831ef9b9fb admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.322900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 800/1592] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:08.323849 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0db3f2-b63b-4a2b-a295-40831ef9b9fb admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.333797 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0db3f2-b63b-4a2b-a295-40831ef9b9fb admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.338669 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bb907-719b-43fd-ad79-bc0c3854ead2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.340654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bb907-719b-43fd-ad79-bc0c3854ead2 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.340654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bb907-719b-43fd-ad79-bc0c3854ead2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.340654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bb907-719b-43fd-ad79-bc0c3854ead2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.340654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66bb907-719b-43fd-ad79-bc0c3854ead2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.342351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66bb907-719b-43fd-ad79-bc0c3854ead2 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.353043 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 801/1593] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:08.353885 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bb907-719b-43fd-ad79-bc0c3854ead2 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.357734 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdbbe6-552d-412a-b232-2e4050e4e604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.358462 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdbbe6-552d-412a-b232-2e4050e4e604 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.358747 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdbbe6-552d-412a-b232-2e4050e4e604 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.359020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdbbe6-552d-412a-b232-2e4050e4e604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.363845 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bb907-719b-43fd-ad79-bc0c3854ead2 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.368607 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f8ea8-b629-44e5-9ae5-c39a2a5e3e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.368897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fdbbe6-552d-412a-b232-2e4050e4e604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.380647 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f8ea8-b629-44e5-9ae5-c39a2a5e3e88 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.380647 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f8ea8-b629-44e5-9ae5-c39a2a5e3e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.380647 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f8ea8-b629-44e5-9ae5-c39a2a5e3e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.380947 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fdbbe6-552d-412a-b232-2e4050e4e604 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.381040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f8ea8-b629-44e5-9ae5-c39a2a5e3e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.381040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f8ea8-b629-44e5-9ae5-c39a2a5e3e88 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.381437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 793/1594] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:08.381857 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdbbe6-552d-412a-b232-2e4050e4e604 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.386448 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 802/1595] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:08.386448 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f8ea8-b629-44e5-9ae5-c39a2a5e3e88 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.392732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdbbe6-552d-412a-b232-2e4050e4e604 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.395759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f8ea8-b629-44e5-9ae5-c39a2a5e3e88 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.397682 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fe61b-9801-4da6-bebb-c4b5542d5c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.398510 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fe61b-9801-4da6-bebb-c4b5542d5c3b admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.398856 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fe61b-9801-4da6-bebb-c4b5542d5c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.399300 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fe61b-9801-4da6-bebb-c4b5542d5c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.400110 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34fe61b-9801-4da6-bebb-c4b5542d5c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.400833 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb3856-4999-435f-86b8-a804d0f8a4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.401281 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb3856-4999-435f-86b8-a804d0f8a4fc admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.401563 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb3856-4999-435f-86b8-a804d0f8a4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.401838 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb3856-4999-435f-86b8-a804d0f8a4fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.402281 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34fe61b-9801-4da6-bebb-c4b5542d5c3b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.402590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb3856-4999-435f-86b8-a804d0f8a4fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.404171 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb3856-4999-435f-86b8-a804d0f8a4fc admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.412902 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 794/1596] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:08.413788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fe61b-9801-4da6-bebb-c4b5542d5c3b admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.417730 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 803/1597] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:08.417730 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2280dc-f793-444a-855c-c75eb0347ba4 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.417730 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2280dc-f793-444a-855c-c75eb0347ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.417730 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2280dc-f793-444a-855c-c75eb0347ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.426566 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fe61b-9801-4da6-bebb-c4b5542d5c3b admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.431342 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca149a0d-e3d8-40db-b8c0-e882ea1647f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.432255 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca149a0d-e3d8-40db-b8c0-e882ea1647f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.432536 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca149a0d-e3d8-40db-b8c0-e882ea1647f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.432807 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca149a0d-e3d8-40db-b8c0-e882ea1647f2 admin admin] PATH_INFO: `/v3/projects/c3c3d75e638a4871b548ba689eeddeda/users/6c6b9438bb4245b3908664bfece4ef22/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.441652 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-4e2280dc-f793-444a-855c-c75eb0347ba4 None None] MFA Rules not processed for user `71ac420d8f7a4a95b325a1b46f46e378`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:08.442891 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4e2280dc-f793-444a-855c-c75eb0347ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:08.448026 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca149a0d-e3d8-40db-b8c0-e882ea1647f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c3d75e638a4871b548ba689eeddeda, user_id=6c6b9438bb4245b3908664bfece4ef22, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.449060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: WARNING py.warnings [None req-ca149a0d-e3d8-40db-b8c0-e882ea1647f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 15:21:08.449060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: warnings.warn(msg) May 16 15:21:08.449060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: May 16 15:21:08.451034 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca149a0d-e3d8-40db-b8c0-e882ea1647f2 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.512335 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 804/1598] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:08 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:08.513194 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2280dc-f793-444a-855c-c75eb0347ba4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.523712 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2280dc-f793-444a-855c-c75eb0347ba4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.528509 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6243f3d-b86d-479c-9c98-70b21206ab1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.529167 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6243f3d-b86d-479c-9c98-70b21206ab1e admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.529446 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6243f3d-b86d-479c-9c98-70b21206ab1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.531263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6243f3d-b86d-479c-9c98-70b21206ab1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.534758 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6243f3d-b86d-479c-9c98-70b21206ab1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.537032 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6243f3d-b86d-479c-9c98-70b21206ab1e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.541271 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 795/1599] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:08 2022] PUT /identity/v3/projects/c3c3d75e638a4871b548ba689eeddeda/users/6c6b9438bb4245b3908664bfece4ef22/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:08.541271 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca149a0d-e3d8-40db-b8c0-e882ea1647f2 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.548680 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 805/1600] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:08.549731 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6243f3d-b86d-479c-9c98-70b21206ab1e admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.559727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6243f3d-b86d-479c-9c98-70b21206ab1e admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.608876 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca149a0d-e3d8-40db-b8c0-e882ea1647f2 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.614760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240780d6-bf4d-479e-b6b4-08d7325ab473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.615735 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240780d6-bf4d-479e-b6b4-08d7325ab473 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.616006 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240780d6-bf4d-479e-b6b4-08d7325ab473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.616282 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240780d6-bf4d-479e-b6b4-08d7325ab473 admin admin] PATH_INFO: `/v3/projects/611940cf6d7b434489cddc0c51bb4197/users/308affaff46d451b92d13ec41b635774/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.630371 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb562c24-a1d2-4dd2-8319-39f932bf0909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.631050 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb562c24-a1d2-4dd2-8319-39f932bf0909 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.631334 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb562c24-a1d2-4dd2-8319-39f932bf0909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.632058 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb562c24-a1d2-4dd2-8319-39f932bf0909 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.632480 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb562c24-a1d2-4dd2-8319-39f932bf0909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.634090 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb562c24-a1d2-4dd2-8319-39f932bf0909 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.637416 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240780d6-bf4d-479e-b6b4-08d7325ab473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=611940cf6d7b434489cddc0c51bb4197, user_id=308affaff46d451b92d13ec41b635774, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.640203 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240780d6-bf4d-479e-b6b4-08d7325ab473 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.649672 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 806/1601] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:08.651495 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb562c24-a1d2-4dd2-8319-39f932bf0909 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.664860 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb562c24-a1d2-4dd2-8319-39f932bf0909 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.675441 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375fc42-0c27-4e07-bbc0-3fe38ef15f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.676341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375fc42-0c27-4e07-bbc0-3fe38ef15f88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.676647 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375fc42-0c27-4e07-bbc0-3fe38ef15f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.676929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375fc42-0c27-4e07-bbc0-3fe38ef15f88 admin admin] PATH_INFO: `/v3/projects/c8fdce3b4e384ebda03b45760240aeb9/users/6ef016cac9fa44fab9f96a4906ef6aff/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.693692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375fc42-0c27-4e07-bbc0-3fe38ef15f88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8fdce3b4e384ebda03b45760240aeb9, user_id=6ef016cac9fa44fab9f96a4906ef6aff, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.698565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375fc42-0c27-4e07-bbc0-3fe38ef15f88 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.720299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 796/1602] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:08 2022] PUT /identity/v3/projects/611940cf6d7b434489cddc0c51bb4197/users/308affaff46d451b92d13ec41b635774/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:08.720299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240780d6-bf4d-479e-b6b4-08d7325ab473 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.777665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 807/1603] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:08 2022] PUT /identity/v3/projects/c8fdce3b4e384ebda03b45760240aeb9/users/6ef016cac9fa44fab9f96a4906ef6aff/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:08.783269 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240780d6-bf4d-479e-b6b4-08d7325ab473 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.783400 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375fc42-0c27-4e07-bbc0-3fe38ef15f88 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.836750 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abff3f-f1d4-48de-9664-d5a66fe22035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.837638 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abff3f-f1d4-48de-9664-d5a66fe22035 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.837918 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abff3f-f1d4-48de-9664-d5a66fe22035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.838225 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abff3f-f1d4-48de-9664-d5a66fe22035 admin admin] PATH_INFO: `/v3/projects/f2241c9641bb401aa9f1c6930c513552/users/d3492cec550a46598e09c48474a4c6fb/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.844374 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375fc42-0c27-4e07-bbc0-3fe38ef15f88 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.849086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82445de-ea2f-42e0-bf8d-54bac896c6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.849766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82445de-ea2f-42e0-bf8d-54bac896c6c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.850045 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82445de-ea2f-42e0-bf8d-54bac896c6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.850371 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82445de-ea2f-42e0-bf8d-54bac896c6c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.851056 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82445de-ea2f-42e0-bf8d-54bac896c6c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.852533 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abff3f-f1d4-48de-9664-d5a66fe22035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2241c9641bb401aa9f1c6930c513552, user_id=d3492cec550a46598e09c48474a4c6fb, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.852956 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82445de-ea2f-42e0-bf8d-54bac896c6c0 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.855363 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abff3f-f1d4-48de-9664-d5a66fe22035 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.955765 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 797/1604] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:08 2022] PUT /identity/v3/projects/f2241c9641bb401aa9f1c6930c513552/users/d3492cec550a46598e09c48474a4c6fb/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:08.959541 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66033c-3fa8-4e30-8bbd-21a48c6d2970 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.959541 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66033c-3fa8-4e30-8bbd-21a48c6d2970 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.959541 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66033c-3fa8-4e30-8bbd-21a48c6d2970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.976544 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-6d66033c-3fa8-4e30-8bbd-21a48c6d2970 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:08.978015 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6d66033c-3fa8-4e30-8bbd-21a48c6d2970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:08.990050 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 808/1605] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:21:08 2022] POST /identity/v3/projects => generated 401 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:08.990050 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82445de-ea2f-42e0-bf8d-54bac896c6c0 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:09.061211 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 798/1606] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:09.063261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66033c-3fa8-4e30-8bbd-21a48c6d2970 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:09.073818 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66033c-3fa8-4e30-8bbd-21a48c6d2970 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:09.078537 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce346a85-0216-46d8-91d4-b13d012d9cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:09.079418 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce346a85-0216-46d8-91d4-b13d012d9cae admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:09.083590 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce346a85-0216-46d8-91d4-b13d012d9cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:09.083590 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce346a85-0216-46d8-91d4-b13d012d9cae admin admin] PATH_INFO: `/v3/projects/b360d85257f14f9191b490327c110ba8/users/6b16118d74774a9ea673d6e0532b8772/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:09.083810 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82445de-ea2f-42e0-bf8d-54bac896c6c0 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:09.085477 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806daab-c5ec-4965-97c2-b9855178ff46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:09.086419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806daab-c5ec-4965-97c2-b9855178ff46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:09.086709 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806daab-c5ec-4965-97c2-b9855178ff46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:09.086986 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806daab-c5ec-4965-97c2-b9855178ff46 admin admin] PATH_INFO: `/v3/projects/22a3cb5588d9482389dcef1c48aabe67/users/78a021cbb2fd40d5a9447a7da1141008/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:09.095481 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce346a85-0216-46d8-91d4-b13d012d9cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b360d85257f14f9191b490327c110ba8, user_id=6b16118d74774a9ea673d6e0532b8772, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:09.098233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce346a85-0216-46d8-91d4-b13d012d9cae admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:09.101760 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806daab-c5ec-4965-97c2-b9855178ff46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a3cb5588d9482389dcef1c48aabe67, user_id=78a021cbb2fd40d5a9447a7da1141008, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:09.104721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806daab-c5ec-4965-97c2-b9855178ff46 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:09.205349 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 799/1607] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:09 2022] PUT /identity/v3/projects/b360d85257f14f9191b490327c110ba8/users/6b16118d74774a9ea673d6e0532b8772/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:09.210211 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d896061-9c07-422d-83d7-7a9a350cbd9c None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:09.210507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d896061-9c07-422d-83d7-7a9a350cbd9c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:09.210785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d896061-9c07-422d-83d7-7a9a350cbd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:09.227705 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-4d896061-9c07-422d-83d7-7a9a350cbd9c None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:09.228945 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4d896061-9c07-422d-83d7-7a9a350cbd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:09.274933 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 809/1608] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:08 2022] PUT /identity/v3/projects/22a3cb5588d9482389dcef1c48aabe67/users/78a021cbb2fd40d5a9447a7da1141008/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:09.276553 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01645d61-657e-49da-9b06-748d93e4777d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:09.277248 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01645d61-657e-49da-9b06-748d93e4777d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:09.277678 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01645d61-657e-49da-9b06-748d93e4777d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:09.289053 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 800/1609] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:09.291635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531170a1-2a47-4a08-a1a7-b086f3eeacdb None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:09.292112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531170a1-2a47-4a08-a1a7-b086f3eeacdb None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:09.292384 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531170a1-2a47-4a08-a1a7-b086f3eeacdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:09.310244 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-531170a1-2a47-4a08-a1a7-b086f3eeacdb None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:09.312097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-531170a1-2a47-4a08-a1a7-b086f3eeacdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:09.313516 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-01645d61-657e-49da-9b06-748d93e4777d None None] MFA Rules not processed for user `6ef016cac9fa44fab9f96a4906ef6aff`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:09.314820 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-01645d61-657e-49da-9b06-748d93e4777d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:09.383419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 810/1610] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:09.383637 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01645d61-657e-49da-9b06-748d93e4777d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:09.389222 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 801/1611] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:09.389767 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531170a1-2a47-4a08-a1a7-b086f3eeacdb None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:09.391332 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-531170a1-2a47-4a08-a1a7-b086f3eeacdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:09.410308 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01645d61-657e-49da-9b06-748d93e4777d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:09.415719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc4459-44ae-40fe-bd5f-6dbff15d0dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:09.416610 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc4459-44ae-40fe-bd5f-6dbff15d0dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:09.416988 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc4459-44ae-40fe-bd5f-6dbff15d0dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:09.417385 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc4459-44ae-40fe-bd5f-6dbff15d0dd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:09.418268 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc4459-44ae-40fe-bd5f-6dbff15d0dd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:09.420514 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc4459-44ae-40fe-bd5f-6dbff15d0dd2 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:09.456024 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531170a1-2a47-4a08-a1a7-b086f3eeacdb None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:09.459836 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502800e4-af39-4200-8e21-e7dc8346339f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:09.460498 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502800e4-af39-4200-8e21-e7dc8346339f service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:09.460846 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502800e4-af39-4200-8e21-e7dc8346339f service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:09.461130 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502800e4-af39-4200-8e21-e7dc8346339f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:09.471596 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502800e4-af39-4200-8e21-e7dc8346339f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:09.473170 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502800e4-af39-4200-8e21-e7dc8346339f service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:09.484850 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 802/1612] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:09.486568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c591d0-42c4-45b8-88b0-2ca5c8f0c69f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:09.487185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c591d0-42c4-45b8-88b0-2ca5c8f0c69f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:09.487681 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c591d0-42c4-45b8-88b0-2ca5c8f0c69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:09.508149 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-68c591d0-42c4-45b8-88b0-2ca5c8f0c69f None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:09.509862 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-68c591d0-42c4-45b8-88b0-2ca5c8f0c69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:09.519436 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 803/1613] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:09.520893 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df62ef-3603-4f22-900b-48df9d048e45 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:09.521313 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df62ef-3603-4f22-900b-48df9d048e45 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:09.521686 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df62ef-3603-4f22-900b-48df9d048e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:09.554189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-17df62ef-3603-4f22-900b-48df9d048e45 None None] MFA Rules not processed for user `78a021cbb2fd40d5a9447a7da1141008`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:09.555552 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-17df62ef-3603-4f22-900b-48df9d048e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:09.561832 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 811/1614] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:21:09 2022] POST /identity/v3/users => generated 307 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:09.566861 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc4459-44ae-40fe-bd5f-6dbff15d0dd2 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:09.573756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc4459-44ae-40fe-bd5f-6dbff15d0dd2 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:09.577754 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b46ae-c157-41a2-af86-22d83039c3bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:09.578452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b46ae-c157-41a2-af86-22d83039c3bd service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:09.578730 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b46ae-c157-41a2-af86-22d83039c3bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:09.579007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b46ae-c157-41a2-af86-22d83039c3bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:09.590011 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b46ae-c157-41a2-af86-22d83039c3bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:09.590936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b46ae-c157-41a2-af86-22d83039c3bd service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:09.602264 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 812/1615] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:09.603083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b46ae-c157-41a2-af86-22d83039c3bd service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:09.634439 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 804/1616] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:09.635496 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df62ef-3603-4f22-900b-48df9d048e45 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:09.660476 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df62ef-3603-4f22-900b-48df9d048e45 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:09.665149 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68fc17-e4ed-4269-9f1d-6ccb3b754cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:09.665888 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68fc17-e4ed-4269-9f1d-6ccb3b754cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:09.666275 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68fc17-e4ed-4269-9f1d-6ccb3b754cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:09.666560 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68fc17-e4ed-4269-9f1d-6ccb3b754cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:09.668930 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b46ae-c157-41a2-af86-22d83039c3bd service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:09.673370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8468e9-b811-4f9f-a759-756d260b867a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:09.674016 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8468e9-b811-4f9f-a759-756d260b867a service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:09.674327 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8468e9-b811-4f9f-a759-756d260b867a service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:09.674605 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8468e9-b811-4f9f-a759-756d260b867a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:09.679076 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68fc17-e4ed-4269-9f1d-6ccb3b754cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:09.680727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68fc17-e4ed-4269-9f1d-6ccb3b754cf5 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:09.683286 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8468e9-b811-4f9f-a759-756d260b867a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:09.684796 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8468e9-b811-4f9f-a759-756d260b867a service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:09.691481 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 805/1617] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:09.692490 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68fc17-e4ed-4269-9f1d-6ccb3b754cf5 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:09.695640 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 813/1618] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:09 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:09.696502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8468e9-b811-4f9f-a759-756d260b867a service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:09.700621 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68fc17-e4ed-4269-9f1d-6ccb3b754cf5 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:09.705355 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f53133-94c9-4c04-b602-ceaba68059cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:09.706050 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f53133-94c9-4c04-b602-ceaba68059cc service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:09.707404 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f53133-94c9-4c04-b602-ceaba68059cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:09.707404 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f53133-94c9-4c04-b602-ceaba68059cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:09.709500 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8468e9-b811-4f9f-a759-756d260b867a service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:09.716057 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4eef2d-d05f-438a-b1a2-3e5ac999a241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:09.716856 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eef2d-d05f-438a-b1a2-3e5ac999a241 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:09.717298 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eef2d-d05f-438a-b1a2-3e5ac999a241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:09.718326 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eef2d-d05f-438a-b1a2-3e5ac999a241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:09.719364 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4eef2d-d05f-438a-b1a2-3e5ac999a241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:09.719759 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f53133-94c9-4c04-b602-ceaba68059cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:09.721491 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f53133-94c9-4c04-b602-ceaba68059cc service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:09.721735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4eef2d-d05f-438a-b1a2-3e5ac999a241 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:09.732133 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 806/1619] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:09.734058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab373bc1-d283-4890-9ff0-dd27aae548d2 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:09.734457 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab373bc1-d283-4890-9ff0-dd27aae548d2 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:09.734827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab373bc1-d283-4890-9ff0-dd27aae548d2 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:09.737665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 814/1620] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:09.738582 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4eef2d-d05f-438a-b1a2-3e5ac999a241 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:09.748115 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 807/1621] 10.222.0.76 () {54 vars in 961 bytes} [Mon May 16 15:21:09 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:21:09.754903 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33b8ca-511a-4897-8536-18f9d8a676e7 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:09.755270 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33b8ca-511a-4897-8536-18f9d8a676e7 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:09.755642 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33b8ca-511a-4897-8536-18f9d8a676e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:09.763003 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4eef2d-d05f-438a-b1a2-3e5ac999a241 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:09.769081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3175f3-d96e-4e5e-bdb5-f44d936e2350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:09.770463 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3175f3-d96e-4e5e-bdb5-f44d936e2350 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:09.770960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3175f3-d96e-4e5e-bdb5-f44d936e2350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:09.771413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3175f3-d96e-4e5e-bdb5-f44d936e2350 admin admin] PATH_INFO: `/v3/projects/07438631cbbe4c1e9aaed2ab509ae188/users/1bc660e790ed431381501f20a4ada18d/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:09.776462 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-dc33b8ca-511a-4897-8536-18f9d8a676e7 None None] MFA Rules not processed for user `9d85024f010c40129d79543b3ec4cfae`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:09.777459 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-dc33b8ca-511a-4897-8536-18f9d8a676e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:09.793890 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3175f3-d96e-4e5e-bdb5-f44d936e2350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07438631cbbe4c1e9aaed2ab509ae188, user_id=1bc660e790ed431381501f20a4ada18d, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:09.802874 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3175f3-d96e-4e5e-bdb5-f44d936e2350 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:09.863572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 808/1622] 10.222.0.76 () {58 vars in 1058 bytes} [Mon May 16 15:21:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:09.865319 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0a645-6563-4bdb-9a6f-de517ed32322 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:09.865781 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0a645-6563-4bdb-9a6f-de517ed32322 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:09.866792 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0a645-6563-4bdb-9a6f-de517ed32322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:09.899080 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 815/1623] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:09 2022] PUT /identity/v3/projects/07438631cbbe4c1e9aaed2ab509ae188/users/1bc660e790ed431381501f20a4ada18d/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:09.899882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3175f3-d96e-4e5e-bdb5-f44d936e2350 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:09.901085 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5ca0a645-6563-4bdb-9a6f-de517ed32322 None None] MFA Rules not processed for user `6da6d35c6c78443ba0319643a5e219d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:09.902397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5ca0a645-6563-4bdb-9a6f-de517ed32322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:10.006283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 809/1624] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:10.007347 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0a645-6563-4bdb-9a6f-de517ed32322 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:10.062925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3175f3-d96e-4e5e-bdb5-f44d936e2350 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:10.070645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b0a25-e23c-4037-ba9a-1794f3852bee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:10.071465 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b0a25-e23c-4037-ba9a-1794f3852bee service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:10.071884 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b0a25-e23c-4037-ba9a-1794f3852bee service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:10.072177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b0a25-e23c-4037-ba9a-1794f3852bee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:10.108789 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0a645-6563-4bdb-9a6f-de517ed32322 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:10.117537 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56c89a-29d6-4a99-b927-80870cad8131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:10.118560 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56c89a-29d6-4a99-b927-80870cad8131 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:10.119044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56c89a-29d6-4a99-b927-80870cad8131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:10.119328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56c89a-29d6-4a99-b927-80870cad8131 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:10.120080 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56c89a-29d6-4a99-b927-80870cad8131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:10.121768 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56c89a-29d6-4a99-b927-80870cad8131 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:10.151642 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 810/1625] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:10.152412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f2a39-18e1-4d03-8722-55ed69142a08 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:10.152764 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f2a39-18e1-4d03-8722-55ed69142a08 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:10.153056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f2a39-18e1-4d03-8722-55ed69142a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:10.177945 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b0a25-e23c-4037-ba9a-1794f3852bee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:10.180251 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b0a25-e23c-4037-ba9a-1794f3852bee service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:10.182942 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-349f2a39-18e1-4d03-8722-55ed69142a08 None None] MFA Rules not processed for user `6da6d35c6c78443ba0319643a5e219d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:10.183607 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-349f2a39-18e1-4d03-8722-55ed69142a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:10.195484 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 811/1626] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:10.202631 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f2a39-18e1-4d03-8722-55ed69142a08 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:10.216478 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f2a39-18e1-4d03-8722-55ed69142a08 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:10.223862 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408d809-32f7-4611-b865-26373d9191d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:10.228839 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 816/1627] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:10.228981 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408d809-32f7-4611-b865-26373d9191d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:10.228981 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408d809-32f7-4611-b865-26373d9191d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:10.228981 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408d809-32f7-4611-b865-26373d9191d1 admin admin] PATH_INFO: `/v3/projects/07438631cbbe4c1e9aaed2ab509ae188/users/1bc660e790ed431381501f20a4ada18d/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:10.229687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408d809-32f7-4611-b865-26373d9191d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07438631cbbe4c1e9aaed2ab509ae188, user_id=1bc660e790ed431381501f20a4ada18d, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:10.238650 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408d809-32f7-4611-b865-26373d9191d1 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:10.241140 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ee8fb-92d7-4a4f-a1b6-6d70bf933ca2 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:10.241431 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ee8fb-92d7-4a4f-a1b6-6d70bf933ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:10.241711 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ee8fb-92d7-4a4f-a1b6-6d70bf933ca2 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:10.243473 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 817/1628] 10.222.0.76 () {54 vars in 961 bytes} [Mon May 16 15:21:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:21:10.251550 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79a768-6048-43b4-9291-8b433aabbd31 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:10.251981 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79a768-6048-43b4-9291-8b433aabbd31 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:10.252262 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79a768-6048-43b4-9291-8b433aabbd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:10.263869 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 812/1629] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:10 2022] PUT /identity/v3/projects/07438631cbbe4c1e9aaed2ab509ae188/users/1bc660e790ed431381501f20a4ada18d/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:10.276642 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1e50f-5454-49d6-b0cc-a457dc8b7d9f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:10.277467 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1e50f-5454-49d6-b0cc-a457dc8b7d9f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:10.277467 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1e50f-5454-49d6-b0cc-a457dc8b7d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:10.284602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1e79a768-6048-43b4-9291-8b433aabbd31 None None] MFA Rules not processed for user `9d85024f010c40129d79543b3ec4cfae`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:10.287818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1e79a768-6048-43b4-9291-8b433aabbd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:10.309212 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5ec1e50f-5454-49d6-b0cc-a457dc8b7d9f None None] MFA Rules not processed for user `1bc660e790ed431381501f20a4ada18d`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:10.310614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5ec1e50f-5454-49d6-b0cc-a457dc8b7d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:10.386632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 818/1630] 10.222.0.76 () {58 vars in 1058 bytes} [Mon May 16 15:21:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:21:10.391683 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79a768-6048-43b4-9291-8b433aabbd31 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:10.407804 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79a768-6048-43b4-9291-8b433aabbd31 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:10.423398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 813/1631] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:10 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:10.424947 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f70f34-af20-481f-89d2-f40772368b1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:10.425657 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f70f34-af20-481f-89d2-f40772368b1b service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:10.426279 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f70f34-af20-481f-89d2-f40772368b1b service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:10.430535 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f70f34-af20-481f-89d2-f40772368b1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:10.442490 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1e50f-5454-49d6-b0cc-a457dc8b7d9f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:10.533257 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1e50f-5454-49d6-b0cc-a457dc8b7d9f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:10.538097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0b956-8617-4a5a-81ce-394c772acccb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:10.538932 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0b956-8617-4a5a-81ce-394c772acccb service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:10.539274 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0b956-8617-4a5a-81ce-394c772acccb service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:10.539559 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0b956-8617-4a5a-81ce-394c772acccb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:10.548755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f70f34-af20-481f-89d2-f40772368b1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:10.550523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f70f34-af20-481f-89d2-f40772368b1b service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:10.552517 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0b956-8617-4a5a-81ce-394c772acccb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:10.554010 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0b956-8617-4a5a-81ce-394c772acccb service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:10.573628 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 814/1632] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:10 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:21:10.576036 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 819/1633] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:21:10.606106 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9b384-cb12-4bfe-a8a8-7f9c48339962 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:10.606797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9b384-cb12-4bfe-a8a8-7f9c48339962 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:10.606797 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9b384-cb12-4bfe-a8a8-7f9c48339962 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:10.608974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 815/1634] 10.222.0.76 () {54 vars in 912 bytes} [Mon May 16 15:21:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:21:10.615715 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa7871-a7a7-44b1-a5db-f33351f57e9a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:10.616009 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa7871-a7a7-44b1-a5db-f33351f57e9a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:10.616287 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa7871-a7a7-44b1-a5db-f33351f57e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:10.641863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-8daa7871-a7a7-44b1-a5db-f33351f57e9a None None] MFA Rules not processed for user `9d85024f010c40129d79543b3ec4cfae`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:10.648011 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8daa7871-a7a7-44b1-a5db-f33351f57e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:10.660765 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 820/1635] 10.222.0.76 () {58 vars in 1009 bytes} [Mon May 16 15:21:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:10.699049 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9b384-cb12-4bfe-a8a8-7f9c48339962 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:10.712993 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9b384-cb12-4bfe-a8a8-7f9c48339962 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:10.717225 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cf9bf-3e21-4c66-8bed-3d78ed566a43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:10.718284 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cf9bf-3e21-4c66-8bed-3d78ed566a43 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:10.718867 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cf9bf-3e21-4c66-8bed-3d78ed566a43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:10.719349 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cf9bf-3e21-4c66-8bed-3d78ed566a43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:10.735823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7cf9bf-3e21-4c66-8bed-3d78ed566a43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:10.737690 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7cf9bf-3e21-4c66-8bed-3d78ed566a43 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:10.752645 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 816/1636] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:10.982769 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83d525-a7e2-482d-b1be-7fd5e63206bf None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:10.983731 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83d525-a7e2-482d-b1be-7fd5e63206bf None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:10.984090 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83d525-a7e2-482d-b1be-7fd5e63206bf None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:10.985980 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 821/1637] 10.222.0.76 () {54 vars in 912 bytes} [Mon May 16 15:21:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:21:10.991651 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791e83b-ac16-44bb-8058-0993a16000c2 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:10.992038 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791e83b-ac16-44bb-8058-0993a16000c2 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:10.992392 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791e83b-ac16-44bb-8058-0993a16000c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:11.023738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-c791e83b-ac16-44bb-8058-0993a16000c2 None None] MFA Rules not processed for user `9d85024f010c40129d79543b3ec4cfae`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:11.027343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c791e83b-ac16-44bb-8058-0993a16000c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:11.040490 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 817/1638] 10.222.0.76 () {58 vars in 1009 bytes} [Mon May 16 15:21:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:11.053915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83d525-a7e2-482d-b1be-7fd5e63206bf None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:11.056058 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ed83d525-a7e2-482d-b1be-7fd5e63206bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:11.129216 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83d525-a7e2-482d-b1be-7fd5e63206bf None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:11.133157 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149d640-6231-4662-a533-c3372a6c68cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1e67aa4370453fafb5b6525ba13cd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:11.133817 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149d640-6231-4662-a533-c3372a6c68cd service glance] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:11.134102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149d640-6231-4662-a533-c3372a6c68cd service glance] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:11.134417 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149d640-6231-4662-a533-c3372a6c68cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:11.150114 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149d640-6231-4662-a533-c3372a6c68cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:11.151723 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149d640-6231-4662-a533-c3372a6c68cd service glance] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:11.175944 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 822/1639] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:11.472615 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791e83b-ac16-44bb-8058-0993a16000c2 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:11.548947 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791e83b-ac16-44bb-8058-0993a16000c2 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:11.555913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d85bd-0148-491d-b2c5-3ff0e8262b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:11.562486 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d85bd-0148-491d-b2c5-3ff0e8262b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:11.562486 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d85bd-0148-491d-b2c5-3ff0e8262b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:11.562486 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d85bd-0148-491d-b2c5-3ff0e8262b52 admin admin] PATH_INFO: `/v3/users/71ac420d8f7a4a95b325a1b46f46e378` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:11.562486 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d85bd-0148-491d-b2c5-3ff0e8262b52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71ac420d8f7a4a95b325a1b46f46e378)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:11.562486 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: WARNING py.warnings [None req-fa2d85bd-0148-491d-b2c5-3ff0e8262b52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 15:21:11.562486 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: warnings.warn(msg) May 16 15:21:11.562486 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: May 16 15:21:11.563116 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d85bd-0148-491d-b2c5-3ff0e8262b52 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:11.698521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ee5c4-f400-475d-af3f-e39dd7eb94d8 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:11.699108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ee5c4-f400-475d-af3f-e39dd7eb94d8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:11.699204 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ee5c4-f400-475d-af3f-e39dd7eb94d8 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:11.700593 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 823/1640] 10.222.0.76 () {54 vars in 912 bytes} [Mon May 16 15:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:21:11.708536 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d121d5-4439-407f-beb8-65f5b908f854 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:11.708907 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d121d5-4439-407f-beb8-65f5b908f854 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:11.709171 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d121d5-4439-407f-beb8-65f5b908f854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:11.758689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-18d121d5-4439-407f-beb8-65f5b908f854 None None] MFA Rules not processed for user `15ff90527ece4406be62f449bdf71d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:11.760025 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-18d121d5-4439-407f-beb8-65f5b908f854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:11.850614 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 824/1641] 10.222.0.76 () {58 vars in 1009 bytes} [Mon May 16 15:21:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:11.862853 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d121d5-4439-407f-beb8-65f5b908f854 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:11.871739 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d121d5-4439-407f-beb8-65f5b908f854 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:11.875853 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa57bfb-95d2-422a-8930-c45909434976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:11.876498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa57bfb-95d2-422a-8930-c45909434976 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:11.876821 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa57bfb-95d2-422a-8930-c45909434976 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:11.877118 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa57bfb-95d2-422a-8930-c45909434976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:11.884804 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa57bfb-95d2-422a-8930-c45909434976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:11.886306 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa57bfb-95d2-422a-8930-c45909434976 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:11.896071 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 825/1642] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:21:11.913258 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-fa2d85bd-0148-491d-b2c5-3ff0e8262b52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71ac420d8f7a4a95b325a1b46f46e378'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:11.938781 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccea884-3088-46ac-8e2c-d740a9dcf832 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:11.939075 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccea884-3088-46ac-8e2c-d740a9dcf832 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:11.939358 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccea884-3088-46ac-8e2c-d740a9dcf832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:12.009297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-fa2d85bd-0148-491d-b2c5-3ff0e8262b52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71ac420d8f7a4a95b325a1b46f46e378'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:12.010225 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-fa2d85bd-0148-491d-b2c5-3ff0e8262b52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71ac420d8f7a4a95b325a1b46f46e378'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:12.012197 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6ccea884-3088-46ac-8e2c-d740a9dcf832 None None] MFA Rules not processed for user `308affaff46d451b92d13ec41b635774`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:12.014066 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6ccea884-3088-46ac-8e2c-d740a9dcf832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:12.067388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-fa2d85bd-0148-491d-b2c5-3ff0e8262b52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71ac420d8f7a4a95b325a1b46f46e378'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:12.068905 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-fa2d85bd-0148-491d-b2c5-3ff0e8262b52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71ac420d8f7a4a95b325a1b46f46e378'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:12.150083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 818/1643] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:21:11 2022] DELETE /identity/v3/users/71ac420d8f7a4a95b325a1b46f46e378 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:12.158514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d698ce3-3be1-4bb0-ae53-c429debc297b None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:12.159753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d698ce3-3be1-4bb0-ae53-c429debc297b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:12.162000 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d698ce3-3be1-4bb0-ae53-c429debc297b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:12.164700 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 826/1644] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:21:12.169848 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccea884-3088-46ac-8e2c-d740a9dcf832 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:12.173955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6ccea884-3088-46ac-8e2c-d740a9dcf832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:12.200020 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccea884-3088-46ac-8e2c-d740a9dcf832 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:12.207269 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-6d698ce3-3be1-4bb0-ae53-c429debc297b None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:12.209045 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6d698ce3-3be1-4bb0-ae53-c429debc297b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:12.284672 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a39364-30ee-4900-a5c6-34c2001484bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:12.285357 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a39364-30ee-4900-a5c6-34c2001484bc admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:12.285649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a39364-30ee-4900-a5c6-34c2001484bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:12.286166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a39364-30ee-4900-a5c6-34c2001484bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:12.286898 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a39364-30ee-4900-a5c6-34c2001484bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:12.290467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a39364-30ee-4900-a5c6-34c2001484bc admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:12.306258 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 819/1645] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:12.318368 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d698ce3-3be1-4bb0-ae53-c429debc297b None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:12.320011 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6d698ce3-3be1-4bb0-ae53-c429debc297b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:12.383673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 827/1646] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:21:12 2022] POST /identity/v3/projects => generated 405 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:12.387961 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a39364-30ee-4900-a5c6-34c2001484bc admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:12.414549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d698ce3-3be1-4bb0-ae53-c429debc297b None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:12.493734 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d2949-bae3-4f0e-a1cb-3bb68b0e3245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:12.494459 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d2949-bae3-4f0e-a1cb-3bb68b0e3245 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:12.494751 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d2949-bae3-4f0e-a1cb-3bb68b0e3245 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:12.495866 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d2949-bae3-4f0e-a1cb-3bb68b0e3245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:12.501122 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a39364-30ee-4900-a5c6-34c2001484bc admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:12.511753 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ecb6c-9e6e-4924-939b-0957e369e1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:12.512617 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ecb6c-9e6e-4924-939b-0957e369e1ed admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:12.513321 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ecb6c-9e6e-4924-939b-0957e369e1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:12.515181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ecb6c-9e6e-4924-939b-0957e369e1ed admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:12.516778 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ecb6c-9e6e-4924-939b-0957e369e1ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:12.518437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d2949-bae3-4f0e-a1cb-3bb68b0e3245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:12.519912 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d2949-bae3-4f0e-a1cb-3bb68b0e3245 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:12.521095 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ecb6c-9e6e-4924-939b-0957e369e1ed admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:12.530618 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 820/1647] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:12.652895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d2949-bae3-4f0e-a1cb-3bb68b0e3245 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:12.662307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 828/1648] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:21:12 2022] POST /identity/v3/users => generated 309 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:12.671313 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d2949-bae3-4f0e-a1cb-3bb68b0e3245 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:12.678429 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1585e28-147a-42f2-96d0-ba747e43e1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:12.679355 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1585e28-147a-42f2-96d0-ba747e43e1da admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:12.679785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1585e28-147a-42f2-96d0-ba747e43e1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:12.680228 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1585e28-147a-42f2-96d0-ba747e43e1da admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:12.681111 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1585e28-147a-42f2-96d0-ba747e43e1da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:12.683011 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1585e28-147a-42f2-96d0-ba747e43e1da admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:12.716618 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 821/1649] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:12.718492 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ecb6c-9e6e-4924-939b-0957e369e1ed admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:12.735676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ecb6c-9e6e-4924-939b-0957e369e1ed admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:12.743123 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab322b6-2cc2-41b5-b199-d49855753ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:12.744177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab322b6-2cc2-41b5-b199-d49855753ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:12.744552 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab322b6-2cc2-41b5-b199-d49855753ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:12.744925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab322b6-2cc2-41b5-b199-d49855753ab4 admin admin] PATH_INFO: `/v3/projects/b3a02de1f5fe49cab974ab63a2f44790/users/c585fdbe57db442e98ed9e02562b92ac/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:12.781795 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab322b6-2cc2-41b5-b199-d49855753ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3a02de1f5fe49cab974ab63a2f44790, user_id=c585fdbe57db442e98ed9e02562b92ac, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:12.790306 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab322b6-2cc2-41b5-b199-d49855753ab4 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:12.908680 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 829/1650] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:12 2022] PUT /identity/v3/projects/b3a02de1f5fe49cab974ab63a2f44790/users/c585fdbe57db442e98ed9e02562b92ac/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:12.909825 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1585e28-147a-42f2-96d0-ba747e43e1da admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:12.921498 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1585e28-147a-42f2-96d0-ba747e43e1da admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:13.004167 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00979160-7b39-4987-9952-6de6fb2b4341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:13.005211 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00979160-7b39-4987-9952-6de6fb2b4341 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:13.005676 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00979160-7b39-4987-9952-6de6fb2b4341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:13.006116 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00979160-7b39-4987-9952-6de6fb2b4341 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:13.007050 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00979160-7b39-4987-9952-6de6fb2b4341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:13.008841 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00979160-7b39-4987-9952-6de6fb2b4341 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:13.021980 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 822/1651] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:13.027403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab322b6-2cc2-41b5-b199-d49855753ab4 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:13.044488 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab322b6-2cc2-41b5-b199-d49855753ab4 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:13.059323 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d4cc1-f474-445b-bdcf-e5007164ca11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:13.060276 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d4cc1-f474-445b-bdcf-e5007164ca11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:13.060508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d4cc1-f474-445b-bdcf-e5007164ca11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:13.060781 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d4cc1-f474-445b-bdcf-e5007164ca11 admin admin] PATH_INFO: `/v3/projects/b3a02de1f5fe49cab974ab63a2f44790/users/c585fdbe57db442e98ed9e02562b92ac/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:13.065851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d4cc1-f474-445b-bdcf-e5007164ca11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3a02de1f5fe49cab974ab63a2f44790, user_id=c585fdbe57db442e98ed9e02562b92ac, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:13.074704 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d4cc1-f474-445b-bdcf-e5007164ca11 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:13.100797 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 830/1652] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:13 2022] PUT /identity/v3/projects/b3a02de1f5fe49cab974ab63a2f44790/users/c585fdbe57db442e98ed9e02562b92ac/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:13.148227 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c03ff0-3214-4d3a-85a7-8ca78c244316 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:13.148227 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c03ff0-3214-4d3a-85a7-8ca78c244316 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:13.153520 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c03ff0-3214-4d3a-85a7-8ca78c244316 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:13.153520 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 823/1653] 10.222.0.76 () {54 vars in 960 bytes} [Mon May 16 15:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:21:13.155885 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc21a95-6b0a-46db-ba95-ed05f915d296 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:13.156183 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc21a95-6b0a-46db-ba95-ed05f915d296 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:13.156464 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc21a95-6b0a-46db-ba95-ed05f915d296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:13.188991 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-3cc21a95-6b0a-46db-ba95-ed05f915d296 None None] MFA Rules not processed for user `1f231aa78ac84054b06a2126e1a11f31`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:13.190072 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3cc21a95-6b0a-46db-ba95-ed05f915d296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:13.320005 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 831/1654] 10.222.0.76 () {58 vars in 1057 bytes} [Mon May 16 15:21:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:13.330391 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c03ff0-3214-4d3a-85a7-8ca78c244316 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:13.385787 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c03ff0-3214-4d3a-85a7-8ca78c244316 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:13.405721 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbba6a1-8230-462e-a7a9-0faf63f7af22 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f231aa78ac84054b06a2126e1a11f31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:13.406515 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbba6a1-8230-462e-a7a9-0faf63f7af22 service placement] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:13.407060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbba6a1-8230-462e-a7a9-0faf63f7af22 service placement] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:13.407824 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbba6a1-8230-462e-a7a9-0faf63f7af22 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:13.410259 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-fdbba6a1-8230-462e-a7a9-0faf63f7af22 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:13.428368 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbba6a1-8230-462e-a7a9-0faf63f7af22 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:13.431949 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbba6a1-8230-462e-a7a9-0faf63f7af22 service placement] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:13.455154 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 824/1655] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:14.070102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc21a95-6b0a-46db-ba95-ed05f915d296 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:14.071605 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3cc21a95-6b0a-46db-ba95-ed05f915d296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:14.195727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc21a95-6b0a-46db-ba95-ed05f915d296 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:14.201389 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d655b1c-84e2-46f8-9760-7fe2cf9d80f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:14.203101 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d655b1c-84e2-46f8-9760-7fe2cf9d80f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:14.203694 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d655b1c-84e2-46f8-9760-7fe2cf9d80f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:14.203966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d655b1c-84e2-46f8-9760-7fe2cf9d80f5 admin admin] PATH_INFO: `/v3/projects/f2ff61b9286d438ea809a173ddf142ab` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:14.205620 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d655b1c-84e2-46f8-9760-7fe2cf9d80f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2ff61b9286d438ea809a173ddf142ab)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:14.207074 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: WARNING py.warnings [None req-7d655b1c-84e2-46f8-9760-7fe2cf9d80f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 15:21:14.207074 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: warnings.warn(msg) May 16 15:21:14.207074 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: May 16 15:21:14.210659 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d655b1c-84e2-46f8-9760-7fe2cf9d80f5 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:14.404724 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7d655b1c-84e2-46f8-9760-7fe2cf9d80f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2ff61b9286d438ea809a173ddf142ab', 'request_id': 'req-7d655b1c-84e2-46f8-9760-7fe2cf9d80f5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:14.452257 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7d655b1c-84e2-46f8-9760-7fe2cf9d80f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2ff61b9286d438ea809a173ddf142ab', 'request_id': 'req-7d655b1c-84e2-46f8-9760-7fe2cf9d80f5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:14.555070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7d655b1c-84e2-46f8-9760-7fe2cf9d80f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2ff61b9286d438ea809a173ddf142ab', 'request_id': 'req-7d655b1c-84e2-46f8-9760-7fe2cf9d80f5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:14.573313 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7d655b1c-84e2-46f8-9760-7fe2cf9d80f5 admin admin] The token cache is being invalidate because project f2ff61b9286d438ea809a173ddf142ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:21:14.574723 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7d655b1c-84e2-46f8-9760-7fe2cf9d80f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:14.576192 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7d655b1c-84e2-46f8-9760-7fe2cf9d80f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:14.582287 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 832/1656] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:21:14 2022] DELETE /identity/v3/projects/f2ff61b9286d438ea809a173ddf142ab => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:14.586110 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbba6a1-8230-462e-a7a9-0faf63f7af22 service placement] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:14.605537 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbba6a1-8230-462e-a7a9-0faf63f7af22 service placement] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:14.813112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559c99e-c36a-4551-8382-593e621dd22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:14.814007 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559c99e-c36a-4551-8382-593e621dd22c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:14.814632 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559c99e-c36a-4551-8382-593e621dd22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:14.814987 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559c99e-c36a-4551-8382-593e621dd22c admin admin] PATH_INFO: `/v3/users/1bc660e790ed431381501f20a4ada18d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:14.816646 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559c99e-c36a-4551-8382-593e621dd22c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bc660e790ed431381501f20a4ada18d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:14.819409 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559c99e-c36a-4551-8382-593e621dd22c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:15.141419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8559c99e-c36a-4551-8382-593e621dd22c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bc660e790ed431381501f20a4ada18d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:15.253705 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d655b1c-84e2-46f8-9760-7fe2cf9d80f5 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:15.272863 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8559c99e-c36a-4551-8382-593e621dd22c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bc660e790ed431381501f20a4ada18d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:15.272863 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8559c99e-c36a-4551-8382-593e621dd22c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bc660e790ed431381501f20a4ada18d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:15.273343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7d655b1c-84e2-46f8-9760-7fe2cf9d80f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:15.286090 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d655b1c-84e2-46f8-9760-7fe2cf9d80f5 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:15.292078 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8559c99e-c36a-4551-8382-593e621dd22c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bc660e790ed431381501f20a4ada18d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:15.293068 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca4615-9975-48d0-884e-082aa5f15ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:15.293605 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8559c99e-c36a-4551-8382-593e621dd22c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bc660e790ed431381501f20a4ada18d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:15.294778 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca4615-9975-48d0-884e-082aa5f15ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:15.295768 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca4615-9975-48d0-884e-082aa5f15ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:15.296192 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca4615-9975-48d0-884e-082aa5f15ee8 admin admin] PATH_INFO: `/v3/users/78a021cbb2fd40d5a9447a7da1141008` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:15.297694 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca4615-9975-48d0-884e-082aa5f15ee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78a021cbb2fd40d5a9447a7da1141008)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:15.301341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca4615-9975-48d0-884e-082aa5f15ee8 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:15.319617 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 825/1657] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:21:14 2022] DELETE /identity/v3/users/1bc660e790ed431381501f20a4ada18d => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:21:15.585551 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-06ca4615-9975-48d0-884e-082aa5f15ee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78a021cbb2fd40d5a9447a7da1141008'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:15.616149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-06ca4615-9975-48d0-884e-082aa5f15ee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78a021cbb2fd40d5a9447a7da1141008'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:15.618334 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-06ca4615-9975-48d0-884e-082aa5f15ee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78a021cbb2fd40d5a9447a7da1141008'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:15.619802 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-06ca4615-9975-48d0-884e-082aa5f15ee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78a021cbb2fd40d5a9447a7da1141008'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:15.633189 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-06ca4615-9975-48d0-884e-082aa5f15ee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78a021cbb2fd40d5a9447a7da1141008'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:15.745444 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 833/1658] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:21:15 2022] DELETE /identity/v3/users/78a021cbb2fd40d5a9447a7da1141008 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:15.750595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad5b29-f94c-4e7e-b1bf-0b557ee1a4e4 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:15.751100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad5b29-f94c-4e7e-b1bf-0b557ee1a4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:15.751200 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad5b29-f94c-4e7e-b1bf-0b557ee1a4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:15.792047 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-42ad5b29-f94c-4e7e-b1bf-0b557ee1a4e4 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:15.797494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-42ad5b29-f94c-4e7e-b1bf-0b557ee1a4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:15.991873 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 826/1659] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:21:16.034427 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca4615-9975-48d0-884e-082aa5f15ee8 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:16.036181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-06ca4615-9975-48d0-884e-082aa5f15ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:16.162341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca4615-9975-48d0-884e-082aa5f15ee8 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:16.166541 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcff245-f8b6-4817-b65e-267d6c4d7578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:16.168385 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcff245-f8b6-4817-b65e-267d6c4d7578 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:16.168817 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcff245-f8b6-4817-b65e-267d6c4d7578 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:16.169259 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcff245-f8b6-4817-b65e-267d6c4d7578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:16.182112 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcff245-f8b6-4817-b65e-267d6c4d7578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:16.183762 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcff245-f8b6-4817-b65e-267d6c4d7578 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:16.201253 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 834/1660] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:16.884923 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529768b9-17bc-4fa1-ab57-e1c15e0f3226 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:16.886471 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529768b9-17bc-4fa1-ab57-e1c15e0f3226 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:16.886958 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529768b9-17bc-4fa1-ab57-e1c15e0f3226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:17.014761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-529768b9-17bc-4fa1-ab57-e1c15e0f3226 None None] MFA Rules not processed for user `c585fdbe57db442e98ed9e02562b92ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:17.018856 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-529768b9-17bc-4fa1-ab57-e1c15e0f3226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:17.347113 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 827/1661] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:16 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:17.373950 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcff245-f8b6-4817-b65e-267d6c4d7578 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:17.375988 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7dcff245-f8b6-4817-b65e-267d6c4d7578 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:17.411452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcff245-f8b6-4817-b65e-267d6c4d7578 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:17.430270 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f74b8-f2cc-4175-8fc9-27afdbbe4e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:17.431205 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f74b8-f2cc-4175-8fc9-27afdbbe4e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:17.431573 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f74b8-f2cc-4175-8fc9-27afdbbe4e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:17.431907 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f74b8-f2cc-4175-8fc9-27afdbbe4e43 admin admin] PATH_INFO: `/v3/projects/07438631cbbe4c1e9aaed2ab509ae188` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:17.433376 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f74b8-f2cc-4175-8fc9-27afdbbe4e43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07438631cbbe4c1e9aaed2ab509ae188)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:17.438329 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f74b8-f2cc-4175-8fc9-27afdbbe4e43 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:17.673109 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5d8f74b8-f2cc-4175-8fc9-27afdbbe4e43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07438631cbbe4c1e9aaed2ab509ae188', 'request_id': 'req-5d8f74b8-f2cc-4175-8fc9-27afdbbe4e43'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:17.702336 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5d8f74b8-f2cc-4175-8fc9-27afdbbe4e43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07438631cbbe4c1e9aaed2ab509ae188', 'request_id': 'req-5d8f74b8-f2cc-4175-8fc9-27afdbbe4e43'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:17.794322 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5d8f74b8-f2cc-4175-8fc9-27afdbbe4e43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07438631cbbe4c1e9aaed2ab509ae188', 'request_id': 'req-5d8f74b8-f2cc-4175-8fc9-27afdbbe4e43'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:17.814810 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5d8f74b8-f2cc-4175-8fc9-27afdbbe4e43 admin admin] The token cache is being invalidate because project 07438631cbbe4c1e9aaed2ab509ae188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:21:17.815105 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5d8f74b8-f2cc-4175-8fc9-27afdbbe4e43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:17.819577 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5d8f74b8-f2cc-4175-8fc9-27afdbbe4e43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:17.831393 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 835/1662] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:21:17 2022] DELETE /identity/v3/projects/07438631cbbe4c1e9aaed2ab509ae188 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:17.832657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a1a43-a184-441f-9453-e7f5b56f6a96 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:17.833165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a1a43-a184-441f-9453-e7f5b56f6a96 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:17.833633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a1a43-a184-441f-9453-e7f5b56f6a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:17.869820 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-128a1a43-a184-441f-9453-e7f5b56f6a96 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:17.872336 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-128a1a43-a184-441f-9453-e7f5b56f6a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:18.052404 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 828/1663] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:18.070772 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa97ac1-8293-43c5-90db-d27f0df7b381 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:18.071068 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa97ac1-8293-43c5-90db-d27f0df7b381 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:18.071348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa97ac1-8293-43c5-90db-d27f0df7b381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:18.169463 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1fa97ac1-8293-43c5-90db-d27f0df7b381 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:18.175869 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1fa97ac1-8293-43c5-90db-d27f0df7b381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:18.227978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 836/1664] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:18.229653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a1a43-a184-441f-9453-e7f5b56f6a96 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:18.246152 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a1a43-a184-441f-9453-e7f5b56f6a96 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:18.269004 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef9aa9-57cb-43e8-a9c5-5b93ba8844c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:18.271748 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef9aa9-57cb-43e8-a9c5-5b93ba8844c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:18.272039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef9aa9-57cb-43e8-a9c5-5b93ba8844c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:18.272472 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef9aa9-57cb-43e8-a9c5-5b93ba8844c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:18.273381 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef9aa9-57cb-43e8-a9c5-5b93ba8844c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:21:18.276022 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef9aa9-57cb-43e8-a9c5-5b93ba8844c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:18.283059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef9aa9-57cb-43e8-a9c5-5b93ba8844c2 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:18.329040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa97ac1-8293-43c5-90db-d27f0df7b381 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:18.340709 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa97ac1-8293-43c5-90db-d27f0df7b381 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:18.340992 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 829/1665] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:21:18.389329 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec0d1b-a812-4e2c-92b7-8562526d619c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:18.390708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec0d1b-a812-4e2c-92b7-8562526d619c admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:18.391215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec0d1b-a812-4e2c-92b7-8562526d619c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:18.391720 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec0d1b-a812-4e2c-92b7-8562526d619c admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:18.392630 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec0d1b-a812-4e2c-92b7-8562526d619c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:18.394853 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec0d1b-a812-4e2c-92b7-8562526d619c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:18.523532 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 837/1666] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:21:18 2022] POST /identity/v3/projects => generated 365 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:18.523628 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef9aa9-57cb-43e8-a9c5-5b93ba8844c2 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:18.541496 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef9aa9-57cb-43e8-a9c5-5b93ba8844c2 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:18.707936 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acef7a7-b87f-4f7e-b6db-16b6450aa278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:18.711203 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acef7a7-b87f-4f7e-b6db-16b6450aa278 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:18.711639 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acef7a7-b87f-4f7e-b6db-16b6450aa278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:18.713253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acef7a7-b87f-4f7e-b6db-16b6450aa278 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:18.715546 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acef7a7-b87f-4f7e-b6db-16b6450aa278 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:18.720029 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acef7a7-b87f-4f7e-b6db-16b6450aa278 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:18.781702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517bcb5-8f80-4556-b259-e8dd2ed9f479 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:18.782003 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517bcb5-8f80-4556-b259-e8dd2ed9f479 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:18.782323 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517bcb5-8f80-4556-b259-e8dd2ed9f479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:18.831362 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1517bcb5-8f80-4556-b259-e8dd2ed9f479 None None] MFA Rules not processed for user `1a7181297bf14a57b3bf1f3c8b178d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:18.832680 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1517bcb5-8f80-4556-b259-e8dd2ed9f479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:18.854804 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 830/1667] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:21:18 2022] POST /identity/v3/users => generated 283 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:18.856324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acef7a7-b87f-4f7e-b6db-16b6450aa278 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:18.867228 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acef7a7-b87f-4f7e-b6db-16b6450aa278 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:18.872837 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65000b3b-87ea-4294-af8b-a28ea29b8dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:18.875749 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65000b3b-87ea-4294-af8b-a28ea29b8dac admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:18.875749 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65000b3b-87ea-4294-af8b-a28ea29b8dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:18.875749 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65000b3b-87ea-4294-af8b-a28ea29b8dac admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:18.875749 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65000b3b-87ea-4294-af8b-a28ea29b8dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:18.877742 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65000b3b-87ea-4294-af8b-a28ea29b8dac admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:18.904459 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 831/1668] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:18.908261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65000b3b-87ea-4294-af8b-a28ea29b8dac admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:18.918541 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65000b3b-87ea-4294-af8b-a28ea29b8dac admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:18.924334 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5e39e-5f4b-4295-92f2-6cce7693bbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:18.925342 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5e39e-5f4b-4295-92f2-6cce7693bbcd admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:18.925910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5e39e-5f4b-4295-92f2-6cce7693bbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:18.927014 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5e39e-5f4b-4295-92f2-6cce7693bbcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:18.928043 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5e39e-5f4b-4295-92f2-6cce7693bbcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:18.930169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5e39e-5f4b-4295-92f2-6cce7693bbcd admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:18.944557 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 832/1669] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:18.948618 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5e39e-5f4b-4295-92f2-6cce7693bbcd admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:18.963000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 838/1670] 10.222.0.76 () {58 vars in 1009 bytes} [Mon May 16 15:21:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:18.969177 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5e39e-5f4b-4295-92f2-6cce7693bbcd admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:18.973465 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517bcb5-8f80-4556-b259-e8dd2ed9f479 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:18.975019 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1517bcb5-8f80-4556-b259-e8dd2ed9f479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:18.977300 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c13dbe-6f84-40d9-ac49-e71dd75a59dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:18.978418 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c13dbe-6f84-40d9-ac49-e71dd75a59dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:18.978863 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c13dbe-6f84-40d9-ac49-e71dd75a59dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:18.979454 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c13dbe-6f84-40d9-ac49-e71dd75a59dc admin admin] PATH_INFO: `/v3/projects/f5a8c5a7911e46abb77217c0291cd2ef/users/599c3952ecef4e27b952980036b501df/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:19.002507 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517bcb5-8f80-4556-b259-e8dd2ed9f479 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:19.006639 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c13dbe-6f84-40d9-ac49-e71dd75a59dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a8c5a7911e46abb77217c0291cd2ef, user_id=599c3952ecef4e27b952980036b501df, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:19.009543 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c13dbe-6f84-40d9-ac49-e71dd75a59dc admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:19.016871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98981e-5952-4a58-a010-064f220e847c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:19.017758 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98981e-5952-4a58-a010-064f220e847c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:19.018063 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98981e-5952-4a58-a010-064f220e847c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:19.018338 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98981e-5952-4a58-a010-064f220e847c admin admin] PATH_INFO: `/v3/projects/22a3cb5588d9482389dcef1c48aabe67` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:19.019881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98981e-5952-4a58-a010-064f220e847c admin admin] RBAC: Authorizing `identity:delete_project(project_id=22a3cb5588d9482389dcef1c48aabe67)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:19.021515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98981e-5952-4a58-a010-064f220e847c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:19.122983 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 833/1671] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:18 2022] PUT /identity/v3/projects/f5a8c5a7911e46abb77217c0291cd2ef/users/599c3952ecef4e27b952980036b501df/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:19.128766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d22306-94a4-487a-b609-1bbc26e113f2 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:19.129119 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d22306-94a4-487a-b609-1bbc26e113f2 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:19.129412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d22306-94a4-487a-b609-1bbc26e113f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:19.203987 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-c7d22306-94a4-487a-b609-1bbc26e113f2 None None] MFA Rules not processed for user `599c3952ecef4e27b952980036b501df`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:19.205595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c7d22306-94a4-487a-b609-1bbc26e113f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:19.223712 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6b98981e-5952-4a58-a010-064f220e847c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22a3cb5588d9482389dcef1c48aabe67', 'request_id': 'req-6b98981e-5952-4a58-a010-064f220e847c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:19.231154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6b98981e-5952-4a58-a010-064f220e847c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22a3cb5588d9482389dcef1c48aabe67', 'request_id': 'req-6b98981e-5952-4a58-a010-064f220e847c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:19.302473 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6b98981e-5952-4a58-a010-064f220e847c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22a3cb5588d9482389dcef1c48aabe67', 'request_id': 'req-6b98981e-5952-4a58-a010-064f220e847c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:19.319916 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6b98981e-5952-4a58-a010-064f220e847c admin admin] The token cache is being invalidate because project 22a3cb5588d9482389dcef1c48aabe67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:21:19.320483 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6b98981e-5952-4a58-a010-064f220e847c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:19.326367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6b98981e-5952-4a58-a010-064f220e847c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:19.328661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 839/1672] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:21:18 2022] DELETE /identity/v3/projects/22a3cb5588d9482389dcef1c48aabe67 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:19.333135 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49226ff0-34d5-48c2-9bfc-afa988f9b4a7 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:19.335151 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49226ff0-34d5-48c2-9bfc-afa988f9b4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:19.335151 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49226ff0-34d5-48c2-9bfc-afa988f9b4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:19.352647 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 834/1673] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:19.356941 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d22306-94a4-487a-b609-1bbc26e113f2 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:19.361538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c7d22306-94a4-487a-b609-1bbc26e113f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:19.386248 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-49226ff0-34d5-48c2-9bfc-afa988f9b4a7 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:19.387790 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-49226ff0-34d5-48c2-9bfc-afa988f9b4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:19.507361 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d22306-94a4-487a-b609-1bbc26e113f2 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:19.519996 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5970b-87d5-4454-aa02-df0b9b874420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:19.520828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5970b-87d5-4454-aa02-df0b9b874420 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:19.521211 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5970b-87d5-4454-aa02-df0b9b874420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:19.522213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5970b-87d5-4454-aa02-df0b9b874420 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:19.522584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5970b-87d5-4454-aa02-df0b9b874420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:19.527772 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5970b-87d5-4454-aa02-df0b9b874420 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:19.549327 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 840/1674] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:21:19.557371 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2c735-75ed-4944-b807-d65f95eb9154 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:19.557554 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2c735-75ed-4944-b807-d65f95eb9154 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:19.557780 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2c735-75ed-4944-b807-d65f95eb9154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:19.595425 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a3e2c735-75ed-4944-b807-d65f95eb9154 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:19.597111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a3e2c735-75ed-4944-b807-d65f95eb9154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:19.610876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 841/1675] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:21:19.612133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2c735-75ed-4944-b807-d65f95eb9154 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:19.615195 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a3e2c735-75ed-4944-b807-d65f95eb9154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:19.677030 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 835/1676] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:21:19 2022] POST /identity/v3/projects => generated 365 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:21:19.678221 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5970b-87d5-4454-aa02-df0b9b874420 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:19.765927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2c735-75ed-4944-b807-d65f95eb9154 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:19.823328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5970b-87d5-4454-aa02-df0b9b874420 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:19.837218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664ef93-4318-4757-8f8e-e833e922ed45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:19.838100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664ef93-4318-4757-8f8e-e833e922ed45 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:19.838418 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664ef93-4318-4757-8f8e-e833e922ed45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:19.838788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664ef93-4318-4757-8f8e-e833e922ed45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:19.839637 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664ef93-4318-4757-8f8e-e833e922ed45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:21:19.840035 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664ef93-4318-4757-8f8e-e833e922ed45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:19.844702 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664ef93-4318-4757-8f8e-e833e922ed45 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:19.869835 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 836/1677] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:21:19.870881 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664ef93-4318-4757-8f8e-e833e922ed45 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:19.893162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664ef93-4318-4757-8f8e-e833e922ed45 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:19.911609 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94f0f3-8a3c-4695-8d4b-b1c23b4ecc35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33470e30760842ca9e96bb7f0cf9f07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:19.912283 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94f0f3-8a3c-4695-8d4b-b1c23b4ecc35 service swift] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:19.912569 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94f0f3-8a3c-4695-8d4b-b1c23b4ecc35 service swift] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:19.912851 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94f0f3-8a3c-4695-8d4b-b1c23b4ecc35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:19.912948 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25edf448-be98-4594-a97f-c6a829647b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:19.913808 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edf448-be98-4594-a97f-c6a829647b06 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:19.914209 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edf448-be98-4594-a97f-c6a829647b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:19.914583 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edf448-be98-4594-a97f-c6a829647b06 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:19.915381 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25edf448-be98-4594-a97f-c6a829647b06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:19.915494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9f94f0f3-8a3c-4695-8d4b-b1c23b4ecc35 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:19.917502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25edf448-be98-4594-a97f-c6a829647b06 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:20.016539 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 837/1678] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:21:19 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:20.017595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25edf448-be98-4594-a97f-c6a829647b06 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:20.035174 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25edf448-be98-4594-a97f-c6a829647b06 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:20.050201 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1331b7-1619-43eb-a97d-d2878d2a3dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:20.051140 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1331b7-1619-43eb-a97d-d2878d2a3dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:20.051614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1331b7-1619-43eb-a97d-d2878d2a3dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:20.052099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1331b7-1619-43eb-a97d-d2878d2a3dc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:20.052998 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1331b7-1619-43eb-a97d-d2878d2a3dc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:20.055167 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1331b7-1619-43eb-a97d-d2878d2a3dc7 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:20.060351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94f0f3-8a3c-4695-8d4b-b1c23b4ecc35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:20.063176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94f0f3-8a3c-4695-8d4b-b1c23b4ecc35 service swift] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:20.108255 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 842/1679] 10.222.0.76 () {60 vars in 1384 bytes} [Mon May 16 15:21:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:21:20.112053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94f0f3-8a3c-4695-8d4b-b1c23b4ecc35 service swift] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:20.139924 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94f0f3-8a3c-4695-8d4b-b1c23b4ecc35 service swift] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:20.158868 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf27d1-adc7-4978-8518-7f696c9b104c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:20.159937 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf27d1-adc7-4978-8518-7f696c9b104c admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:20.160386 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf27d1-adc7-4978-8518-7f696c9b104c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:20.160813 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf27d1-adc7-4978-8518-7f696c9b104c admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:20.161731 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf27d1-adc7-4978-8518-7f696c9b104c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:20.163710 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf27d1-adc7-4978-8518-7f696c9b104c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:20.221869 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 843/1680] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:20.226626 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf27d1-adc7-4978-8518-7f696c9b104c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:20.249110 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf27d1-adc7-4978-8518-7f696c9b104c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:20.270691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d56e7d-c625-400d-ba05-1a370e63e3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:20.272023 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d56e7d-c625-400d-ba05-1a370e63e3c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:20.272472 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d56e7d-c625-400d-ba05-1a370e63e3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:20.272944 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d56e7d-c625-400d-ba05-1a370e63e3c9 admin admin] PATH_INFO: `/v3/projects/011408e430344c008c53c55ff738b1ec/users/6ccad66cb56c481cad6b8881f2621b57/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:20.310016 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d56e7d-c625-400d-ba05-1a370e63e3c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=011408e430344c008c53c55ff738b1ec, user_id=6ccad66cb56c481cad6b8881f2621b57, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:20.314627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d56e7d-c625-400d-ba05-1a370e63e3c9 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:20.402050 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 838/1681] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:21:20 2022] POST /identity/v3/projects => generated 387 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:20.407626 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1331b7-1619-43eb-a97d-d2878d2a3dc7 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:20.416901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 844/1682] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:20 2022] PUT /identity/v3/projects/011408e430344c008c53c55ff738b1ec/users/6ccad66cb56c481cad6b8881f2621b57/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:20.421021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d56e7d-c625-400d-ba05-1a370e63e3c9 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:20.565178 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d56e7d-c625-400d-ba05-1a370e63e3c9 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:20.588969 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6c155-eb03-4771-820b-82bbfd147621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:20.591575 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6c155-eb03-4771-820b-82bbfd147621 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:20.592090 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6c155-eb03-4771-820b-82bbfd147621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:20.592523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6c155-eb03-4771-820b-82bbfd147621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:20.593443 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6c155-eb03-4771-820b-82bbfd147621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:20.595279 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6c155-eb03-4771-820b-82bbfd147621 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:20.615238 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 845/1683] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:20.616586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6c155-eb03-4771-820b-82bbfd147621 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:20.648829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6c155-eb03-4771-820b-82bbfd147621 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:20.658917 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b34d5-f616-4ede-9600-dfbee50dc717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:20.660072 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b34d5-f616-4ede-9600-dfbee50dc717 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:20.660603 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b34d5-f616-4ede-9600-dfbee50dc717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:20.661111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b34d5-f616-4ede-9600-dfbee50dc717 admin admin] PATH_INFO: `/v3/projects/011408e430344c008c53c55ff738b1ec/users/6ccad66cb56c481cad6b8881f2621b57/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:20.663392 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1331b7-1619-43eb-a97d-d2878d2a3dc7 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:20.664123 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b34d5-f616-4ede-9600-dfbee50dc717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=011408e430344c008c53c55ff738b1ec, user_id=6ccad66cb56c481cad6b8881f2621b57, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:20.667218 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b34d5-f616-4ede-9600-dfbee50dc717 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:20.684912 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dd351-7a6f-496b-a57c-4631807489c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:20.687439 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dd351-7a6f-496b-a57c-4631807489c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:20.688890 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dd351-7a6f-496b-a57c-4631807489c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:20.689863 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dd351-7a6f-496b-a57c-4631807489c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:20.691478 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828dd351-7a6f-496b-a57c-4631807489c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:20.698194 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828dd351-7a6f-496b-a57c-4631807489c1 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:20.704659 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 846/1684] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:20 2022] PUT /identity/v3/projects/011408e430344c008c53c55ff738b1ec/users/6ccad66cb56c481cad6b8881f2621b57/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:20.706458 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24045a2-6cde-43bb-8413-e84f4282b6b4 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:20.707188 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24045a2-6cde-43bb-8413-e84f4282b6b4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:20.707612 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24045a2-6cde-43bb-8413-e84f4282b6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:20.740000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a24045a2-6cde-43bb-8413-e84f4282b6b4 None None] MFA Rules not processed for user `6ccad66cb56c481cad6b8881f2621b57`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:20.741787 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a24045a2-6cde-43bb-8413-e84f4282b6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:20.843264 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 839/1685] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:21:20 2022] POST /identity/v3/users => generated 294 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:21:20.844775 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dd351-7a6f-496b-a57c-4631807489c1 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:20.864448 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dd351-7a6f-496b-a57c-4631807489c1 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:20.882747 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 847/1686] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:20 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:20.888660 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24045a2-6cde-43bb-8413-e84f4282b6b4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:20.891165 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a24045a2-6cde-43bb-8413-e84f4282b6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:20.999619 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24045a2-6cde-43bb-8413-e84f4282b6b4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:21.008469 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed803932-a50d-4d06-b6f3-4dde5bb3bc52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:21.009471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed803932-a50d-4d06-b6f3-4dde5bb3bc52 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:21.009757 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed803932-a50d-4d06-b6f3-4dde5bb3bc52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:21.010028 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed803932-a50d-4d06-b6f3-4dde5bb3bc52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:21.027794 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad4f06-1e45-43ad-a853-55047d7cf1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:21.031115 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad4f06-1e45-43ad-a853-55047d7cf1dc admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:21.031115 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad4f06-1e45-43ad-a853-55047d7cf1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:21.031115 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad4f06-1e45-43ad-a853-55047d7cf1dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:21.031115 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad4f06-1e45-43ad-a853-55047d7cf1dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:21.032091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad4f06-1e45-43ad-a853-55047d7cf1dc admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:21.045590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed803932-a50d-4d06-b6f3-4dde5bb3bc52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:21.047374 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed803932-a50d-4d06-b6f3-4dde5bb3bc52 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:21.067006 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 840/1687] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:21.070373 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad4f06-1e45-43ad-a853-55047d7cf1dc admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:21.090675 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 848/1688] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:20 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:21:21.099790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad4f06-1e45-43ad-a853-55047d7cf1dc admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:21.119501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc431d-159a-490e-953a-f9e79d0eacdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:21.122928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc431d-159a-490e-953a-f9e79d0eacdf admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:21.122928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc431d-159a-490e-953a-f9e79d0eacdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:21.122928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc431d-159a-490e-953a-f9e79d0eacdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:21.122928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc431d-159a-490e-953a-f9e79d0eacdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:21.124969 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc431d-159a-490e-953a-f9e79d0eacdf admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:21.137199 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 841/1689] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:21.142098 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed803932-a50d-4d06-b6f3-4dde5bb3bc52 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:21.173038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed803932-a50d-4d06-b6f3-4dde5bb3bc52 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:21.198024 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34523a-7e75-4f0d-b193-82d5a4757fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:21.198986 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34523a-7e75-4f0d-b193-82d5a4757fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:21.199276 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34523a-7e75-4f0d-b193-82d5a4757fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:21.199555 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34523a-7e75-4f0d-b193-82d5a4757fc5 admin admin] PATH_INFO: `/v3/projects/c9f4c691fe094e75933fcb8b9d2fa41c/users/a5dee74465344c3f9e6983daca4d4657/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:21.239973 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34523a-7e75-4f0d-b193-82d5a4757fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f4c691fe094e75933fcb8b9d2fa41c, user_id=a5dee74465344c3f9e6983daca4d4657, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:21.242993 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34523a-7e75-4f0d-b193-82d5a4757fc5 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:21.381570 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 849/1690] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:21 2022] PUT /identity/v3/projects/c9f4c691fe094e75933fcb8b9d2fa41c/users/a5dee74465344c3f9e6983daca4d4657/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:21.383458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a54f2-09c9-4ecf-85f8-b0f271920436 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:21.384881 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a54f2-09c9-4ecf-85f8-b0f271920436 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:21.385967 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a54f2-09c9-4ecf-85f8-b0f271920436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:21.513358 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-126a54f2-09c9-4ecf-85f8-b0f271920436 None None] MFA Rules not processed for user `a5dee74465344c3f9e6983daca4d4657`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:21.523468 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-126a54f2-09c9-4ecf-85f8-b0f271920436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:21.780217 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 842/1691] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:21:21.785457 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34523a-7e75-4f0d-b193-82d5a4757fc5 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:21.996798 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34523a-7e75-4f0d-b193-82d5a4757fc5 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:22.011736 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a982e7-5430-41d6-a775-e69a69c0ceee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:22.012458 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a982e7-5430-41d6-a775-e69a69c0ceee admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:22.012812 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a982e7-5430-41d6-a775-e69a69c0ceee admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:22.013007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a982e7-5430-41d6-a775-e69a69c0ceee admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:22.014265 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a982e7-5430-41d6-a775-e69a69c0ceee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:22.016335 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a982e7-5430-41d6-a775-e69a69c0ceee admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:22.164096 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 850/1692] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:21:21 2022] POST /identity/v3/projects => generated 385 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:22.165329 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a54f2-09c9-4ecf-85f8-b0f271920436 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:22.214474 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a54f2-09c9-4ecf-85f8-b0f271920436 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:22.478298 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f5ece-53e4-4287-9705-8c24aa29ed60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:22.481255 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f5ece-53e4-4287-9705-8c24aa29ed60 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:22.482843 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f5ece-53e4-4287-9705-8c24aa29ed60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:22.484379 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f5ece-53e4-4287-9705-8c24aa29ed60 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:22.485976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f5ece-53e4-4287-9705-8c24aa29ed60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:22.492951 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f5ece-53e4-4287-9705-8c24aa29ed60 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:22.598515 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 843/1693] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:21:22 2022] POST /identity/v3/users => generated 299 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:22.602638 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a982e7-5430-41d6-a775-e69a69c0ceee admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:22.629032 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a982e7-5430-41d6-a775-e69a69c0ceee admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:22.677140 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd0952-f618-4390-a009-ec0aeb6e48de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:22.678109 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd0952-f618-4390-a009-ec0aeb6e48de admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:22.678608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd0952-f618-4390-a009-ec0aeb6e48de admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:22.679038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd0952-f618-4390-a009-ec0aeb6e48de admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:22.679941 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd0952-f618-4390-a009-ec0aeb6e48de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:22.681744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd0952-f618-4390-a009-ec0aeb6e48de admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:22.711459 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f5ece-53e4-4287-9705-8c24aa29ed60 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:22.712047 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 851/1694] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:22.733619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f5ece-53e4-4287-9705-8c24aa29ed60 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:22.768427 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55608c21-b643-49e9-8ae8-29c48c9015d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:22.772775 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55608c21-b643-49e9-8ae8-29c48c9015d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:22.778691 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55608c21-b643-49e9-8ae8-29c48c9015d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:22.779339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55608c21-b643-49e9-8ae8-29c48c9015d3 admin admin] PATH_INFO: `/v3/projects/fb61fa4850d14f78bc14c86b2daa6b1f/users/96ffbd01e74f4c66a59cc1f093b09cab/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:22.816306 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55608c21-b643-49e9-8ae8-29c48c9015d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb61fa4850d14f78bc14c86b2daa6b1f, user_id=96ffbd01e74f4c66a59cc1f093b09cab, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:22.819472 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55608c21-b643-49e9-8ae8-29c48c9015d3 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:22.941927 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 844/1695] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:22 2022] PUT /identity/v3/projects/fb61fa4850d14f78bc14c86b2daa6b1f/users/96ffbd01e74f4c66a59cc1f093b09cab/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:22.946005 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd0952-f618-4390-a009-ec0aeb6e48de admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:22.957070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd0952-f618-4390-a009-ec0aeb6e48de admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:23.069206 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55608c21-b643-49e9-8ae8-29c48c9015d3 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:23.073008 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-55608c21-b643-49e9-8ae8-29c48c9015d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:23.210550 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84fa35-62e8-4f92-ac3f-47ff0938425c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:23.211255 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84fa35-62e8-4f92-ac3f-47ff0938425c admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:23.211542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84fa35-62e8-4f92-ac3f-47ff0938425c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:23.211812 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84fa35-62e8-4f92-ac3f-47ff0938425c admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:23.220259 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84fa35-62e8-4f92-ac3f-47ff0938425c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:23.224693 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84fa35-62e8-4f92-ac3f-47ff0938425c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:23.235997 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55608c21-b643-49e9-8ae8-29c48c9015d3 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:23.254378 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfe2e5-fba1-4af7-ab5f-6f1476b862a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:23.255562 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfe2e5-fba1-4af7-ab5f-6f1476b862a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:23.255987 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfe2e5-fba1-4af7-ab5f-6f1476b862a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:23.256401 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfe2e5-fba1-4af7-ab5f-6f1476b862a0 admin admin] PATH_INFO: `/v3/users/6ef016cac9fa44fab9f96a4906ef6aff` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:23.258007 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfe2e5-fba1-4af7-ab5f-6f1476b862a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ef016cac9fa44fab9f96a4906ef6aff)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:23.260129 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfe2e5-fba1-4af7-ab5f-6f1476b862a0 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:23.290140 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 852/1696] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:23.295252 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84fa35-62e8-4f92-ac3f-47ff0938425c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:23.329215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84fa35-62e8-4f92-ac3f-47ff0938425c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:23.339504 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b00f2c-fdc6-43e5-aba2-fbf612d265e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:23.340707 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b00f2c-fdc6-43e5-aba2-fbf612d265e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:23.341149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b00f2c-fdc6-43e5-aba2-fbf612d265e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:23.341572 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b00f2c-fdc6-43e5-aba2-fbf612d265e3 admin admin] PATH_INFO: `/v3/users/599c3952ecef4e27b952980036b501df` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:23.347376 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b00f2c-fdc6-43e5-aba2-fbf612d265e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=599c3952ecef4e27b952980036b501df)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:23.350464 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b00f2c-fdc6-43e5-aba2-fbf612d265e3 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:23.521164 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1abfe2e5-fba1-4af7-ab5f-6f1476b862a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ef016cac9fa44fab9f96a4906ef6aff'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:23.602762 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1abfe2e5-fba1-4af7-ab5f-6f1476b862a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ef016cac9fa44fab9f96a4906ef6aff'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:23.610839 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1abfe2e5-fba1-4af7-ab5f-6f1476b862a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ef016cac9fa44fab9f96a4906ef6aff'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:23.640961 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f5b00f2c-fdc6-43e5-aba2-fbf612d265e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '599c3952ecef4e27b952980036b501df'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:23.646965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1abfe2e5-fba1-4af7-ab5f-6f1476b862a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ef016cac9fa44fab9f96a4906ef6aff'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:23.648078 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1abfe2e5-fba1-4af7-ab5f-6f1476b862a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ef016cac9fa44fab9f96a4906ef6aff'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:23.683988 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f5b00f2c-fdc6-43e5-aba2-fbf612d265e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '599c3952ecef4e27b952980036b501df'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:23.689032 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f5b00f2c-fdc6-43e5-aba2-fbf612d265e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '599c3952ecef4e27b952980036b501df'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:23.690019 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f5b00f2c-fdc6-43e5-aba2-fbf612d265e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '599c3952ecef4e27b952980036b501df'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:23.696855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 845/1697] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:21:23 2022] DELETE /identity/v3/users/6ef016cac9fa44fab9f96a4906ef6aff => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:23.696855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfe2e5-fba1-4af7-ab5f-6f1476b862a0 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:23.699724 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1abfe2e5-fba1-4af7-ab5f-6f1476b862a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:23.711062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f5b00f2c-fdc6-43e5-aba2-fbf612d265e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '599c3952ecef4e27b952980036b501df'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:23.822341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 853/1698] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:21:23 2022] DELETE /identity/v3/users/599c3952ecef4e27b952980036b501df => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:23.824044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2026cbc-d6e9-41c2-abba-291bdb6da687 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:23.824467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2026cbc-d6e9-41c2-abba-291bdb6da687 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:23.826459 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2026cbc-d6e9-41c2-abba-291bdb6da687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:23.833501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfe2e5-fba1-4af7-ab5f-6f1476b862a0 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:23.899330 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a2026cbc-d6e9-41c2-abba-291bdb6da687 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:23.900649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a2026cbc-d6e9-41c2-abba-291bdb6da687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:23.913913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c11bf-4cc5-4fa1-a9f4-1e03bbd14a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:23.915771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c11bf-4cc5-4fa1-a9f4-1e03bbd14a95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:23.916052 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c11bf-4cc5-4fa1-a9f4-1e03bbd14a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:23.916731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c11bf-4cc5-4fa1-a9f4-1e03bbd14a95 admin admin] PATH_INFO: `/v3/projects/fb61fa4850d14f78bc14c86b2daa6b1f/users/96ffbd01e74f4c66a59cc1f093b09cab/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:23.924766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c11bf-4cc5-4fa1-a9f4-1e03bbd14a95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb61fa4850d14f78bc14c86b2daa6b1f, user_id=96ffbd01e74f4c66a59cc1f093b09cab, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:23.938311 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c11bf-4cc5-4fa1-a9f4-1e03bbd14a95 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:23.954095 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 846/1699] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:23 2022] PUT /identity/v3/projects/fb61fa4850d14f78bc14c86b2daa6b1f/users/96ffbd01e74f4c66a59cc1f093b09cab/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:23.955466 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35034a8f-14e5-4349-9a57-30bfc3ea7ba1 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:23.955751 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35034a8f-14e5-4349-9a57-30bfc3ea7ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:23.962456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35034a8f-14e5-4349-9a57-30bfc3ea7ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:23.962835 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 854/1700] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:23.964149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c2dd0-8a05-4af8-b41d-02899da76114 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:23.964447 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c2dd0-8a05-4af8-b41d-02899da76114 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:23.964748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c2dd0-8a05-4af8-b41d-02899da76114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:23.977191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-35034a8f-14e5-4349-9a57-30bfc3ea7ba1 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:23.978449 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-35034a8f-14e5-4349-9a57-30bfc3ea7ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:24.084067 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-3c1c2dd0-8a05-4af8-b41d-02899da76114 None None] MFA Rules not processed for user `96ffbd01e74f4c66a59cc1f093b09cab`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:24.085301 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3c1c2dd0-8a05-4af8-b41d-02899da76114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:24.117362 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 847/1701] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:24.123937 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35034a8f-14e5-4349-9a57-30bfc3ea7ba1 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:24.125477 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-35034a8f-14e5-4349-9a57-30bfc3ea7ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:24.330488 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35034a8f-14e5-4349-9a57-30bfc3ea7ba1 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:24.354865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e97c6-d172-41ab-ad1d-ad2b981bbe6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:24.355949 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e97c6-d172-41ab-ad1d-ad2b981bbe6f service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:24.363427 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e97c6-d172-41ab-ad1d-ad2b981bbe6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:24.363427 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e97c6-d172-41ab-ad1d-ad2b981bbe6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:24.375082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 855/1702] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:24.377666 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c2dd0-8a05-4af8-b41d-02899da76114 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:24.420008 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e97c6-d172-41ab-ad1d-ad2b981bbe6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:24.435083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e97c6-d172-41ab-ad1d-ad2b981bbe6f service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:24.453019 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c2dd0-8a05-4af8-b41d-02899da76114 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:24.468087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89631962-6588-40c7-9eec-371ef33e059d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:24.468087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89631962-6588-40c7-9eec-371ef33e059d service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:24.468389 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89631962-6588-40c7-9eec-371ef33e059d service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:24.468715 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89631962-6588-40c7-9eec-371ef33e059d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:24.480342 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 848/1703] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:24.484067 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e97c6-d172-41ab-ad1d-ad2b981bbe6f service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:24.488065 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3d1e97c6-d172-41ab-ad1d-ad2b981bbe6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:24.527102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89631962-6588-40c7-9eec-371ef33e059d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:24.529755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89631962-6588-40c7-9eec-371ef33e059d service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:24.575633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 856/1704] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:24.719718 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e97c6-d172-41ab-ad1d-ad2b981bbe6f service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:24.748871 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73273e74-719a-44a0-acea-1c6ac58b6615 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:24.753011 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73273e74-719a-44a0-acea-1c6ac58b6615 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:24.753011 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73273e74-719a-44a0-acea-1c6ac58b6615 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:24.753011 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73273e74-719a-44a0-acea-1c6ac58b6615 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:24.789311 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73273e74-719a-44a0-acea-1c6ac58b6615 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:24.795946 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73273e74-719a-44a0-acea-1c6ac58b6615 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:24.835057 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 849/1705] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:24.891214 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89631962-6588-40c7-9eec-371ef33e059d service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:24.892999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-89631962-6588-40c7-9eec-371ef33e059d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:24.931577 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89631962-6588-40c7-9eec-371ef33e059d service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:24.944977 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43148b27-cefe-4aef-a007-6304bc115642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:24.945906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43148b27-cefe-4aef-a007-6304bc115642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:24.946210 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43148b27-cefe-4aef-a007-6304bc115642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:24.946488 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43148b27-cefe-4aef-a007-6304bc115642 admin admin] PATH_INFO: `/v3/users/a5dee74465344c3f9e6983daca4d4657` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:24.956125 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43148b27-cefe-4aef-a007-6304bc115642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5dee74465344c3f9e6983daca4d4657)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:24.958228 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43148b27-cefe-4aef-a007-6304bc115642 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:25.239795 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-43148b27-cefe-4aef-a007-6304bc115642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5dee74465344c3f9e6983daca4d4657'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:25.298526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-43148b27-cefe-4aef-a007-6304bc115642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5dee74465344c3f9e6983daca4d4657'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:25.300763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-43148b27-cefe-4aef-a007-6304bc115642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5dee74465344c3f9e6983daca4d4657'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:25.306591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-43148b27-cefe-4aef-a007-6304bc115642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5dee74465344c3f9e6983daca4d4657'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:25.327644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-43148b27-cefe-4aef-a007-6304bc115642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5dee74465344c3f9e6983daca4d4657'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:25.424222 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 857/1706] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:21:24 2022] DELETE /identity/v3/users/a5dee74465344c3f9e6983daca4d4657 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:25.428855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225a66b-c9da-4541-ac9a-2e4536c1cb4d None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:25.429241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225a66b-c9da-4541-ac9a-2e4536c1cb4d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:25.429579 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225a66b-c9da-4541-ac9a-2e4536c1cb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:25.484174 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-6225a66b-c9da-4541-ac9a-2e4536c1cb4d None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:25.485607 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6225a66b-c9da-4541-ac9a-2e4536c1cb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:25.651872 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f3354-4611-4bd1-9815-fc2b2eddf1d5 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:25.652930 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f3354-4611-4bd1-9815-fc2b2eddf1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:25.653519 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f3354-4611-4bd1-9815-fc2b2eddf1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:25.677187 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 850/1707] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:25.691680 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a09f3354-4611-4bd1-9815-fc2b2eddf1d5 None None] MFA Rules not processed for user `15ff90527ece4406be62f449bdf71d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:25.693538 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a09f3354-4611-4bd1-9815-fc2b2eddf1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:25.792673 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225a66b-c9da-4541-ac9a-2e4536c1cb4d None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:25.799657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6225a66b-c9da-4541-ac9a-2e4536c1cb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:25.830880 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 858/1708] 10.222.0.79 () {58 vars in 1015 bytes} [Mon May 16 15:21:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:25.891735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f3354-4611-4bd1-9815-fc2b2eddf1d5 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:25.894016 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a09f3354-4611-4bd1-9815-fc2b2eddf1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:25.975811 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f3354-4611-4bd1-9815-fc2b2eddf1d5 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:25.988477 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3cad1-2046-4adb-a787-b1537034ee54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:25.989404 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3cad1-2046-4adb-a787-b1537034ee54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:25.989692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3cad1-2046-4adb-a787-b1537034ee54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:25.989974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3cad1-2046-4adb-a787-b1537034ee54 admin admin] PATH_INFO: `/v3/users/308affaff46d451b92d13ec41b635774` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:25.998715 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3cad1-2046-4adb-a787-b1537034ee54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=308affaff46d451b92d13ec41b635774)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:26.002499 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3cad1-2046-4adb-a787-b1537034ee54 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:26.055086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225a66b-c9da-4541-ac9a-2e4536c1cb4d None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:26.068398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279520df-5e77-469d-9617-ef5d649eff30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:26.069364 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279520df-5e77-469d-9617-ef5d649eff30 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:26.069869 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279520df-5e77-469d-9617-ef5d649eff30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:26.070396 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279520df-5e77-469d-9617-ef5d649eff30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:26.108745 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279520df-5e77-469d-9617-ef5d649eff30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:26.110627 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279520df-5e77-469d-9617-ef5d649eff30 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:26.142939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 851/1709] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:26.143801 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279520df-5e77-469d-9617-ef5d649eff30 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:26.146231 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-279520df-5e77-469d-9617-ef5d649eff30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:26.173274 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279520df-5e77-469d-9617-ef5d649eff30 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:26.178375 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462cbc6-80b3-4ff2-908d-9b4e271e0b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:26.188789 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462cbc6-80b3-4ff2-908d-9b4e271e0b10 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:26.189244 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462cbc6-80b3-4ff2-908d-9b4e271e0b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:26.189578 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462cbc6-80b3-4ff2-908d-9b4e271e0b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:26.205906 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462cbc6-80b3-4ff2-908d-9b4e271e0b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:26.208116 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462cbc6-80b3-4ff2-908d-9b4e271e0b10 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:26.247005 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 852/1710] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:26.251703 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f17bc1-68b2-4359-a0ba-d7357181e006 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:26.251992 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f17bc1-68b2-4359-a0ba-d7357181e006 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:26.252273 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f17bc1-68b2-4359-a0ba-d7357181e006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:26.309935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-65d3cad1-2046-4adb-a787-b1537034ee54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '308affaff46d451b92d13ec41b635774'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:26.351578 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-65d3cad1-2046-4adb-a787-b1537034ee54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '308affaff46d451b92d13ec41b635774'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:26.355058 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-65d3cad1-2046-4adb-a787-b1537034ee54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '308affaff46d451b92d13ec41b635774'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:26.355058 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-65d3cad1-2046-4adb-a787-b1537034ee54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '308affaff46d451b92d13ec41b635774'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:26.383878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-65d3cad1-2046-4adb-a787-b1537034ee54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '308affaff46d451b92d13ec41b635774'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:26.409316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-21f17bc1-68b2-4359-a0ba-d7357181e006 None None] MFA Rules not processed for user `6b16118d74774a9ea673d6e0532b8772`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:26.410683 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-21f17bc1-68b2-4359-a0ba-d7357181e006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:26.501525 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 859/1711] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:21:25 2022] DELETE /identity/v3/users/308affaff46d451b92d13ec41b635774 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:21:26.510777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3cad1-2046-4adb-a787-b1537034ee54 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:26.523108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-65d3cad1-2046-4adb-a787-b1537034ee54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:26.559391 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 853/1712] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:26.582364 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f17bc1-68b2-4359-a0ba-d7357181e006 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:26.584005 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-21f17bc1-68b2-4359-a0ba-d7357181e006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:26.768559 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3cad1-2046-4adb-a787-b1537034ee54 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:26.789056 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2412d01-5c0b-4508-a4f7-516f9a132e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:26.789945 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2412d01-5c0b-4508-a4f7-516f9a132e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:26.790258 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2412d01-5c0b-4508-a4f7-516f9a132e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:26.790534 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2412d01-5c0b-4508-a4f7-516f9a132e09 admin admin] PATH_INFO: `/v3/projects/c8fdce3b4e384ebda03b45760240aeb9` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:26.796255 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f17bc1-68b2-4359-a0ba-d7357181e006 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:26.797350 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2412d01-5c0b-4508-a4f7-516f9a132e09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8fdce3b4e384ebda03b45760240aeb9)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:26.807066 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2412d01-5c0b-4508-a4f7-516f9a132e09 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:26.945549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fceff9-d2b0-46c4-90d9-66daacddb2a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:26.948404 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fceff9-d2b0-46c4-90d9-66daacddb2a1 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:26.948404 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fceff9-d2b0-46c4-90d9-66daacddb2a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:26.948404 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fceff9-d2b0-46c4-90d9-66daacddb2a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:26.979004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d2412d01-5c0b-4508-a4f7-516f9a132e09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8fdce3b4e384ebda03b45760240aeb9', 'request_id': 'req-d2412d01-5c0b-4508-a4f7-516f9a132e09'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:26.992631 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d2412d01-5c0b-4508-a4f7-516f9a132e09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8fdce3b4e384ebda03b45760240aeb9', 'request_id': 'req-d2412d01-5c0b-4508-a4f7-516f9a132e09'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:27.077407 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d2412d01-5c0b-4508-a4f7-516f9a132e09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8fdce3b4e384ebda03b45760240aeb9', 'request_id': 'req-d2412d01-5c0b-4508-a4f7-516f9a132e09'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:27.115157 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d2412d01-5c0b-4508-a4f7-516f9a132e09 admin admin] The token cache is being invalidate because project c8fdce3b4e384ebda03b45760240aeb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:21:27.115458 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d2412d01-5c0b-4508-a4f7-516f9a132e09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:27.116890 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d2412d01-5c0b-4508-a4f7-516f9a132e09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:27.122639 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 860/1713] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:21:26 2022] DELETE /identity/v3/projects/c8fdce3b4e384ebda03b45760240aeb9 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:27.123327 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2412d01-5c0b-4508-a4f7-516f9a132e09 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:27.127842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d2412d01-5c0b-4508-a4f7-516f9a132e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:27.159244 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fceff9-d2b0-46c4-90d9-66daacddb2a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:27.167812 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fceff9-d2b0-46c4-90d9-66daacddb2a1 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:27.208406 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 854/1714] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:21:27.213097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268de65-c295-4264-be73-fe96a59ca21b None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:27.213418 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268de65-c295-4264-be73-fe96a59ca21b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:27.214918 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268de65-c295-4264-be73-fe96a59ca21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:27.292952 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-7268de65-c295-4264-be73-fe96a59ca21b None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:27.294480 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7268de65-c295-4264-be73-fe96a59ca21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:27.322152 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2412d01-5c0b-4508-a4f7-516f9a132e09 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:27.335654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9f1f5-9183-4c67-b4c0-bf1fb3f58ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:27.336658 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9f1f5-9183-4c67-b4c0-bf1fb3f58ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:27.336836 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9f1f5-9183-4c67-b4c0-bf1fb3f58ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:27.337089 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9f1f5-9183-4c67-b4c0-bf1fb3f58ebf admin admin] PATH_INFO: `/v3/projects/f5a8c5a7911e46abb77217c0291cd2ef` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:27.338577 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9f1f5-9183-4c67-b4c0-bf1fb3f58ebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5a8c5a7911e46abb77217c0291cd2ef)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:27.340207 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 855/1715] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:27.341139 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268de65-c295-4264-be73-fe96a59ca21b None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:27.347254 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7268de65-c295-4264-be73-fe96a59ca21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:27.353066 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9f1f5-9183-4c67-b4c0-bf1fb3f58ebf admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:27.368134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268de65-c295-4264-be73-fe96a59ca21b None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:27.374423 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22978b50-f84d-49b6-bdd4-93d8ebb385e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:27.375356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22978b50-f84d-49b6-bdd4-93d8ebb385e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:27.375632 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22978b50-f84d-49b6-bdd4-93d8ebb385e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:27.375974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22978b50-f84d-49b6-bdd4-93d8ebb385e6 admin admin] PATH_INFO: `/v3/projects/c9f4c691fe094e75933fcb8b9d2fa41c` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:27.377542 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22978b50-f84d-49b6-bdd4-93d8ebb385e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9f4c691fe094e75933fcb8b9d2fa41c)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:27.379966 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22978b50-f84d-49b6-bdd4-93d8ebb385e6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:27.513667 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f1c9f1f5-9183-4c67-b4c0-bf1fb3f58ebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5a8c5a7911e46abb77217c0291cd2ef', 'request_id': 'req-f1c9f1f5-9183-4c67-b4c0-bf1fb3f58ebf'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:27.530975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f1c9f1f5-9183-4c67-b4c0-bf1fb3f58ebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5a8c5a7911e46abb77217c0291cd2ef', 'request_id': 'req-f1c9f1f5-9183-4c67-b4c0-bf1fb3f58ebf'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:27.551416 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-22978b50-f84d-49b6-bdd4-93d8ebb385e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f4c691fe094e75933fcb8b9d2fa41c', 'request_id': 'req-22978b50-f84d-49b6-bdd4-93d8ebb385e6'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:27.617538 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f1c9f1f5-9183-4c67-b4c0-bf1fb3f58ebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5a8c5a7911e46abb77217c0291cd2ef', 'request_id': 'req-f1c9f1f5-9183-4c67-b4c0-bf1fb3f58ebf'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:27.636100 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f1c9f1f5-9183-4c67-b4c0-bf1fb3f58ebf admin admin] The token cache is being invalidate because project f5a8c5a7911e46abb77217c0291cd2ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:21:27.636514 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f1c9f1f5-9183-4c67-b4c0-bf1fb3f58ebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:27.637703 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f1c9f1f5-9183-4c67-b4c0-bf1fb3f58ebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:27.641245 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 861/1716] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:21:27 2022] DELETE /identity/v3/projects/f5a8c5a7911e46abb77217c0291cd2ef => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:27.645695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30cade-1a13-436c-b725-15a6598c4382 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:27.646441 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30cade-1a13-436c-b725-15a6598c4382 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:27.650029 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30cade-1a13-436c-b725-15a6598c4382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:27.691276 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-5a30cade-1a13-436c-b725-15a6598c4382 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:27.692736 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5a30cade-1a13-436c-b725-15a6598c4382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:27.695477 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-22978b50-f84d-49b6-bdd4-93d8ebb385e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f4c691fe094e75933fcb8b9d2fa41c', 'request_id': 'req-22978b50-f84d-49b6-bdd4-93d8ebb385e6'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:27.705113 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-22978b50-f84d-49b6-bdd4-93d8ebb385e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f4c691fe094e75933fcb8b9d2fa41c', 'request_id': 'req-22978b50-f84d-49b6-bdd4-93d8ebb385e6'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:27.737773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-22978b50-f84d-49b6-bdd4-93d8ebb385e6 admin admin] The token cache is being invalidate because project c9f4c691fe094e75933fcb8b9d2fa41c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:21:27.738518 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-22978b50-f84d-49b6-bdd4-93d8ebb385e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:27.741226 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-22978b50-f84d-49b6-bdd4-93d8ebb385e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:27.746301 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 856/1717] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:21:27 2022] DELETE /identity/v3/projects/c9f4c691fe094e75933fcb8b9d2fa41c => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:27.752479 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22978b50-f84d-49b6-bdd4-93d8ebb385e6 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:27.755904 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-22978b50-f84d-49b6-bdd4-93d8ebb385e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:27.890944 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 862/1718] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:27.892391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30cade-1a13-436c-b725-15a6598c4382 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:27.895024 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5a30cade-1a13-436c-b725-15a6598c4382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:27.925084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30cade-1a13-436c-b725-15a6598c4382 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:27.935381 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97ef92-284e-4b69-80f8-18b8016021d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:27.937019 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97ef92-284e-4b69-80f8-18b8016021d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:27.937906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97ef92-284e-4b69-80f8-18b8016021d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:27.938365 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97ef92-284e-4b69-80f8-18b8016021d5 admin admin] PATH_INFO: `/v3/users/6ccad66cb56c481cad6b8881f2621b57` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:27.939882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97ef92-284e-4b69-80f8-18b8016021d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ccad66cb56c481cad6b8881f2621b57)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:27.943004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97ef92-284e-4b69-80f8-18b8016021d5 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:27.950119 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22978b50-f84d-49b6-bdd4-93d8ebb385e6 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:27.964217 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609614e9-a43c-43e1-b282-890e57ba60e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:27.965832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609614e9-a43c-43e1-b282-890e57ba60e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:27.966376 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609614e9-a43c-43e1-b282-890e57ba60e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:27.966830 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609614e9-a43c-43e1-b282-890e57ba60e5 admin admin] PATH_INFO: `/v3/projects/611940cf6d7b434489cddc0c51bb4197` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:27.985098 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609614e9-a43c-43e1-b282-890e57ba60e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=611940cf6d7b434489cddc0c51bb4197)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:27.988729 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609614e9-a43c-43e1-b282-890e57ba60e5 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:28.221700 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-609614e9-a43c-43e1-b282-890e57ba60e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '611940cf6d7b434489cddc0c51bb4197', 'request_id': 'req-609614e9-a43c-43e1-b282-890e57ba60e5'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:28.222350 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-2a97ef92-284e-4b69-80f8-18b8016021d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ccad66cb56c481cad6b8881f2621b57'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:28.239495 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-2a97ef92-284e-4b69-80f8-18b8016021d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ccad66cb56c481cad6b8881f2621b57'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:28.240526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-2a97ef92-284e-4b69-80f8-18b8016021d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ccad66cb56c481cad6b8881f2621b57'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:28.241216 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-2a97ef92-284e-4b69-80f8-18b8016021d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ccad66cb56c481cad6b8881f2621b57'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:28.258794 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-2a97ef92-284e-4b69-80f8-18b8016021d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ccad66cb56c481cad6b8881f2621b57'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:28.313192 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-609614e9-a43c-43e1-b282-890e57ba60e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '611940cf6d7b434489cddc0c51bb4197', 'request_id': 'req-609614e9-a43c-43e1-b282-890e57ba60e5'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:28.322920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-609614e9-a43c-43e1-b282-890e57ba60e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '611940cf6d7b434489cddc0c51bb4197', 'request_id': 'req-609614e9-a43c-43e1-b282-890e57ba60e5'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:28.365796 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-609614e9-a43c-43e1-b282-890e57ba60e5 admin admin] The token cache is being invalidate because project 611940cf6d7b434489cddc0c51bb4197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:21:28.365796 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-609614e9-a43c-43e1-b282-890e57ba60e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:28.365796 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-609614e9-a43c-43e1-b282-890e57ba60e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:28.370286 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 857/1719] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:21:27 2022] DELETE /identity/v3/projects/611940cf6d7b434489cddc0c51bb4197 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:28.371674 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609614e9-a43c-43e1-b282-890e57ba60e5 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:28.374421 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-609614e9-a43c-43e1-b282-890e57ba60e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:28.439894 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 863/1720] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:21:27 2022] DELETE /identity/v3/users/6ccad66cb56c481cad6b8881f2621b57 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:28.441022 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97ef92-284e-4b69-80f8-18b8016021d5 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:28.444135 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2a97ef92-284e-4b69-80f8-18b8016021d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:28.577325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609614e9-a43c-43e1-b282-890e57ba60e5 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:28.587776 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5dd275-ca8e-4e28-b3f0-46c845acf5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:28.589066 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dd275-ca8e-4e28-b3f0-46c845acf5c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:28.589531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dd275-ca8e-4e28-b3f0-46c845acf5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:28.590277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dd275-ca8e-4e28-b3f0-46c845acf5c8 admin admin] PATH_INFO: `/v3/users/96ffbd01e74f4c66a59cc1f093b09cab` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:28.590954 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97ef92-284e-4b69-80f8-18b8016021d5 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:28.592118 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5dd275-ca8e-4e28-b3f0-46c845acf5c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96ffbd01e74f4c66a59cc1f093b09cab)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:28.594456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5dd275-ca8e-4e28-b3f0-46c845acf5c8 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:28.598714 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d23b64-3098-4196-876b-01f43995d1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:28.599485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d23b64-3098-4196-876b-01f43995d1ef admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:28.599897 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d23b64-3098-4196-876b-01f43995d1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:28.600293 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d23b64-3098-4196-876b-01f43995d1ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:28.601205 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d23b64-3098-4196-876b-01f43995d1ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:21:28.601584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d23b64-3098-4196-876b-01f43995d1ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:28.603545 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d23b64-3098-4196-876b-01f43995d1ef admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:28.626997 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 864/1721] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:21:28.627406 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f81b7d-e855-4455-9f5a-ec5f6240f8d6 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:28.628518 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f81b7d-e855-4455-9f5a-ec5f6240f8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:28.628518 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f81b7d-e855-4455-9f5a-ec5f6240f8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:28.689608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-90f81b7d-e855-4455-9f5a-ec5f6240f8d6 None None] MFA Rules not processed for user `d3492cec550a46598e09c48474a4c6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:28.691476 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-90f81b7d-e855-4455-9f5a-ec5f6240f8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:28.817567 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 865/1722] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:28.818617 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f81b7d-e855-4455-9f5a-ec5f6240f8d6 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:28.827753 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-90f81b7d-e855-4455-9f5a-ec5f6240f8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:28.854371 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f81b7d-e855-4455-9f5a-ec5f6240f8d6 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:28.861461 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159dda9-7132-4257-9254-537531ef54c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:28.862460 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159dda9-7132-4257-9254-537531ef54c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:28.863164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159dda9-7132-4257-9254-537531ef54c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:28.863811 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159dda9-7132-4257-9254-537531ef54c0 admin admin] PATH_INFO: `/v3/users/c585fdbe57db442e98ed9e02562b92ac` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:28.865412 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159dda9-7132-4257-9254-537531ef54c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c585fdbe57db442e98ed9e02562b92ac)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:28.867671 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159dda9-7132-4257-9254-537531ef54c0 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:28.929255 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-be5dd275-ca8e-4e28-b3f0-46c845acf5c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96ffbd01e74f4c66a59cc1f093b09cab'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:29.063111 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-be5dd275-ca8e-4e28-b3f0-46c845acf5c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96ffbd01e74f4c66a59cc1f093b09cab'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:29.065061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-be5dd275-ca8e-4e28-b3f0-46c845acf5c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96ffbd01e74f4c66a59cc1f093b09cab'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:29.101304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-be5dd275-ca8e-4e28-b3f0-46c845acf5c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96ffbd01e74f4c66a59cc1f093b09cab'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:29.102388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-be5dd275-ca8e-4e28-b3f0-46c845acf5c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96ffbd01e74f4c66a59cc1f093b09cab'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:29.158409 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 858/1723] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:21:28 2022] DELETE /identity/v3/users/96ffbd01e74f4c66a59cc1f093b09cab => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:29.160445 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5dd275-ca8e-4e28-b3f0-46c845acf5c8 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:29.162437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-be5dd275-ca8e-4e28-b3f0-46c845acf5c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:29.168520 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8159dda9-7132-4257-9254-537531ef54c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c585fdbe57db442e98ed9e02562b92ac'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:29.199539 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8159dda9-7132-4257-9254-537531ef54c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c585fdbe57db442e98ed9e02562b92ac'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:29.203772 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8159dda9-7132-4257-9254-537531ef54c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c585fdbe57db442e98ed9e02562b92ac'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:29.205791 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8159dda9-7132-4257-9254-537531ef54c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c585fdbe57db442e98ed9e02562b92ac'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:29.234485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8159dda9-7132-4257-9254-537531ef54c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c585fdbe57db442e98ed9e02562b92ac'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:29.314094 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 866/1724] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:21:28 2022] DELETE /identity/v3/users/c585fdbe57db442e98ed9e02562b92ac => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:29.315187 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159dda9-7132-4257-9254-537531ef54c0 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:29.320506 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8159dda9-7132-4257-9254-537531ef54c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:29.337823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5dd275-ca8e-4e28-b3f0-46c845acf5c8 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:29.480150 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8481f-a653-4aca-80b3-bc43241d84aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:29.481133 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8481f-a653-4aca-80b3-bc43241d84aa admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:29.481863 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8481f-a653-4aca-80b3-bc43241d84aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:29.483106 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8481f-a653-4aca-80b3-bc43241d84aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:29.484648 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8481f-a653-4aca-80b3-bc43241d84aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:29.489926 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8481f-a653-4aca-80b3-bc43241d84aa admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:29.510856 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159dda9-7132-4257-9254-537531ef54c0 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:29.526478 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba1805-fdd0-4f29-a141-7d36a55a0ff7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:29.527243 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba1805-fdd0-4f29-a141-7d36a55a0ff7 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:29.527613 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba1805-fdd0-4f29-a141-7d36a55a0ff7 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:29.528443 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba1805-fdd0-4f29-a141-7d36a55a0ff7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:29.534511 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5dba1805-fdd0-4f29-a141-7d36a55a0ff7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:29.635436 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 859/1725] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:21:29 2022] POST /identity/v3/projects => generated 373 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:29.637159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8481f-a653-4aca-80b3-bc43241d84aa admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:29.640515 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-bcd8481f-a653-4aca-80b3-bc43241d84aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:29.669051 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba1805-fdd0-4f29-a141-7d36a55a0ff7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:29.671435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba1805-fdd0-4f29-a141-7d36a55a0ff7 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:29.695864 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 867/1726] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:29.755728 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8481f-a653-4aca-80b3-bc43241d84aa admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:29.768173 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce626a-9d1a-467e-87a0-de98afff7321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:29.768929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce626a-9d1a-467e-87a0-de98afff7321 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:29.769803 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce626a-9d1a-467e-87a0-de98afff7321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:29.772764 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce626a-9d1a-467e-87a0-de98afff7321 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:29.773531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce626a-9d1a-467e-87a0-de98afff7321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:29.775558 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce626a-9d1a-467e-87a0-de98afff7321 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:29.913248 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba1805-fdd0-4f29-a141-7d36a55a0ff7 service nova] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:29.914158 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 860/1727] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:21:29 2022] POST /identity/v3/users => generated 287 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:29.931369 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba1805-fdd0-4f29-a141-7d36a55a0ff7 service nova] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:29.940829 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce626a-9d1a-467e-87a0-de98afff7321 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:29.944599 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-36ce626a-9d1a-467e-87a0-de98afff7321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:29.956728 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d1953-5c2a-4ae7-91fa-fc647b74f6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:29.957418 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d1953-5c2a-4ae7-91fa-fc647b74f6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:29.957701 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d1953-5c2a-4ae7-91fa-fc647b74f6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:29.957972 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d1953-5c2a-4ae7-91fa-fc647b74f6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:29.958746 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d1953-5c2a-4ae7-91fa-fc647b74f6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:29.960355 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d1953-5c2a-4ae7-91fa-fc647b74f6b6 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:29.975397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce626a-9d1a-467e-87a0-de98afff7321 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:29.987759 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f1ed9-286a-4124-bb0d-a1e6b72541e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:29.990702 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f1ed9-286a-4124-bb0d-a1e6b72541e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:29.990827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f1ed9-286a-4124-bb0d-a1e6b72541e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:29.991070 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f1ed9-286a-4124-bb0d-a1e6b72541e3 admin admin] PATH_INFO: `/v3/projects/011408e430344c008c53c55ff738b1ec` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:29.995592 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f1ed9-286a-4124-bb0d-a1e6b72541e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=011408e430344c008c53c55ff738b1ec)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:29.996505 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 868/1728] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:21:30.003725 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d1953-5c2a-4ae7-91fa-fc647b74f6b6 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:30.004513 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f1ed9-286a-4124-bb0d-a1e6b72541e3 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:30.061001 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d1953-5c2a-4ae7-91fa-fc647b74f6b6 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:30.091564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a788026-9899-4bc7-8b2b-174ad85b0d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:30.092321 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a788026-9899-4bc7-8b2b-174ad85b0d46 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:30.092637 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a788026-9899-4bc7-8b2b-174ad85b0d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:30.092914 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a788026-9899-4bc7-8b2b-174ad85b0d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:30.093690 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a788026-9899-4bc7-8b2b-174ad85b0d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:30.095381 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a788026-9899-4bc7-8b2b-174ad85b0d46 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:30.132685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 869/1729] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:30.133764 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a788026-9899-4bc7-8b2b-174ad85b0d46 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:30.157325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a788026-9899-4bc7-8b2b-174ad85b0d46 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:30.186684 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-4b0f1ed9-286a-4124-bb0d-a1e6b72541e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '011408e430344c008c53c55ff738b1ec', 'request_id': 'req-4b0f1ed9-286a-4124-bb0d-a1e6b72541e3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:30.267754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-4b0f1ed9-286a-4124-bb0d-a1e6b72541e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '011408e430344c008c53c55ff738b1ec', 'request_id': 'req-4b0f1ed9-286a-4124-bb0d-a1e6b72541e3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:30.279393 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-4b0f1ed9-286a-4124-bb0d-a1e6b72541e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '011408e430344c008c53c55ff738b1ec', 'request_id': 'req-4b0f1ed9-286a-4124-bb0d-a1e6b72541e3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:30.322603 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f42cef-7b31-46d9-b3c2-dcac7cd5e3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:30.322862 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-4b0f1ed9-286a-4124-bb0d-a1e6b72541e3 admin admin] The token cache is being invalidate because project 011408e430344c008c53c55ff738b1ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:21:30.323100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-4b0f1ed9-286a-4124-bb0d-a1e6b72541e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:30.324374 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f42cef-7b31-46d9-b3c2-dcac7cd5e3a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:30.324902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f42cef-7b31-46d9-b3c2-dcac7cd5e3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:30.325386 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f42cef-7b31-46d9-b3c2-dcac7cd5e3a6 admin admin] PATH_INFO: `/v3/projects/28a18cc5692e478096446e7a316f276f/users/ad6d4ac939d640fc9c2acb8beb119525/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:30.326429 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-4b0f1ed9-286a-4124-bb0d-a1e6b72541e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:30.337340 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 861/1730] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:21:29 2022] DELETE /identity/v3/projects/011408e430344c008c53c55ff738b1ec => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:21:30.342102 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97d9b5-39e3-4b53-adb8-f59d8248252c None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:30.344069 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97d9b5-39e3-4b53-adb8-f59d8248252c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:30.344586 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97d9b5-39e3-4b53-adb8-f59d8248252c None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:30.348926 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 862/1731] 10.222.0.76 () {54 vars in 921 bytes} [Mon May 16 15:21:30 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:21:30.353176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5f9af-79dc-42d4-b9d3-d59eeef90890 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:30.355065 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5f9af-79dc-42d4-b9d3-d59eeef90890 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:30.355571 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5f9af-79dc-42d4-b9d3-d59eeef90890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:30.366389 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f42cef-7b31-46d9-b3c2-dcac7cd5e3a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a18cc5692e478096446e7a316f276f, user_id=ad6d4ac939d640fc9c2acb8beb119525, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:30.369924 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f42cef-7b31-46d9-b3c2-dcac7cd5e3a6 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:30.414519 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-e2e5f9af-79dc-42d4-b9d3-d59eeef90890 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:30.415828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e2e5f9af-79dc-42d4-b9d3-d59eeef90890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:30.459509 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 863/1732] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:30.469131 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b30664-9f24-4b99-83b9-6cb3027d5311 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:30.469417 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b30664-9f24-4b99-83b9-6cb3027d5311 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:30.469712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b30664-9f24-4b99-83b9-6cb3027d5311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:30.491760 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 870/1733] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:30 2022] PUT /identity/v3/projects/28a18cc5692e478096446e7a316f276f/users/ad6d4ac939d640fc9c2acb8beb119525/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:30.505244 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05562471-f278-48bb-abd7-d4dd168956f1 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:30.505244 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05562471-f278-48bb-abd7-d4dd168956f1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:30.505244 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05562471-f278-48bb-abd7-d4dd168956f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:30.566803 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-60b30664-9f24-4b99-83b9-6cb3027d5311 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:30.569476 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-60b30664-9f24-4b99-83b9-6cb3027d5311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:30.631601 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-05562471-f278-48bb-abd7-d4dd168956f1 None None] MFA Rules not processed for user `ad6d4ac939d640fc9c2acb8beb119525`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:30.637031 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-05562471-f278-48bb-abd7-d4dd168956f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:30.851528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 864/1734] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:30.854338 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096d0c1-151f-4cb0-b76c-c5484e95b34a None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:30.855556 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096d0c1-151f-4cb0-b76c-c5484e95b34a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:30.856182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096d0c1-151f-4cb0-b76c-c5484e95b34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:30.919385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0096d0c1-151f-4cb0-b76c-c5484e95b34a None None] MFA Rules not processed for user `9d85024f010c40129d79543b3ec4cfae`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:30.921925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0096d0c1-151f-4cb0-b76c-c5484e95b34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:30.927487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 871/1735] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:30.928697 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05562471-f278-48bb-abd7-d4dd168956f1 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:30.933450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-05562471-f278-48bb-abd7-d4dd168956f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:30.973902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05562471-f278-48bb-abd7-d4dd168956f1 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:30.995192 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aff31e-7f1d-4efd-a79f-f433262ea5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:30.999290 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aff31e-7f1d-4efd-a79f-f433262ea5a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:31.000062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aff31e-7f1d-4efd-a79f-f433262ea5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:31.004077 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aff31e-7f1d-4efd-a79f-f433262ea5a9 admin admin] PATH_INFO: `/v3/projects/b3a02de1f5fe49cab974ab63a2f44790` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:31.014287 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aff31e-7f1d-4efd-a79f-f433262ea5a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3a02de1f5fe49cab974ab63a2f44790)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:31.021129 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aff31e-7f1d-4efd-a79f-f433262ea5a9 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:31.195506 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 865/1736] 10.222.0.76 () {58 vars in 1018 bytes} [Mon May 16 15:21:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:31.197578 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096d0c1-151f-4cb0-b76c-c5484e95b34a None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:31.210540 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096d0c1-151f-4cb0-b76c-c5484e95b34a None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:31.219147 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80804d-dba4-4bcc-9164-2d679870fa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:31.220046 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80804d-dba4-4bcc-9164-2d679870fa4d admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:31.220426 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80804d-dba4-4bcc-9164-2d679870fa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:31.220798 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80804d-dba4-4bcc-9164-2d679870fa4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:31.221910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80804d-dba4-4bcc-9164-2d679870fa4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:21:31.222338 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80804d-dba4-4bcc-9164-2d679870fa4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:31.225934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80804d-dba4-4bcc-9164-2d679870fa4d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:31.249843 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 866/1737] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:21:31.250827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80804d-dba4-4bcc-9164-2d679870fa4d admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:31.254849 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6e80804d-dba4-4bcc-9164-2d679870fa4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:31.282163 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80804d-dba4-4bcc-9164-2d679870fa4d admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:31.306419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-13aff31e-7f1d-4efd-a79f-f433262ea5a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3a02de1f5fe49cab974ab63a2f44790', 'request_id': 'req-13aff31e-7f1d-4efd-a79f-f433262ea5a9'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:31.336960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-13aff31e-7f1d-4efd-a79f-f433262ea5a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3a02de1f5fe49cab974ab63a2f44790', 'request_id': 'req-13aff31e-7f1d-4efd-a79f-f433262ea5a9'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:31.416012 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-13aff31e-7f1d-4efd-a79f-f433262ea5a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3a02de1f5fe49cab974ab63a2f44790', 'request_id': 'req-13aff31e-7f1d-4efd-a79f-f433262ea5a9'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:31.442863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-13aff31e-7f1d-4efd-a79f-f433262ea5a9 admin admin] The token cache is being invalidate because project b3a02de1f5fe49cab974ab63a2f44790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:21:31.443493 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-13aff31e-7f1d-4efd-a79f-f433262ea5a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:31.444939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-13aff31e-7f1d-4efd-a79f-f433262ea5a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:31.450216 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 872/1738] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:21:30 2022] DELETE /identity/v3/projects/b3a02de1f5fe49cab974ab63a2f44790 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:31.455058 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6e9bd-0b98-47c3-bcbb-03ca83cc0255 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:31.455526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b753841-c2a9-416e-ad23-6207079673ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:31.456371 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6e9bd-0b98-47c3-bcbb-03ca83cc0255 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:31.457014 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b753841-c2a9-416e-ad23-6207079673ad admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:31.457988 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b753841-c2a9-416e-ad23-6207079673ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:31.459618 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b753841-c2a9-416e-ad23-6207079673ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:31.461476 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6e9bd-0b98-47c3-bcbb-03ca83cc0255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:31.462434 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b753841-c2a9-416e-ad23-6207079673ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:31.467904 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b753841-c2a9-416e-ad23-6207079673ad admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:31.536956 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-5ea6e9bd-0b98-47c3-bcbb-03ca83cc0255 None None] MFA Rules not processed for user `6c6b9438bb4245b3908664bfece4ef22`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:31.539817 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5ea6e9bd-0b98-47c3-bcbb-03ca83cc0255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:31.648245 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 867/1739] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:21:31 2022] POST /identity/v3/projects => generated 371 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:31.655908 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b753841-c2a9-416e-ad23-6207079673ad admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:31.660766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3b753841-c2a9-416e-ad23-6207079673ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:31.760916 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 873/1740] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:31.762392 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6e9bd-0b98-47c3-bcbb-03ca83cc0255 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:31.766283 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5ea6e9bd-0b98-47c3-bcbb-03ca83cc0255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:31.824812 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6e9bd-0b98-47c3-bcbb-03ca83cc0255 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:31.918008 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b753841-c2a9-416e-ad23-6207079673ad admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:31.932127 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83d9e0-eff5-4002-a1d1-d27af8d104b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:31.932805 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83d9e0-eff5-4002-a1d1-d27af8d104b3 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:31.933091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83d9e0-eff5-4002-a1d1-d27af8d104b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:31.933370 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83d9e0-eff5-4002-a1d1-d27af8d104b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:31.941842 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1e83d9e0-eff5-4002-a1d1-d27af8d104b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:31.978922 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83d9e0-eff5-4002-a1d1-d27af8d104b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:31.981433 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83d9e0-eff5-4002-a1d1-d27af8d104b3 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:31.996211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc04f6-797e-48e9-94cc-d5a92a0396f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:31.997180 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc04f6-797e-48e9-94cc-d5a92a0396f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:31.998150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc04f6-797e-48e9-94cc-d5a92a0396f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:31.998541 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc04f6-797e-48e9-94cc-d5a92a0396f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:31.999401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc04f6-797e-48e9-94cc-d5a92a0396f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:32.003865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc04f6-797e-48e9-94cc-d5a92a0396f0 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:32.013128 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 868/1741] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:32.015215 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c62b5-74de-47ec-8a9f-79250df99aef None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:32.015507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c62b5-74de-47ec-8a9f-79250df99aef None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:32.015792 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c62b5-74de-47ec-8a9f-79250df99aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:32.062907 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-436c62b5-74de-47ec-8a9f-79250df99aef None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:32.064192 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-436c62b5-74de-47ec-8a9f-79250df99aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:32.090184 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 869/1742] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:32.091278 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c62b5-74de-47ec-8a9f-79250df99aef None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:32.100195 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-436c62b5-74de-47ec-8a9f-79250df99aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:32.128328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c62b5-74de-47ec-8a9f-79250df99aef None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:32.134083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86da471-b88a-4047-997f-75517ca73f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:32.136872 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86da471-b88a-4047-997f-75517ca73f9d admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:32.142630 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86da471-b88a-4047-997f-75517ca73f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:32.142630 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86da471-b88a-4047-997f-75517ca73f9d admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:32.142630 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86da471-b88a-4047-997f-75517ca73f9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:32.142630 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86da471-b88a-4047-997f-75517ca73f9d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:32.197722 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 874/1743] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:21:31 2022] POST /identity/v3/projects => generated 375 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:32.200347 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b8b7b-5864-4f5e-aef6-5bddb05c3315 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:32.200648 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b8b7b-5864-4f5e-aef6-5bddb05c3315 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:32.200982 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b8b7b-5864-4f5e-aef6-5bddb05c3315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:32.248242 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-102b8b7b-5864-4f5e-aef6-5bddb05c3315 None None] MFA Rules not processed for user `6c6b9438bb4245b3908664bfece4ef22`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:32.250609 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-102b8b7b-5864-4f5e-aef6-5bddb05c3315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:32.276863 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 870/1744] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:21:32 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:32.276863 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86da471-b88a-4047-997f-75517ca73f9d admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:32.278612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c86da471-b88a-4047-997f-75517ca73f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:32.324137 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86da471-b88a-4047-997f-75517ca73f9d admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:32.333921 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 875/1745] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:32.333921 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4515707-34c7-4e9d-a8db-b93efb82e86f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:32.333921 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4515707-34c7-4e9d-a8db-b93efb82e86f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:32.333921 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4515707-34c7-4e9d-a8db-b93efb82e86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:32.358839 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f4515707-34c7-4e9d-a8db-b93efb82e86f None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:32.360450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f4515707-34c7-4e9d-a8db-b93efb82e86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:32.451584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 876/1746] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:32.451584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4515707-34c7-4e9d-a8db-b93efb82e86f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:32.464361 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4515707-34c7-4e9d-a8db-b93efb82e86f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:32.484876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe707c1e-1d48-408c-b335-2af5dc4a89dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:32.485739 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe707c1e-1d48-408c-b335-2af5dc4a89dc admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:32.486028 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe707c1e-1d48-408c-b335-2af5dc4a89dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:32.486333 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe707c1e-1d48-408c-b335-2af5dc4a89dc admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:32.487052 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe707c1e-1d48-408c-b335-2af5dc4a89dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:32.492089 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe707c1e-1d48-408c-b335-2af5dc4a89dc admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:32.545858 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3f98d-40c2-465f-bdc5-e8ac10f67b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:32.548732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3f98d-40c2-465f-bdc5-e8ac10f67b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:32.549029 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3f98d-40c2-465f-bdc5-e8ac10f67b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:32.550564 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3f98d-40c2-465f-bdc5-e8ac10f67b9c admin admin] PATH_INFO: `/v3/projects/fb61fa4850d14f78bc14c86b2daa6b1f` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:32.553270 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae3f98d-40c2-465f-bdc5-e8ac10f67b9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb61fa4850d14f78bc14c86b2daa6b1f)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:32.559196 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae3f98d-40c2-465f-bdc5-e8ac10f67b9c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:32.619367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 877/1747] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:21:32 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:32.628207 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe707c1e-1d48-408c-b335-2af5dc4a89dc admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:32.656938 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe707c1e-1d48-408c-b335-2af5dc4a89dc admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:32.665520 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170da050-c191-4045-8b98-43cf2b664aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:32.667276 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170da050-c191-4045-8b98-43cf2b664aab admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:32.667790 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170da050-c191-4045-8b98-43cf2b664aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:32.667965 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170da050-c191-4045-8b98-43cf2b664aab admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:32.670610 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170da050-c191-4045-8b98-43cf2b664aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:32.673230 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170da050-c191-4045-8b98-43cf2b664aab admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:32.690083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 878/1748] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:32.692372 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170da050-c191-4045-8b98-43cf2b664aab admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:32.694728 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-170da050-c191-4045-8b98-43cf2b664aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:32.736777 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-aae3f98d-40c2-465f-bdc5-e8ac10f67b9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb61fa4850d14f78bc14c86b2daa6b1f', 'request_id': 'req-aae3f98d-40c2-465f-bdc5-e8ac10f67b9c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:32.804756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-aae3f98d-40c2-465f-bdc5-e8ac10f67b9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb61fa4850d14f78bc14c86b2daa6b1f', 'request_id': 'req-aae3f98d-40c2-465f-bdc5-e8ac10f67b9c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:32.816751 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-aae3f98d-40c2-465f-bdc5-e8ac10f67b9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb61fa4850d14f78bc14c86b2daa6b1f', 'request_id': 'req-aae3f98d-40c2-465f-bdc5-e8ac10f67b9c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:32.859342 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-aae3f98d-40c2-465f-bdc5-e8ac10f67b9c admin admin] The token cache is being invalidate because project fb61fa4850d14f78bc14c86b2daa6b1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:21:32.859645 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-aae3f98d-40c2-465f-bdc5-e8ac10f67b9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:32.862687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-aae3f98d-40c2-465f-bdc5-e8ac10f67b9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:32.867552 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 871/1749] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:21:32 2022] DELETE /identity/v3/projects/fb61fa4850d14f78bc14c86b2daa6b1f => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:32.867552 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3f98d-40c2-465f-bdc5-e8ac10f67b9c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:32.877192 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-aae3f98d-40c2-465f-bdc5-e8ac10f67b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:32.918562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170da050-c191-4045-8b98-43cf2b664aab admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:33.040771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac8e14-4371-4704-9eb4-53319b33b8e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:33.041445 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac8e14-4371-4704-9eb4-53319b33b8e2 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:33.041729 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac8e14-4371-4704-9eb4-53319b33b8e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:33.042007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac8e14-4371-4704-9eb4-53319b33b8e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:33.043912 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-51ac8e14-4371-4704-9eb4-53319b33b8e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:33.049992 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3f98d-40c2-465f-bdc5-e8ac10f67b9c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:33.078982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2f1fd-cca8-44f7-83a6-df8102521404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:33.081060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2f1fd-cca8-44f7-83a6-df8102521404 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:33.081978 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2f1fd-cca8-44f7-83a6-df8102521404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:33.082894 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2f1fd-cca8-44f7-83a6-df8102521404 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:33.084983 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2f1fd-cca8-44f7-83a6-df8102521404 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:21:33.085871 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2f1fd-cca8-44f7-83a6-df8102521404 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:33.092349 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2f1fd-cca8-44f7-83a6-df8102521404 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:33.123744 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 872/1750] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:21:33.124771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2f1fd-cca8-44f7-83a6-df8102521404 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:33.131527 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b6e2f1fd-cca8-44f7-83a6-df8102521404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:33.154262 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2f1fd-cca8-44f7-83a6-df8102521404 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:33.163196 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90079bd-fc59-495d-b170-a8f5bf32ce5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:33.163978 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90079bd-fc59-495d-b170-a8f5bf32ce5c admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:33.164377 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90079bd-fc59-495d-b170-a8f5bf32ce5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:33.164799 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90079bd-fc59-495d-b170-a8f5bf32ce5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:33.165633 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90079bd-fc59-495d-b170-a8f5bf32ce5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:33.167543 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90079bd-fc59-495d-b170-a8f5bf32ce5c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:33.183097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 873/1751] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:33.184429 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90079bd-fc59-495d-b170-a8f5bf32ce5c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:33.187860 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d90079bd-fc59-495d-b170-a8f5bf32ce5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:33.212345 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90079bd-fc59-495d-b170-a8f5bf32ce5c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:33.230060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09418d9b-e827-4f49-bf64-c9096f827c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:33.231409 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09418d9b-e827-4f49-bf64-c9096f827c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:33.231696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09418d9b-e827-4f49-bf64-c9096f827c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:33.232010 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09418d9b-e827-4f49-bf64-c9096f827c3e admin admin] PATH_INFO: `/v3/projects/503ffcfe61994d2388ef4d7a189f228d/users/ae875a51b1ff4dd0a590eed247f05665/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:33.255820 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09418d9b-e827-4f49-bf64-c9096f827c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=503ffcfe61994d2388ef4d7a189f228d, user_id=ae875a51b1ff4dd0a590eed247f05665, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:33.258465 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09418d9b-e827-4f49-bf64-c9096f827c3e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:33.267027 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac8e14-4371-4704-9eb4-53319b33b8e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:33.269083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac8e14-4371-4704-9eb4-53319b33b8e2 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:33.295818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 879/1752] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:33.297174 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56bcad-b998-4431-b85e-b0b439dde20a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:33.297467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56bcad-b998-4431-b85e-b0b439dde20a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:33.297747 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56bcad-b998-4431-b85e-b0b439dde20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:33.355338 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-0b56bcad-b998-4431-b85e-b0b439dde20a None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:33.356589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0b56bcad-b998-4431-b85e-b0b439dde20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:33.362211 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 874/1753] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:33 2022] PUT /identity/v3/projects/503ffcfe61994d2388ef4d7a189f228d/users/ae875a51b1ff4dd0a590eed247f05665/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:33.363258 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09418d9b-e827-4f49-bf64-c9096f827c3e admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:33.546261 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 880/1754] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:33.546261 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56bcad-b998-4431-b85e-b0b439dde20a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:33.573357 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56bcad-b998-4431-b85e-b0b439dde20a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:33.606067 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13cfe0-8886-47a5-be62-5feca8fb4d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:33.607256 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13cfe0-8886-47a5-be62-5feca8fb4d79 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:33.607690 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13cfe0-8886-47a5-be62-5feca8fb4d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:33.608109 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13cfe0-8886-47a5-be62-5feca8fb4d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:33.608999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13cfe0-8886-47a5-be62-5feca8fb4d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:33.611907 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13cfe0-8886-47a5-be62-5feca8fb4d79 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:33.643190 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 881/1755] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:33.644238 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13cfe0-8886-47a5-be62-5feca8fb4d79 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:33.649000 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09418d9b-e827-4f49-bf64-c9096f827c3e admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:33.660522 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13cfe0-8886-47a5-be62-5feca8fb4d79 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:33.661002 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5c9da-3b8d-4e82-a219-5dcb0da3b984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:33.664311 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5c9da-3b8d-4e82-a219-5dcb0da3b984 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:33.667446 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5c9da-3b8d-4e82-a219-5dcb0da3b984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:33.667446 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5c9da-3b8d-4e82-a219-5dcb0da3b984 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:33.667446 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5c9da-3b8d-4e82-a219-5dcb0da3b984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:33.671736 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2fdb2-e840-4461-9475-a01d66d86d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:33.671912 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5c9da-3b8d-4e82-a219-5dcb0da3b984 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:33.672748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2fdb2-e840-4461-9475-a01d66d86d17 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:33.673175 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2fdb2-e840-4461-9475-a01d66d86d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:33.673592 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2fdb2-e840-4461-9475-a01d66d86d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:33.674502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2fdb2-e840-4461-9475-a01d66d86d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:33.687206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2fdb2-e840-4461-9475-a01d66d86d17 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:33.704153 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 882/1756] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:33.705738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c11bb-6cee-4894-a32e-e3bce0093459 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:33.706143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c11bb-6cee-4894-a32e-e3bce0093459 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:33.707609 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c11bb-6cee-4894-a32e-e3bce0093459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:33.758063 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-0f4c11bb-6cee-4894-a32e-e3bce0093459 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:33.759416 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0f4c11bb-6cee-4894-a32e-e3bce0093459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:33.787236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 883/1757] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:33.790540 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c11bb-6cee-4894-a32e-e3bce0093459 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:33.805353 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c11bb-6cee-4894-a32e-e3bce0093459 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:33.805519 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 875/1758] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:21:33 2022] POST /identity/v3/projects => generated 373 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:33.808605 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5c9da-3b8d-4e82-a219-5dcb0da3b984 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:33.931896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9423539-25d8-4819-81e2-3778d4aca347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:33.937593 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9423539-25d8-4819-81e2-3778d4aca347 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:33.938239 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9423539-25d8-4819-81e2-3778d4aca347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:33.939347 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9423539-25d8-4819-81e2-3778d4aca347 admin admin] PATH_INFO: `/v3/projects/90ef2027e69a462b9f55af10229142a6/users/5744c94f9d3a4a268f3ec61851923876/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:33.970750 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9423539-25d8-4819-81e2-3778d4aca347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ef2027e69a462b9f55af10229142a6, user_id=5744c94f9d3a4a268f3ec61851923876, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:33.974752 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5c9da-3b8d-4e82-a219-5dcb0da3b984 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:33.979708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9423539-25d8-4819-81e2-3778d4aca347 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:33.992238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817891bb-9f15-4fb4-8205-48bbe08ac247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:33.994544 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817891bb-9f15-4fb4-8205-48bbe08ac247 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:33.995177 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817891bb-9f15-4fb4-8205-48bbe08ac247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:33.995743 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817891bb-9f15-4fb4-8205-48bbe08ac247 admin admin] PATH_INFO: `/v3/projects/503ffcfe61994d2388ef4d7a189f228d/users/ae875a51b1ff4dd0a590eed247f05665/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:34.000903 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817891bb-9f15-4fb4-8205-48bbe08ac247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=503ffcfe61994d2388ef4d7a189f228d, user_id=ae875a51b1ff4dd0a590eed247f05665, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:34.008368 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817891bb-9f15-4fb4-8205-48bbe08ac247 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:34.039852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 876/1759] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:33 2022] PUT /identity/v3/projects/503ffcfe61994d2388ef4d7a189f228d/users/ae875a51b1ff4dd0a590eed247f05665/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:34.042897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817891bb-9f15-4fb4-8205-48bbe08ac247 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:34.082433 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 884/1760] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:33 2022] PUT /identity/v3/projects/90ef2027e69a462b9f55af10229142a6/users/5744c94f9d3a4a268f3ec61851923876/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:34.084229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9423539-25d8-4819-81e2-3778d4aca347 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:34.215088 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817891bb-9f15-4fb4-8205-48bbe08ac247 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:34.310510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9423539-25d8-4819-81e2-3778d4aca347 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:34.328474 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8cf03-95ed-4272-8485-767d3e37b42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:34.329848 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8cf03-95ed-4272-8485-767d3e37b42c admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:34.331065 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8cf03-95ed-4272-8485-767d3e37b42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:34.332066 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80e8e3-683a-4264-a72a-efeee7966558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:34.333255 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80e8e3-683a-4264-a72a-efeee7966558 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:34.333681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80e8e3-683a-4264-a72a-efeee7966558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:34.334235 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80e8e3-683a-4264-a72a-efeee7966558 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:34.338374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8cf03-95ed-4272-8485-767d3e37b42c admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:34.339058 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80e8e3-683a-4264-a72a-efeee7966558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:34.343308 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8cf03-95ed-4272-8485-767d3e37b42c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:21:34.344560 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8cf03-95ed-4272-8485-767d3e37b42c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:34.348269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80e8e3-683a-4264-a72a-efeee7966558 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:34.351091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8cf03-95ed-4272-8485-767d3e37b42c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:34.382493 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 877/1761] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:21:34.384154 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd3179-940b-460d-997d-158ccc25f984 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:34.384471 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd3179-940b-460d-997d-158ccc25f984 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:34.384759 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd3179-940b-460d-997d-158ccc25f984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:34.418991 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-66dd3179-940b-460d-997d-158ccc25f984 None None] MFA Rules not processed for user `ae875a51b1ff4dd0a590eed247f05665`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:34.420565 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-66dd3179-940b-460d-997d-158ccc25f984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:34.488162 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 885/1762] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:21:34 2022] POST /identity/v3/users => generated 287 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:34.488162 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04eb1aa-7ff1-4227-a622-aea6b17738ea None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:34.488162 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04eb1aa-7ff1-4227-a622-aea6b17738ea None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:34.488162 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04eb1aa-7ff1-4227-a622-aea6b17738ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:34.560986 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f04eb1aa-7ff1-4227-a622-aea6b17738ea None None] MFA Rules not processed for user `5744c94f9d3a4a268f3ec61851923876`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:34.562607 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f04eb1aa-7ff1-4227-a622-aea6b17738ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:34.604759 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 878/1763] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:34 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:34.604759 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd3179-940b-460d-997d-158ccc25f984 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:34.621532 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd3179-940b-460d-997d-158ccc25f984 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:34.629761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a7e0d-f516-428c-963f-b5a7495a51df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:34.630778 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a7e0d-f516-428c-963f-b5a7495a51df admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:34.631255 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a7e0d-f516-428c-963f-b5a7495a51df admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:34.631734 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a7e0d-f516-428c-963f-b5a7495a51df admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:34.632886 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a7e0d-f516-428c-963f-b5a7495a51df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:34.635591 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a7e0d-f516-428c-963f-b5a7495a51df admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:34.712307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 886/1764] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:34.713283 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04eb1aa-7ff1-4227-a622-aea6b17738ea None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:34.725960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04eb1aa-7ff1-4227-a622-aea6b17738ea None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:34.731055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd236a30-d42c-41aa-9182-24b656a0c9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:34.731747 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd236a30-d42c-41aa-9182-24b656a0c9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:34.732614 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd236a30-d42c-41aa-9182-24b656a0c9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:34.732894 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd236a30-d42c-41aa-9182-24b656a0c9e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:34.733645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd236a30-d42c-41aa-9182-24b656a0c9e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:34.734803 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 879/1765] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:21:34 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:34.735599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd236a30-d42c-41aa-9182-24b656a0c9e3 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:34.749736 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0fabe-9eca-4fd5-b335-386e02abda8d None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:34.749736 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0fabe-9eca-4fd5-b335-386e02abda8d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:34.749736 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0fabe-9eca-4fd5-b335-386e02abda8d None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:34.753689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 887/1766] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:34.753767 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 880/1767] 10.222.0.76 () {54 vars in 912 bytes} [Mon May 16 15:21:34 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:21:34.753833 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd236a30-d42c-41aa-9182-24b656a0c9e3 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:34.753833 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bd236a30-d42c-41aa-9182-24b656a0c9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:34.753982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b46ff-5678-4b2d-a2de-bd90b29b961c None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:34.753982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b46ff-5678-4b2d-a2de-bd90b29b961c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:34.753982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b46ff-5678-4b2d-a2de-bd90b29b961c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:34.819501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-8d1b46ff-5678-4b2d-a2de-bd90b29b961c None None] MFA Rules not processed for user `6b16118d74774a9ea673d6e0532b8772`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:34.821475 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8d1b46ff-5678-4b2d-a2de-bd90b29b961c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:34.834937 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd236a30-d42c-41aa-9182-24b656a0c9e3 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:34.907294 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20427b6b-843b-4d2b-9286-ca3cdf9a2a39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:34.908006 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20427b6b-843b-4d2b-9286-ca3cdf9a2a39 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:34.908292 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20427b6b-843b-4d2b-9286-ca3cdf9a2a39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:34.909054 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20427b6b-843b-4d2b-9286-ca3cdf9a2a39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:34.936936 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 881/1768] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:34.943073 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b46ff-5678-4b2d-a2de-bd90b29b961c None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:35.078031 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20427b6b-843b-4d2b-9286-ca3cdf9a2a39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:35.080534 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20427b6b-843b-4d2b-9286-ca3cdf9a2a39 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:35.117293 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b46ff-5678-4b2d-a2de-bd90b29b961c None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:35.126366 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10754b97-58d2-48a6-998e-78cbb9c0576a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:35.127053 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10754b97-58d2-48a6-998e-78cbb9c0576a admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:35.127334 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10754b97-58d2-48a6-998e-78cbb9c0576a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:35.127641 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10754b97-58d2-48a6-998e-78cbb9c0576a admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:35.128315 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10754b97-58d2-48a6-998e-78cbb9c0576a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:35.130416 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10754b97-58d2-48a6-998e-78cbb9c0576a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:35.135226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 888/1769] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:34 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:35.136278 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20427b6b-843b-4d2b-9286-ca3cdf9a2a39 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:35.178009 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20427b6b-843b-4d2b-9286-ca3cdf9a2a39 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:35.212948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc63a4-8fbb-4b55-8e2f-d0c127da5925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:35.212948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc63a4-8fbb-4b55-8e2f-d0c127da5925 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:35.212948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc63a4-8fbb-4b55-8e2f-d0c127da5925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:35.212948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc63a4-8fbb-4b55-8e2f-d0c127da5925 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:35.213644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc63a4-8fbb-4b55-8e2f-d0c127da5925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:35.213644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc63a4-8fbb-4b55-8e2f-d0c127da5925 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:35.703854 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 889/1770] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:21:35 2022] POST /identity/v3/users => generated 291 bytes in 568 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:35.710458 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10374af7-dbae-40ca-8074-5747350d785a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:35.710458 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10374af7-dbae-40ca-8074-5747350d785a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:35.710458 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10374af7-dbae-40ca-8074-5747350d785a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:35.710827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 882/1771] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:21:34 2022] POST /identity/v3/projects => generated 377 bytes in 766 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:35.710827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10754b97-58d2-48a6-998e-78cbb9c0576a admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:35.748730 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-10374af7-dbae-40ca-8074-5747350d785a None None] MFA Rules not processed for user `15ff90527ece4406be62f449bdf71d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:35.754499 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-10374af7-dbae-40ca-8074-5747350d785a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:35.823114 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10754b97-58d2-48a6-998e-78cbb9c0576a admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:35.837622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee78fe5-de7e-482f-b4c3-2c66ba68bcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:35.839730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee78fe5-de7e-482f-b4c3-2c66ba68bcd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:35.839975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 890/1772] 10.222.0.76 () {58 vars in 1009 bytes} [Mon May 16 15:21:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:35.841016 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10374af7-dbae-40ca-8074-5747350d785a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:35.841480 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee78fe5-de7e-482f-b4c3-2c66ba68bcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:35.841904 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee78fe5-de7e-482f-b4c3-2c66ba68bcd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:35.845963 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee78fe5-de7e-482f-b4c3-2c66ba68bcd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:35.851015 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee78fe5-de7e-482f-b4c3-2c66ba68bcd8 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:35.876875 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10374af7-dbae-40ca-8074-5747350d785a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:35.905007 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 883/1773] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:35.905007 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee78fe5-de7e-482f-b4c3-2c66ba68bcd8 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:35.920387 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b147bbc-cbf0-41cd-ab9b-6e524d59c902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:35.921175 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b147bbc-cbf0-41cd-ab9b-6e524d59c902 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:35.921536 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b147bbc-cbf0-41cd-ab9b-6e524d59c902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:35.921799 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b147bbc-cbf0-41cd-ab9b-6e524d59c902 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:35.940213 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b147bbc-cbf0-41cd-ab9b-6e524d59c902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:35.942103 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b147bbc-cbf0-41cd-ab9b-6e524d59c902 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:35.960378 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee78fe5-de7e-482f-b4c3-2c66ba68bcd8 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:35.974522 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47138f-3fa7-4f33-9927-b322c81d5c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:35.977804 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47138f-3fa7-4f33-9927-b322c81d5c62 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:35.978218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47138f-3fa7-4f33-9927-b322c81d5c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:35.978511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47138f-3fa7-4f33-9927-b322c81d5c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:35.980596 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47138f-3fa7-4f33-9927-b322c81d5c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:35.984674 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47138f-3fa7-4f33-9927-b322c81d5c62 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:36.007656 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 884/1774] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:36.007656 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47138f-3fa7-4f33-9927-b322c81d5c62 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:36.011851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4f47138f-3fa7-4f33-9927-b322c81d5c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:36.030768 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47138f-3fa7-4f33-9927-b322c81d5c62 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:36.036200 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876ae25-a659-4374-9497-f7671c19a660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:36.036907 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876ae25-a659-4374-9497-f7671c19a660 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:36.037260 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876ae25-a659-4374-9497-f7671c19a660 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:36.037680 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876ae25-a659-4374-9497-f7671c19a660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:36.063421 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876ae25-a659-4374-9497-f7671c19a660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:36.065032 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876ae25-a659-4374-9497-f7671c19a660 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:36.078339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 885/1775] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:36.079533 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876ae25-a659-4374-9497-f7671c19a660 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:36.109676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 891/1776] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:21:35 2022] POST /identity/v3/users => generated 295 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:36.111695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b147bbc-cbf0-41cd-ab9b-6e524d59c902 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:36.131381 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b147bbc-cbf0-41cd-ab9b-6e524d59c902 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:36.141475 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a8fa6-acc0-4a07-9895-b1b2bff9205d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:36.143385 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a8fa6-acc0-4a07-9895-b1b2bff9205d admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:36.143886 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a8fa6-acc0-4a07-9895-b1b2bff9205d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:36.144357 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a8fa6-acc0-4a07-9895-b1b2bff9205d admin admin] PATH_INFO: `/v3/projects/d83bf5f7c93f4d5a80296b6886c43630/users/4ae2222c4f1945839a1c090c1a1de33c/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:36.176698 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a8fa6-acc0-4a07-9895-b1b2bff9205d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d83bf5f7c93f4d5a80296b6886c43630, user_id=4ae2222c4f1945839a1c090c1a1de33c, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:36.179407 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a8fa6-acc0-4a07-9895-b1b2bff9205d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:36.179862 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876ae25-a659-4374-9497-f7671c19a660 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:36.184464 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8569eff-9098-4dbe-a711-6f83c306322d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:36.185223 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8569eff-9098-4dbe-a711-6f83c306322d service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:36.185774 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8569eff-9098-4dbe-a711-6f83c306322d service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:36.186076 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8569eff-9098-4dbe-a711-6f83c306322d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:36.188056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d8569eff-9098-4dbe-a711-6f83c306322d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:36.274577 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 892/1777] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:36 2022] PUT /identity/v3/projects/d83bf5f7c93f4d5a80296b6886c43630/users/4ae2222c4f1945839a1c090c1a1de33c/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:36.276443 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a8fa6-acc0-4a07-9895-b1b2bff9205d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:36.401304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8569eff-9098-4dbe-a711-6f83c306322d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:36.403554 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8569eff-9098-4dbe-a711-6f83c306322d service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:36.416627 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 886/1778] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:36.417319 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8569eff-9098-4dbe-a711-6f83c306322d service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:36.430563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8569eff-9098-4dbe-a711-6f83c306322d service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:36.514570 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a8fa6-acc0-4a07-9895-b1b2bff9205d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:36.533800 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f68f87-f24f-42e9-8aec-458c6ae5c527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:36.535258 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f68f87-f24f-42e9-8aec-458c6ae5c527 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:36.535543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f68f87-f24f-42e9-8aec-458c6ae5c527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:36.535820 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f68f87-f24f-42e9-8aec-458c6ae5c527 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:36.537403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f68f87-f24f-42e9-8aec-458c6ae5c527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:36.539088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f68f87-f24f-42e9-8aec-458c6ae5c527 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:36.597588 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 893/1779] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:36.601257 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85655c66-6ba8-4328-9eb4-d1977b164956 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:36.602804 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85655c66-6ba8-4328-9eb4-d1977b164956 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:36.603323 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85655c66-6ba8-4328-9eb4-d1977b164956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:36.613905 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68a802-3c07-413f-885c-eb239ce4918b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:36.614496 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68a802-3c07-413f-885c-eb239ce4918b admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:36.614779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68a802-3c07-413f-885c-eb239ce4918b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:36.615055 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68a802-3c07-413f-885c-eb239ce4918b admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:36.618323 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68a802-3c07-413f-885c-eb239ce4918b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:36.628137 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68a802-3c07-413f-885c-eb239ce4918b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:36.657103 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 887/1780] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:36.657781 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68a802-3c07-413f-885c-eb239ce4918b admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:36.685492 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68a802-3c07-413f-885c-eb239ce4918b admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:36.688567 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-85655c66-6ba8-4328-9eb4-d1977b164956 None None] MFA Rules not processed for user `4ae2222c4f1945839a1c090c1a1de33c`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:36.693288 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-85655c66-6ba8-4328-9eb4-d1977b164956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:36.694094 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb7e02-9bf9-4551-9819-d09b9daabc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:36.695023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb7e02-9bf9-4551-9819-d09b9daabc64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:36.699067 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb7e02-9bf9-4551-9819-d09b9daabc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:36.699494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb7e02-9bf9-4551-9819-d09b9daabc64 admin admin] PATH_INFO: `/v3/projects/dcef043f1ed4441eb9ae33d9b085c66d/users/722795d75a6945f1a400f82715c2eb57/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:36.736020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb7e02-9bf9-4551-9819-d09b9daabc64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcef043f1ed4441eb9ae33d9b085c66d, user_id=722795d75a6945f1a400f82715c2eb57, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:36.738863 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb7e02-9bf9-4551-9819-d09b9daabc64 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:36.830887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 894/1781] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:36.844790 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85655c66-6ba8-4328-9eb4-d1977b164956 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:36.845023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 888/1782] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:36 2022] PUT /identity/v3/projects/dcef043f1ed4441eb9ae33d9b085c66d/users/722795d75a6945f1a400f82715c2eb57/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:36.845023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb7e02-9bf9-4551-9819-d09b9daabc64 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:36.862778 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85655c66-6ba8-4328-9eb4-d1977b164956 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:37.046985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad5c49-f1b4-4cd1-ad93-20ee7a8878d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:37.050664 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad5c49-f1b4-4cd1-ad93-20ee7a8878d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:37.051145 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad5c49-f1b4-4cd1-ad93-20ee7a8878d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:37.051547 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad5c49-f1b4-4cd1-ad93-20ee7a8878d4 admin admin] PATH_INFO: `/v3/projects/1418654d879c45839c5573d103a44ee5/users/d4508876fd104267853d7d17643966e0/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:37.065579 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb7e02-9bf9-4551-9819-d09b9daabc64 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:37.082164 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab9f2b-d366-4a2c-9e3b-20bceb9a03a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:37.085049 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab9f2b-d366-4a2c-9e3b-20bceb9a03a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:37.085049 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab9f2b-d366-4a2c-9e3b-20bceb9a03a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:37.085049 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab9f2b-d366-4a2c-9e3b-20bceb9a03a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:37.085049 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab9f2b-d366-4a2c-9e3b-20bceb9a03a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:37.088807 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab9f2b-d366-4a2c-9e3b-20bceb9a03a0 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:37.092634 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad5c49-f1b4-4cd1-ad93-20ee7a8878d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1418654d879c45839c5573d103a44ee5, user_id=d4508876fd104267853d7d17643966e0, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:37.096497 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad5c49-f1b4-4cd1-ad93-20ee7a8878d4 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:37.228566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 895/1783] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:36 2022] PUT /identity/v3/projects/1418654d879c45839c5573d103a44ee5/users/d4508876fd104267853d7d17643966e0/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:37.232252 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb7866-c3c6-41fc-83f1-e5bd452879eb None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:37.232556 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb7866-c3c6-41fc-83f1-e5bd452879eb None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:37.232839 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb7866-c3c6-41fc-83f1-e5bd452879eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:37.233946 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 889/1784] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:21:36 2022] POST /identity/v3/projects => generated 371 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:37.236786 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebba270-cd7e-4ba9-891c-cc95412386bf None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:37.240817 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebba270-cd7e-4ba9-891c-cc95412386bf None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:37.241160 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebba270-cd7e-4ba9-891c-cc95412386bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:37.293233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-4ebba270-cd7e-4ba9-891c-cc95412386bf None None] MFA Rules not processed for user `6c6b9438bb4245b3908664bfece4ef22`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:37.297314 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4ebba270-cd7e-4ba9-891c-cc95412386bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:37.336057 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-71fb7866-c3c6-41fc-83f1-e5bd452879eb None None] MFA Rules not processed for user `722795d75a6945f1a400f82715c2eb57`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:37.337341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-71fb7866-c3c6-41fc-83f1-e5bd452879eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:37.459731 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 896/1785] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:37.459731 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb7866-c3c6-41fc-83f1-e5bd452879eb None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:37.468808 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 890/1786] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:37.470090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebba270-cd7e-4ba9-891c-cc95412386bf None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:37.580926 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb7866-c3c6-41fc-83f1-e5bd452879eb None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:37.593405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24312d46-03f1-4855-a428-5a0d9656023b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:37.593405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24312d46-03f1-4855-a428-5a0d9656023b admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:37.593405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24312d46-03f1-4855-a428-5a0d9656023b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:37.593405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24312d46-03f1-4855-a428-5a0d9656023b admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:37.594342 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24312d46-03f1-4855-a428-5a0d9656023b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:37.603880 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24312d46-03f1-4855-a428-5a0d9656023b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:37.613861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebba270-cd7e-4ba9-891c-cc95412386bf None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:37.623440 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf711467-ba52-4ed8-8a4b-9d289404013c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:37.624429 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf711467-ba52-4ed8-8a4b-9d289404013c admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:37.628405 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf711467-ba52-4ed8-8a4b-9d289404013c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:37.631494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf711467-ba52-4ed8-8a4b-9d289404013c admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:37.632447 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf711467-ba52-4ed8-8a4b-9d289404013c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:37.634653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf711467-ba52-4ed8-8a4b-9d289404013c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:37.650876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 897/1787] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:37.651185 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24312d46-03f1-4855-a428-5a0d9656023b admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:37.672721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24312d46-03f1-4855-a428-5a0d9656023b admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:37.687166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004232fb-02b7-4356-9bdb-767f556ea436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:37.688059 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004232fb-02b7-4356-9bdb-767f556ea436 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:37.688512 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004232fb-02b7-4356-9bdb-767f556ea436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:37.688928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004232fb-02b7-4356-9bdb-767f556ea436 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:37.689894 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004232fb-02b7-4356-9bdb-767f556ea436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:37.692039 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004232fb-02b7-4356-9bdb-767f556ea436 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:37.842589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 891/1788] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:21:37 2022] POST /identity/v3/users => generated 292 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:37.844996 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c71ff-e3d5-424b-ba8c-338eaf3f5ce0 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:37.845119 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 898/1789] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:21:37 2022] POST /identity/v3/projects => generated 383 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:37.845604 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c71ff-e3d5-424b-ba8c-338eaf3f5ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:37.845910 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004232fb-02b7-4356-9bdb-767f556ea436 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:37.846453 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c71ff-e3d5-424b-ba8c-338eaf3f5ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:37.884660 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-041c71ff-e3d5-424b-ba8c-338eaf3f5ce0 None None] MFA Rules not processed for user `d3492cec550a46598e09c48474a4c6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:37.886613 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-041c71ff-e3d5-424b-ba8c-338eaf3f5ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:37.999980 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004232fb-02b7-4356-9bdb-767f556ea436 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:38.009734 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908040ad-7364-4a07-9d5a-3b8916047e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:38.012820 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908040ad-7364-4a07-9d5a-3b8916047e9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:38.012820 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908040ad-7364-4a07-9d5a-3b8916047e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:38.014400 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908040ad-7364-4a07-9d5a-3b8916047e9a admin admin] PATH_INFO: `/v3/projects/1418654d879c45839c5573d103a44ee5/users/d4508876fd104267853d7d17643966e0/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:38.021844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908040ad-7364-4a07-9d5a-3b8916047e9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1418654d879c45839c5573d103a44ee5, user_id=d4508876fd104267853d7d17643966e0, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:38.033108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908040ad-7364-4a07-9d5a-3b8916047e9a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:38.058339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 892/1790] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:38.059374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c71ff-e3d5-424b-ba8c-338eaf3f5ce0 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:38.061984 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 899/1791] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:37 2022] PUT /identity/v3/projects/1418654d879c45839c5573d103a44ee5/users/d4508876fd104267853d7d17643966e0/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:38.067117 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908040ad-7364-4a07-9d5a-3b8916047e9a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:38.088525 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c71ff-e3d5-424b-ba8c-338eaf3f5ce0 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:38.254408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4f989-a6a8-47d4-9a07-12853f19f1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:38.257238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4f989-a6a8-47d4-9a07-12853f19f1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:38.257593 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4f989-a6a8-47d4-9a07-12853f19f1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:38.257793 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4f989-a6a8-47d4-9a07-12853f19f1e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:38.258583 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4f989-a6a8-47d4-9a07-12853f19f1e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:38.264635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4f989-a6a8-47d4-9a07-12853f19f1e9 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:38.290608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908040ad-7364-4a07-9d5a-3b8916047e9a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:38.291203 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 893/1792] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:38.292048 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc92c63-2f8a-469e-8e26-3506372c18bf None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:38.292048 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc92c63-2f8a-469e-8e26-3506372c18bf None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:38.292261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc92c63-2f8a-469e-8e26-3506372c18bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:38.312775 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467255a-256f-4e1e-9814-38371229cf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:38.313470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467255a-256f-4e1e-9814-38371229cf11 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:38.313764 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467255a-256f-4e1e-9814-38371229cf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:38.314037 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467255a-256f-4e1e-9814-38371229cf11 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:38.314774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467255a-256f-4e1e-9814-38371229cf11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:38.316758 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467255a-256f-4e1e-9814-38371229cf11 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:38.336771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9dc92c63-2f8a-469e-8e26-3506372c18bf None None] MFA Rules not processed for user `d4508876fd104267853d7d17643966e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:38.338759 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9dc92c63-2f8a-469e-8e26-3506372c18bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:38.447660 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 894/1793] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:38.448612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc92c63-2f8a-469e-8e26-3506372c18bf None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:38.471706 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc92c63-2f8a-469e-8e26-3506372c18bf None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:38.476473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f19b2-9744-47f6-9f3b-b37fe82507d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:38.477379 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f19b2-9744-47f6-9f3b-b37fe82507d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:38.477657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f19b2-9744-47f6-9f3b-b37fe82507d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:38.477929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f19b2-9744-47f6-9f3b-b37fe82507d7 admin admin] PATH_INFO: `/v3/projects/ef259632e8d5467a82c740fecf91ff03/users/babf857f87254258b389dcdb43922519/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:38.499868 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f19b2-9744-47f6-9f3b-b37fe82507d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef259632e8d5467a82c740fecf91ff03, user_id=babf857f87254258b389dcdb43922519, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:38.502067 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 900/1794] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:21:38 2022] POST /identity/v3/users => generated 298 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:38.503012 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467255a-256f-4e1e-9814-38371229cf11 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:38.506298 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f19b2-9744-47f6-9f3b-b37fe82507d7 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:38.564941 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467255a-256f-4e1e-9814-38371229cf11 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:38.572835 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9ac0e-cd54-47b7-9466-1fe38e2ff17c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:38.573585 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9ac0e-cd54-47b7-9466-1fe38e2ff17c service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:38.574019 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9ac0e-cd54-47b7-9466-1fe38e2ff17c service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:38.574505 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9ac0e-cd54-47b7-9466-1fe38e2ff17c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:38.635246 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 895/1795] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:38 2022] PUT /identity/v3/projects/ef259632e8d5467a82c740fecf91ff03/users/babf857f87254258b389dcdb43922519/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:38.636479 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f19b2-9744-47f6-9f3b-b37fe82507d7 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:38.709067 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9ac0e-cd54-47b7-9466-1fe38e2ff17c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:38.713280 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9ac0e-cd54-47b7-9466-1fe38e2ff17c service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:38.746509 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 901/1796] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:38.766393 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9ac0e-cd54-47b7-9466-1fe38e2ff17c service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:38.802807 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9ac0e-cd54-47b7-9466-1fe38e2ff17c service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:38.804890 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f19b2-9744-47f6-9f3b-b37fe82507d7 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:38.824315 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f30f5c-28d4-4911-a60c-dcf8a6a843e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:38.825226 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f30f5c-28d4-4911-a60c-dcf8a6a843e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:38.825707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f30f5c-28d4-4911-a60c-dcf8a6a843e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:38.827031 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f30f5c-28d4-4911-a60c-dcf8a6a843e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:38.829302 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f30f5c-28d4-4911-a60c-dcf8a6a843e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:38.831257 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f30f5c-28d4-4911-a60c-dcf8a6a843e1 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:38.841463 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb291dd2-ea38-4284-86f7-10618baf6cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:38.842187 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb291dd2-ea38-4284-86f7-10618baf6cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:38.842476 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb291dd2-ea38-4284-86f7-10618baf6cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:38.843305 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb291dd2-ea38-4284-86f7-10618baf6cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:38.845280 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb291dd2-ea38-4284-86f7-10618baf6cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:38.845703 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb291dd2-ea38-4284-86f7-10618baf6cd7 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:38.859825 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 896/1797] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:38.864762 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f30f5c-28d4-4911-a60c-dcf8a6a843e1 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:38.898951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 902/1798] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:38.901161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb291dd2-ea38-4284-86f7-10618baf6cd7 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:38.904303 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f30f5c-28d4-4911-a60c-dcf8a6a843e1 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:38.919953 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb291dd2-ea38-4284-86f7-10618baf6cd7 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:38.923021 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477ee01-9cd5-4ecd-b6e9-b8dc2aa78c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:38.924156 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477ee01-9cd5-4ecd-b6e9-b8dc2aa78c4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:38.925275 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477ee01-9cd5-4ecd-b6e9-b8dc2aa78c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:38.926431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477ee01-9cd5-4ecd-b6e9-b8dc2aa78c4d admin admin] PATH_INFO: `/v3/projects/6396736e94eb46e6b1d3b4b1ed1adff4/users/f4c36c8c0a9e4642b3b08614c78d8340/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:38.927502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5a8d9-5461-404d-95b7-413b2fdb0255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:38.928747 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5a8d9-5461-404d-95b7-413b2fdb0255 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:38.929161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5a8d9-5461-404d-95b7-413b2fdb0255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:38.929658 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5a8d9-5461-404d-95b7-413b2fdb0255 admin admin] PATH_INFO: `/v3/projects/ef259632e8d5467a82c740fecf91ff03/users/babf857f87254258b389dcdb43922519/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:38.932277 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f5a8d9-5461-404d-95b7-413b2fdb0255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef259632e8d5467a82c740fecf91ff03, user_id=babf857f87254258b389dcdb43922519, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:38.936898 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f5a8d9-5461-404d-95b7-413b2fdb0255 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:38.967198 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 903/1799] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:38 2022] PUT /identity/v3/projects/ef259632e8d5467a82c740fecf91ff03/users/babf857f87254258b389dcdb43922519/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:38.968967 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021c73d-4e61-4c05-acf8-848542f5f283 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:38.969361 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021c73d-4e61-4c05-acf8-848542f5f283 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:38.969759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021c73d-4e61-4c05-acf8-848542f5f283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:38.981559 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477ee01-9cd5-4ecd-b6e9-b8dc2aa78c4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6396736e94eb46e6b1d3b4b1ed1adff4, user_id=f4c36c8c0a9e4642b3b08614c78d8340, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:38.986666 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477ee01-9cd5-4ecd-b6e9-b8dc2aa78c4d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:39.009285 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-5021c73d-4e61-4c05-acf8-848542f5f283 None None] MFA Rules not processed for user `babf857f87254258b389dcdb43922519`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:39.011329 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5021c73d-4e61-4c05-acf8-848542f5f283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:39.100894 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 897/1800] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:38 2022] PUT /identity/v3/projects/6396736e94eb46e6b1d3b4b1ed1adff4/users/f4c36c8c0a9e4642b3b08614c78d8340/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:39.105054 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477ee01-9cd5-4ecd-b6e9-b8dc2aa78c4d admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:39.115821 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 904/1801] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:38 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:39.208717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477ee01-9cd5-4ecd-b6e9-b8dc2aa78c4d admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:39.214227 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e3579-aba2-477e-aafa-55642b2c6c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:39.214916 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e3579-aba2-477e-aafa-55642b2c6c5d admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:39.215206 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e3579-aba2-477e-aafa-55642b2c6c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:39.215488 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e3579-aba2-477e-aafa-55642b2c6c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:39.216771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e3579-aba2-477e-aafa-55642b2c6c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:39.218480 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e3579-aba2-477e-aafa-55642b2c6c5d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:39.232154 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 898/1802] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:39.242543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021c73d-4e61-4c05-acf8-848542f5f283 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:39.273833 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e3579-aba2-477e-aafa-55642b2c6c5d admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:39.275766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8d9e3579-aba2-477e-aafa-55642b2c6c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:39.398450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021c73d-4e61-4c05-acf8-848542f5f283 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:39.405050 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a1608-3970-49c3-9927-b8c3f055c509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:39.406300 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a1608-3970-49c3-9927-b8c3f055c509 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:39.406707 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a1608-3970-49c3-9927-b8c3f055c509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:39.406853 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a1608-3970-49c3-9927-b8c3f055c509 admin admin] PATH_INFO: `/v3/projects/6396736e94eb46e6b1d3b4b1ed1adff4/users/f4c36c8c0a9e4642b3b08614c78d8340/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:39.411285 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a1608-3970-49c3-9927-b8c3f055c509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6396736e94eb46e6b1d3b4b1ed1adff4, user_id=f4c36c8c0a9e4642b3b08614c78d8340, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:39.419756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a1608-3970-49c3-9927-b8c3f055c509 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:39.458266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 905/1803] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:39 2022] PUT /identity/v3/projects/6396736e94eb46e6b1d3b4b1ed1adff4/users/f4c36c8c0a9e4642b3b08614c78d8340/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:39.460783 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e3579-aba2-477e-aafa-55642b2c6c5d admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:39.469467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c3062-b88b-4043-ba0d-4858d2354bc2 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:39.469859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c3062-b88b-4043-ba0d-4858d2354bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:39.470301 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c3062-b88b-4043-ba0d-4858d2354bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:39.542061 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-8c2c3062-b88b-4043-ba0d-4858d2354bc2 None None] MFA Rules not processed for user `f4c36c8c0a9e4642b3b08614c78d8340`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:39.550679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8c2c3062-b88b-4043-ba0d-4858d2354bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:39.635140 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbb884-d183-4954-9fd8-e3709e673344 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:39.635920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbb884-d183-4954-9fd8-e3709e673344 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:39.636748 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbb884-d183-4954-9fd8-e3709e673344 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:39.637039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbb884-d183-4954-9fd8-e3709e673344 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:39.841847 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbb884-d183-4954-9fd8-e3709e673344 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:39.847561 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 906/1804] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:39.847716 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbb884-d183-4954-9fd8-e3709e673344 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:39.882114 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 899/1805] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:39 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:39.992617 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c3062-b88b-4043-ba0d-4858d2354bc2 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:40.003759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c3062-b88b-4043-ba0d-4858d2354bc2 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:40.009992 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c604e08-6abc-4f29-8e15-389b10f5cb17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:40.010713 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c604e08-6abc-4f29-8e15-389b10f5cb17 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:40.010990 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c604e08-6abc-4f29-8e15-389b10f5cb17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:40.011260 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c604e08-6abc-4f29-8e15-389b10f5cb17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:40.032162 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c604e08-6abc-4f29-8e15-389b10f5cb17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:40.033756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c604e08-6abc-4f29-8e15-389b10f5cb17 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:40.064212 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 907/1806] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:21:40.168833 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbb884-d183-4954-9fd8-e3709e673344 service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:40.177171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbb884-d183-4954-9fd8-e3709e673344 service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:40.180856 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b9141-71ce-4b6e-b8b8-527146d6ad42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:40.181490 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b9141-71ce-4b6e-b8b8-527146d6ad42 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:40.181775 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b9141-71ce-4b6e-b8b8-527146d6ad42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:40.182054 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b9141-71ce-4b6e-b8b8-527146d6ad42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:40.239786 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b9141-71ce-4b6e-b8b8-527146d6ad42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:40.241310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b9141-71ce-4b6e-b8b8-527146d6ad42 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:40.250837 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 900/1807] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:21:42.971171 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba92e5-3d9b-4a5c-95af-5507a8a00620 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:42.971740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba92e5-3d9b-4a5c-95af-5507a8a00620 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:42.972016 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba92e5-3d9b-4a5c-95af-5507a8a00620 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:42.974546 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 908/1808] 10.222.0.76 () {54 vars in 921 bytes} [Mon May 16 15:21:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:21:42.985198 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d71e08-36e9-42ed-bb25-fc16b010f318 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:42.985731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d71e08-36e9-42ed-bb25-fc16b010f318 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:42.986161 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d71e08-36e9-42ed-bb25-fc16b010f318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:43.020300 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-20d71e08-36e9-42ed-bb25-fc16b010f318 None None] MFA Rules not processed for user `9d85024f010c40129d79543b3ec4cfae`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:43.022645 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-20d71e08-36e9-42ed-bb25-fc16b010f318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:43.166703 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 901/1809] 10.222.0.76 () {58 vars in 1018 bytes} [Mon May 16 15:21:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:21:43.252953 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba92e5-3d9b-4a5c-95af-5507a8a00620 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:43.255922 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-abba92e5-3d9b-4a5c-95af-5507a8a00620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:43.279092 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba92e5-3d9b-4a5c-95af-5507a8a00620 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:43.288769 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af295b71-657a-4d70-ad1e-d9b903eecfcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:43.289438 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af295b71-657a-4d70-ad1e-d9b903eecfcf service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:43.289716 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af295b71-657a-4d70-ad1e-d9b903eecfcf service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:43.289998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af295b71-657a-4d70-ad1e-d9b903eecfcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:43.302318 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af295b71-657a-4d70-ad1e-d9b903eecfcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:43.304524 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af295b71-657a-4d70-ad1e-d9b903eecfcf service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:43.332499 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 909/1810] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:43.399430 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d71e08-36e9-42ed-bb25-fc16b010f318 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:43.470104 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d71e08-36e9-42ed-bb25-fc16b010f318 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:43.475485 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b72e3-3334-470e-8ffa-9c75c4d88ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:43.476370 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b72e3-3334-470e-8ffa-9c75c4d88ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:43.476651 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b72e3-3334-470e-8ffa-9c75c4d88ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:43.476931 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b72e3-3334-470e-8ffa-9c75c4d88ade admin admin] PATH_INFO: `/v3/users/4ae2222c4f1945839a1c090c1a1de33c` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:43.478138 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b72e3-3334-470e-8ffa-9c75c4d88ade admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ae2222c4f1945839a1c090c1a1de33c)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:43.480152 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b72e3-3334-470e-8ffa-9c75c4d88ade admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:43.663106 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c69b72e3-3334-470e-8ffa-9c75c4d88ade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ae2222c4f1945839a1c090c1a1de33c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:43.741023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c69b72e3-3334-470e-8ffa-9c75c4d88ade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ae2222c4f1945839a1c090c1a1de33c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:43.741643 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c69b72e3-3334-470e-8ffa-9c75c4d88ade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ae2222c4f1945839a1c090c1a1de33c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:43.754909 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c69b72e3-3334-470e-8ffa-9c75c4d88ade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ae2222c4f1945839a1c090c1a1de33c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:43.755624 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c69b72e3-3334-470e-8ffa-9c75c4d88ade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ae2222c4f1945839a1c090c1a1de33c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:43.768132 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 902/1811] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:21:43 2022] DELETE /identity/v3/users/4ae2222c4f1945839a1c090c1a1de33c => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:43.772779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cebaad-e06f-40d7-acb8-00c42bb82b8c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:43.773073 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cebaad-e06f-40d7-acb8-00c42bb82b8c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:43.773357 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cebaad-e06f-40d7-acb8-00c42bb82b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:43.791374 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-88cebaad-e06f-40d7-acb8-00c42bb82b8c None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:43.792583 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-88cebaad-e06f-40d7-acb8-00c42bb82b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:43.874427 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 910/1812] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:43.886486 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b72e3-3334-470e-8ffa-9c75c4d88ade admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:43.889184 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c69b72e3-3334-470e-8ffa-9c75c4d88ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:43.979009 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b72e3-3334-470e-8ffa-9c75c4d88ade admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:43.983021 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243f94a-cca5-417c-98c0-0ec85a0def55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:43.983666 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243f94a-cca5-417c-98c0-0ec85a0def55 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:43.983954 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243f94a-cca5-417c-98c0-0ec85a0def55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:43.984240 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243f94a-cca5-417c-98c0-0ec85a0def55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:43.995291 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3243f94a-cca5-417c-98c0-0ec85a0def55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:43.996860 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3243f94a-cca5-417c-98c0-0ec85a0def55 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:44.008025 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 903/1813] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:44.708863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cebaad-e06f-40d7-acb8-00c42bb82b8c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:44.710464 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-88cebaad-e06f-40d7-acb8-00c42bb82b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:44.723864 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cebaad-e06f-40d7-acb8-00c42bb82b8c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:44.728093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b03fe-a5c8-4ba0-b07f-5cc33b792b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:44.728957 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b03fe-a5c8-4ba0-b07f-5cc33b792b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:44.729240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b03fe-a5c8-4ba0-b07f-5cc33b792b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:44.729520 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b03fe-a5c8-4ba0-b07f-5cc33b792b46 admin admin] PATH_INFO: `/v3/projects/d83bf5f7c93f4d5a80296b6886c43630` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:44.730771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b03fe-a5c8-4ba0-b07f-5cc33b792b46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d83bf5f7c93f4d5a80296b6886c43630)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:44.733237 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b03fe-a5c8-4ba0-b07f-5cc33b792b46 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:44.866238 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-092b03fe-a5c8-4ba0-b07f-5cc33b792b46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd83bf5f7c93f4d5a80296b6886c43630', 'request_id': 'req-092b03fe-a5c8-4ba0-b07f-5cc33b792b46'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:44.872622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-092b03fe-a5c8-4ba0-b07f-5cc33b792b46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd83bf5f7c93f4d5a80296b6886c43630', 'request_id': 'req-092b03fe-a5c8-4ba0-b07f-5cc33b792b46'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:44.992387 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-092b03fe-a5c8-4ba0-b07f-5cc33b792b46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd83bf5f7c93f4d5a80296b6886c43630', 'request_id': 'req-092b03fe-a5c8-4ba0-b07f-5cc33b792b46'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:45.003374 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-092b03fe-a5c8-4ba0-b07f-5cc33b792b46 admin admin] The token cache is being invalidate because project d83bf5f7c93f4d5a80296b6886c43630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:21:45.003657 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-092b03fe-a5c8-4ba0-b07f-5cc33b792b46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:45.004276 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-092b03fe-a5c8-4ba0-b07f-5cc33b792b46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:45.005877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 911/1814] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:21:44 2022] DELETE /identity/v3/projects/d83bf5f7c93f4d5a80296b6886c43630 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:45.015640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243f94a-cca5-417c-98c0-0ec85a0def55 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:45.025313 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243f94a-cca5-417c-98c0-0ec85a0def55 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:45.081802 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcbe8a-cd83-4d71-a90f-e4378993132e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:45.082806 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcbe8a-cd83-4d71-a90f-e4378993132e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:45.083094 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcbe8a-cd83-4d71-a90f-e4378993132e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:45.083370 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcbe8a-cd83-4d71-a90f-e4378993132e admin admin] PATH_INFO: `/v3/users/babf857f87254258b389dcdb43922519` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:45.084548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bcbe8a-cd83-4d71-a90f-e4378993132e admin admin] RBAC: Authorizing `identity:delete_user(user_id=babf857f87254258b389dcdb43922519)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:45.086511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bcbe8a-cd83-4d71-a90f-e4378993132e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:45.257572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c4bcbe8a-cd83-4d71-a90f-e4378993132e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'babf857f87254258b389dcdb43922519'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:45.346679 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c4bcbe8a-cd83-4d71-a90f-e4378993132e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'babf857f87254258b389dcdb43922519'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:45.347311 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c4bcbe8a-cd83-4d71-a90f-e4378993132e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'babf857f87254258b389dcdb43922519'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:45.360854 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c4bcbe8a-cd83-4d71-a90f-e4378993132e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'babf857f87254258b389dcdb43922519'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:45.361532 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c4bcbe8a-cd83-4d71-a90f-e4378993132e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'babf857f87254258b389dcdb43922519'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:45.378164 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 904/1815] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:21:45 2022] DELETE /identity/v3/users/babf857f87254258b389dcdb43922519 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:45.947448 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b03fe-a5c8-4ba0-b07f-5cc33b792b46 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:45.948975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-092b03fe-a5c8-4ba0-b07f-5cc33b792b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:45.973452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b03fe-a5c8-4ba0-b07f-5cc33b792b46 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:46.102401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4a4ef-e071-4913-ba65-ab3ce105a186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:46.103386 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4a4ef-e071-4913-ba65-ab3ce105a186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:46.103833 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4a4ef-e071-4913-ba65-ab3ce105a186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:46.104247 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4a4ef-e071-4913-ba65-ab3ce105a186 admin admin] PATH_INFO: `/v3/projects/ef259632e8d5467a82c740fecf91ff03` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:46.105634 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4a4ef-e071-4913-ba65-ab3ce105a186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef259632e8d5467a82c740fecf91ff03)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:46.108277 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4a4ef-e071-4913-ba65-ab3ce105a186 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:46.235148 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-73f4a4ef-e071-4913-ba65-ab3ce105a186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef259632e8d5467a82c740fecf91ff03', 'request_id': 'req-73f4a4ef-e071-4913-ba65-ab3ce105a186'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:46.245068 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-73f4a4ef-e071-4913-ba65-ab3ce105a186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef259632e8d5467a82c740fecf91ff03', 'request_id': 'req-73f4a4ef-e071-4913-ba65-ab3ce105a186'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:46.335296 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-73f4a4ef-e071-4913-ba65-ab3ce105a186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef259632e8d5467a82c740fecf91ff03', 'request_id': 'req-73f4a4ef-e071-4913-ba65-ab3ce105a186'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:46.347605 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-73f4a4ef-e071-4913-ba65-ab3ce105a186 admin admin] The token cache is being invalidate because project ef259632e8d5467a82c740fecf91ff03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:21:46.348021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-73f4a4ef-e071-4913-ba65-ab3ce105a186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:46.351380 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-73f4a4ef-e071-4913-ba65-ab3ce105a186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:46.352734 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 912/1816] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:21:45 2022] DELETE /identity/v3/projects/ef259632e8d5467a82c740fecf91ff03 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:46.359903 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a204a-5f6e-41de-b632-df099186afea None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:46.360849 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a204a-5f6e-41de-b632-df099186afea None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:46.361318 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a204a-5f6e-41de-b632-df099186afea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:46.385608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-861a204a-5f6e-41de-b632-df099186afea None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:46.387190 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-861a204a-5f6e-41de-b632-df099186afea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:46.454974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 905/1817] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:46.462571 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abd32b-fb64-4583-86e8-35a955ad8c5b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:46.462861 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abd32b-fb64-4583-86e8-35a955ad8c5b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:46.463165 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abd32b-fb64-4583-86e8-35a955ad8c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:46.487034 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b2abd32b-fb64-4583-86e8-35a955ad8c5b None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:46.487034 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b2abd32b-fb64-4583-86e8-35a955ad8c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:46.494156 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 913/1818] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:46.497488 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a204a-5f6e-41de-b632-df099186afea None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:46.507355 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a204a-5f6e-41de-b632-df099186afea None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:46.512040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635423d1-1958-45d4-a230-c6894fd419f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:46.517796 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635423d1-1958-45d4-a230-c6894fd419f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:46.517796 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635423d1-1958-45d4-a230-c6894fd419f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:46.517796 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635423d1-1958-45d4-a230-c6894fd419f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:46.517796 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635423d1-1958-45d4-a230-c6894fd419f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:21:46.517796 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635423d1-1958-45d4-a230-c6894fd419f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:46.517796 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635423d1-1958-45d4-a230-c6894fd419f6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:46.528668 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 906/1819] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:21:46.532963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abd32b-fb64-4583-86e8-35a955ad8c5b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:46.542648 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abd32b-fb64-4583-86e8-35a955ad8c5b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:46.547925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096ada6-9373-4609-82a1-85de005856e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:46.548774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096ada6-9373-4609-82a1-85de005856e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:46.549124 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096ada6-9373-4609-82a1-85de005856e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:46.549459 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096ada6-9373-4609-82a1-85de005856e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:46.550381 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096ada6-9373-4609-82a1-85de005856e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:46.553861 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096ada6-9373-4609-82a1-85de005856e5 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:46.666449 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 914/1820] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:21:46 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:46.674390 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635423d1-1958-45d4-a230-c6894fd419f6 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:46.690089 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635423d1-1958-45d4-a230-c6894fd419f6 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:46.781770 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a9be6-03a4-4f8a-82c0-5890fcfa61a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:46.782835 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a9be6-03a4-4f8a-82c0-5890fcfa61a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:46.783345 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a9be6-03a4-4f8a-82c0-5890fcfa61a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:46.784002 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a9be6-03a4-4f8a-82c0-5890fcfa61a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:46.785036 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a9be6-03a4-4f8a-82c0-5890fcfa61a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:46.787408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a9be6-03a4-4f8a-82c0-5890fcfa61a9 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:46.896067 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 907/1821] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:21:46 2022] POST /identity/v3/users => generated 283 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:46.900172 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096ada6-9373-4609-82a1-85de005856e5 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:46.919549 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096ada6-9373-4609-82a1-85de005856e5 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:46.925226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c438fb-93c5-4a08-9e99-c13ef03399c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:46.926214 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c438fb-93c5-4a08-9e99-c13ef03399c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:46.926723 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c438fb-93c5-4a08-9e99-c13ef03399c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:46.927148 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c438fb-93c5-4a08-9e99-c13ef03399c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:46.928280 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c438fb-93c5-4a08-9e99-c13ef03399c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:46.930112 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c438fb-93c5-4a08-9e99-c13ef03399c2 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:46.945398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 915/1822] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:46.949377 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a9be6-03a4-4f8a-82c0-5890fcfa61a9 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:46.965056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a9be6-03a4-4f8a-82c0-5890fcfa61a9 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:46.970262 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346772fa-df99-42b8-8244-610bf4e2f5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:46.970944 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346772fa-df99-42b8-8244-610bf4e2f5ca admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:46.971230 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346772fa-df99-42b8-8244-610bf4e2f5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:46.971502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346772fa-df99-42b8-8244-610bf4e2f5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:46.972599 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346772fa-df99-42b8-8244-610bf4e2f5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:46.977402 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346772fa-df99-42b8-8244-610bf4e2f5ca admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:46.993676 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 908/1823] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:47.003912 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c438fb-93c5-4a08-9e99-c13ef03399c2 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:47.018839 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c438fb-93c5-4a08-9e99-c13ef03399c2 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:47.026058 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b01ebf-76f7-4fb8-ba53-96608ed3f7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:47.027950 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b01ebf-76f7-4fb8-ba53-96608ed3f7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:47.028463 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b01ebf-76f7-4fb8-ba53-96608ed3f7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:47.028901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b01ebf-76f7-4fb8-ba53-96608ed3f7b5 admin admin] PATH_INFO: `/v3/projects/69e315bc0b0748c2831dd81c127e491a/users/70cf2c61e55f4a5e83eca3937ac835e8/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:47.051402 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b01ebf-76f7-4fb8-ba53-96608ed3f7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69e315bc0b0748c2831dd81c127e491a, user_id=70cf2c61e55f4a5e83eca3937ac835e8, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:47.058836 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b01ebf-76f7-4fb8-ba53-96608ed3f7b5 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:47.182104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 916/1824] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:47 2022] PUT /identity/v3/projects/69e315bc0b0748c2831dd81c127e491a/users/70cf2c61e55f4a5e83eca3937ac835e8/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:47.193813 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488d590-170c-460c-9cfc-a5e9279f6aef None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:47.194344 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488d590-170c-460c-9cfc-a5e9279f6aef None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:47.194831 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488d590-170c-460c-9cfc-a5e9279f6aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:47.236353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a488d590-170c-460c-9cfc-a5e9279f6aef None None] MFA Rules not processed for user `70cf2c61e55f4a5e83eca3937ac835e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:47.238057 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a488d590-170c-460c-9cfc-a5e9279f6aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:47.328187 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 909/1825] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:47.332642 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b01ebf-76f7-4fb8-ba53-96608ed3f7b5 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:47.439064 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b01ebf-76f7-4fb8-ba53-96608ed3f7b5 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:47.444317 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d63d67-c229-430c-b27c-8cb8a7bc0dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:47.445142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d63d67-c229-430c-b27c-8cb8a7bc0dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:47.445542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d63d67-c229-430c-b27c-8cb8a7bc0dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:47.446178 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d63d67-c229-430c-b27c-8cb8a7bc0dc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:47.446791 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d63d67-c229-430c-b27c-8cb8a7bc0dc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:47.448949 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d63d67-c229-430c-b27c-8cb8a7bc0dc4 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:47.562922 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 917/1826] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:21:47 2022] POST /identity/v3/projects => generated 363 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:47.568445 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488d590-170c-460c-9cfc-a5e9279f6aef None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:47.579601 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488d590-170c-460c-9cfc-a5e9279f6aef None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:47.665530 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985b196-00d0-45da-ad62-2979801e21f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:47.666508 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985b196-00d0-45da-ad62-2979801e21f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:47.666918 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985b196-00d0-45da-ad62-2979801e21f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:47.667524 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985b196-00d0-45da-ad62-2979801e21f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:47.668408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985b196-00d0-45da-ad62-2979801e21f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:47.671268 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985b196-00d0-45da-ad62-2979801e21f9 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:47.746863 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 910/1827] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:21:47 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:47.751049 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d63d67-c229-430c-b27c-8cb8a7bc0dc4 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:47.761757 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d63d67-c229-430c-b27c-8cb8a7bc0dc4 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:47.767682 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584c7f6-f32d-425e-b97e-dace6f06da1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:47.768387 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584c7f6-f32d-425e-b97e-dace6f06da1f admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:47.768726 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584c7f6-f32d-425e-b97e-dace6f06da1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:47.769065 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584c7f6-f32d-425e-b97e-dace6f06da1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:47.769931 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584c7f6-f32d-425e-b97e-dace6f06da1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:47.771587 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584c7f6-f32d-425e-b97e-dace6f06da1f admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:47.786667 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 918/1828] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:21:47.787680 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985b196-00d0-45da-ad62-2979801e21f9 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:47.797710 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985b196-00d0-45da-ad62-2979801e21f9 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:47.802382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c12aa-23f9-459a-bbe2-74c45299c4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:47.804403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c12aa-23f9-459a-bbe2-74c45299c4dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:47.804403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c12aa-23f9-459a-bbe2-74c45299c4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:47.804403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c12aa-23f9-459a-bbe2-74c45299c4dd admin admin] PATH_INFO: `/v3/projects/6017e7ef523d4250af7aa71d704795a9/users/bc5d6012137647169ad726b7295969cc/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:47.820271 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c12aa-23f9-459a-bbe2-74c45299c4dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6017e7ef523d4250af7aa71d704795a9, user_id=bc5d6012137647169ad726b7295969cc, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:47.822986 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c12aa-23f9-459a-bbe2-74c45299c4dd admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:47.900557 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 911/1829] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:47 2022] PUT /identity/v3/projects/6017e7ef523d4250af7aa71d704795a9/users/bc5d6012137647169ad726b7295969cc/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:21:47.905174 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584c7f6-f32d-425e-b97e-dace6f06da1f admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:47.915073 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584c7f6-f32d-425e-b97e-dace6f06da1f admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:47.971994 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d45ff-1591-4a82-b7ff-4dd4c13e5f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:47.972621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d45ff-1591-4a82-b7ff-4dd4c13e5f28 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:47.972899 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d45ff-1591-4a82-b7ff-4dd4c13e5f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:47.973182 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d45ff-1591-4a82-b7ff-4dd4c13e5f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:47.973935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d45ff-1591-4a82-b7ff-4dd4c13e5f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:47.975580 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d45ff-1591-4a82-b7ff-4dd4c13e5f28 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:47.985716 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 919/1830] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:47.990032 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c12aa-23f9-459a-bbe2-74c45299c4dd admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:48.001583 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c12aa-23f9-459a-bbe2-74c45299c4dd admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:48.006231 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae771d-0899-4664-adef-9e08d04e79b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:48.007114 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae771d-0899-4664-adef-9e08d04e79b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:48.007403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae771d-0899-4664-adef-9e08d04e79b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:48.007801 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae771d-0899-4664-adef-9e08d04e79b2 admin admin] PATH_INFO: `/v3/projects/6017e7ef523d4250af7aa71d704795a9/users/bc5d6012137647169ad726b7295969cc/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:48.009733 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae771d-0899-4664-adef-9e08d04e79b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6017e7ef523d4250af7aa71d704795a9, user_id=bc5d6012137647169ad726b7295969cc, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:48.012459 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae771d-0899-4664-adef-9e08d04e79b2 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:48.023629 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 912/1831] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:47 2022] PUT /identity/v3/projects/6017e7ef523d4250af7aa71d704795a9/users/bc5d6012137647169ad726b7295969cc/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:48.035291 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b42da0-b900-4027-9172-ddb879508571 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:48.035802 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b42da0-b900-4027-9172-ddb879508571 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:48.036117 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b42da0-b900-4027-9172-ddb879508571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:48.076257 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b3b42da0-b900-4027-9172-ddb879508571 None None] MFA Rules not processed for user `bc5d6012137647169ad726b7295969cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:48.077548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b3b42da0-b900-4027-9172-ddb879508571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:48.178067 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 920/1832] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:48 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:48.191020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae771d-0899-4664-adef-9e08d04e79b2 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:48.198006 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-73ae771d-0899-4664-adef-9e08d04e79b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:48.267502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae771d-0899-4664-adef-9e08d04e79b2 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:48.271758 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef90a6-9af0-447d-871f-a0e756873aba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:48.272348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef90a6-9af0-447d-871f-a0e756873aba service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:48.272675 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef90a6-9af0-447d-871f-a0e756873aba service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:48.272937 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef90a6-9af0-447d-871f-a0e756873aba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:48.285499 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef90a6-9af0-447d-871f-a0e756873aba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:48.286921 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef90a6-9af0-447d-871f-a0e756873aba service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:48.298276 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 913/1833] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:48 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:48.524240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b42da0-b900-4027-9172-ddb879508571 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:48.525660 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b3b42da0-b900-4027-9172-ddb879508571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:48.537626 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b42da0-b900-4027-9172-ddb879508571 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:48.541589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb18c9-9d88-447e-a43e-d679f47af47e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:48.542464 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb18c9-9d88-447e-a43e-d679f47af47e service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:48.542827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb18c9-9d88-447e-a43e-d679f47af47e service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:48.543206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb18c9-9d88-447e-a43e-d679f47af47e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:48.598664 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb18c9-9d88-447e-a43e-d679f47af47e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:48.600121 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb18c9-9d88-447e-a43e-d679f47af47e service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:48.609476 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 921/1834] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:49.182335 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef90a6-9af0-447d-871f-a0e756873aba service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:49.195190 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef90a6-9af0-447d-871f-a0e756873aba service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:49.199412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e51328-3835-462b-a03d-24c302f9bd11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:49.211906 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e51328-3835-462b-a03d-24c302f9bd11 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:49.212246 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e51328-3835-462b-a03d-24c302f9bd11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:49.212532 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e51328-3835-462b-a03d-24c302f9bd11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:49.216382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-70e51328-3835-462b-a03d-24c302f9bd11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:49.292746 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e51328-3835-462b-a03d-24c302f9bd11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:49.298868 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e51328-3835-462b-a03d-24c302f9bd11 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:49.321230 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 914/1835] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:49.647494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb18c9-9d88-447e-a43e-d679f47af47e service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:49.654902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3fdb18c9-9d88-447e-a43e-d679f47af47e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:49.781570 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb18c9-9d88-447e-a43e-d679f47af47e service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:49.787485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eac2d9-403a-4453-a1a9-bd667d32a0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:49.788565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eac2d9-403a-4453-a1a9-bd667d32a0a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:49.789685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eac2d9-403a-4453-a1a9-bd667d32a0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:49.790117 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eac2d9-403a-4453-a1a9-bd667d32a0a3 admin admin] PATH_INFO: `/v3/users/722795d75a6945f1a400f82715c2eb57` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:49.791807 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eac2d9-403a-4453-a1a9-bd667d32a0a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=722795d75a6945f1a400f82715c2eb57)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:49.795168 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eac2d9-403a-4453-a1a9-bd667d32a0a3 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:50.027641 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f6eac2d9-403a-4453-a1a9-bd667d32a0a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '722795d75a6945f1a400f82715c2eb57'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:50.066300 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f6eac2d9-403a-4453-a1a9-bd667d32a0a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '722795d75a6945f1a400f82715c2eb57'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:50.072250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f6eac2d9-403a-4453-a1a9-bd667d32a0a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '722795d75a6945f1a400f82715c2eb57'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:50.078585 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f6eac2d9-403a-4453-a1a9-bd667d32a0a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '722795d75a6945f1a400f82715c2eb57'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:50.096628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f6eac2d9-403a-4453-a1a9-bd667d32a0a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '722795d75a6945f1a400f82715c2eb57'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:50.193328 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 922/1836] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:21:49 2022] DELETE /identity/v3/users/722795d75a6945f1a400f82715c2eb57 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:50.197789 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaeea2c-a8ae-4049-a63e-26cb602aaee6 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:50.198354 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaeea2c-a8ae-4049-a63e-26cb602aaee6 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:50.198428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaeea2c-a8ae-4049-a63e-26cb602aaee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:50.236883 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-fbaeea2c-a8ae-4049-a63e-26cb602aaee6 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:50.240875 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-fbaeea2c-a8ae-4049-a63e-26cb602aaee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:50.330541 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 915/1837] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:50.346211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eac2d9-403a-4453-a1a9-bd667d32a0a3 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:50.348402 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f6eac2d9-403a-4453-a1a9-bd667d32a0a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:50.420065 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eac2d9-403a-4453-a1a9-bd667d32a0a3 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:50.423985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c37ce-8d9d-4c4d-ba63-2b54bef4202f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:50.424632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c37ce-8d9d-4c4d-ba63-2b54bef4202f service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:50.424909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c37ce-8d9d-4c4d-ba63-2b54bef4202f service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:50.425178 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c37ce-8d9d-4c4d-ba63-2b54bef4202f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:50.441736 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c37ce-8d9d-4c4d-ba63-2b54bef4202f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:50.444153 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c37ce-8d9d-4c4d-ba63-2b54bef4202f service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:50.460451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 923/1838] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:21:50.479775 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087d10d-b96b-4dfe-b0bf-13b05d4d1468 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:50.481263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087d10d-b96b-4dfe-b0bf-13b05d4d1468 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:50.482325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087d10d-b96b-4dfe-b0bf-13b05d4d1468 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:50.484737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 916/1839] 10.222.0.76 () {54 vars in 921 bytes} [Mon May 16 15:21:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:21:50.504315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca18915-e71d-4e80-b55f-d9227ba5aafe None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:50.504612 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca18915-e71d-4e80-b55f-d9227ba5aafe None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:50.505003 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca18915-e71d-4e80-b55f-d9227ba5aafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:50.527971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-5ca18915-e71d-4e80-b55f-d9227ba5aafe None None] MFA Rules not processed for user `9d85024f010c40129d79543b3ec4cfae`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:50.529333 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5ca18915-e71d-4e80-b55f-d9227ba5aafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:50.667088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 924/1840] 10.222.0.76 () {58 vars in 1018 bytes} [Mon May 16 15:21:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:50.681263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087d10d-b96b-4dfe-b0bf-13b05d4d1468 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:50.685388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c087d10d-b96b-4dfe-b0bf-13b05d4d1468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:50.710099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087d10d-b96b-4dfe-b0bf-13b05d4d1468 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:50.717279 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837f5f6-da18-4ea3-910b-cec86eb96de4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:50.717431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837f5f6-da18-4ea3-910b-cec86eb96de4 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:50.717774 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837f5f6-da18-4ea3-910b-cec86eb96de4 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:50.718120 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837f5f6-da18-4ea3-910b-cec86eb96de4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:50.730079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837f5f6-da18-4ea3-910b-cec86eb96de4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:50.732671 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837f5f6-da18-4ea3-910b-cec86eb96de4 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:50.747958 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 917/1841] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:51.236401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca18915-e71d-4e80-b55f-d9227ba5aafe None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:51.237997 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5ca18915-e71d-4e80-b55f-d9227ba5aafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:51.262664 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca18915-e71d-4e80-b55f-d9227ba5aafe None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:51.265829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e7d44-c8e5-4433-ba63-d275c1947853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:51.267315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e7d44-c8e5-4433-ba63-d275c1947853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:51.267779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e7d44-c8e5-4433-ba63-d275c1947853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:51.268616 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e7d44-c8e5-4433-ba63-d275c1947853 admin admin] PATH_INFO: `/v3/projects/dcef043f1ed4441eb9ae33d9b085c66d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:51.270762 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e7d44-c8e5-4433-ba63-d275c1947853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcef043f1ed4441eb9ae33d9b085c66d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:51.273291 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e7d44-c8e5-4433-ba63-d275c1947853 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:51.487677 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ab6e7d44-c8e5-4433-ba63-d275c1947853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcef043f1ed4441eb9ae33d9b085c66d', 'request_id': 'req-ab6e7d44-c8e5-4433-ba63-d275c1947853'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:51.494650 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ab6e7d44-c8e5-4433-ba63-d275c1947853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcef043f1ed4441eb9ae33d9b085c66d', 'request_id': 'req-ab6e7d44-c8e5-4433-ba63-d275c1947853'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:51.592081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ab6e7d44-c8e5-4433-ba63-d275c1947853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcef043f1ed4441eb9ae33d9b085c66d', 'request_id': 'req-ab6e7d44-c8e5-4433-ba63-d275c1947853'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:51.603372 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ab6e7d44-c8e5-4433-ba63-d275c1947853 admin admin] The token cache is being invalidate because project dcef043f1ed4441eb9ae33d9b085c66d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:21:51.603660 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ab6e7d44-c8e5-4433-ba63-d275c1947853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:51.604328 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ab6e7d44-c8e5-4433-ba63-d275c1947853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:51.606026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 925/1842] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:21:51 2022] DELETE /identity/v3/projects/dcef043f1ed4441eb9ae33d9b085c66d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:51.610054 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837f5f6-da18-4ea3-910b-cec86eb96de4 service nova] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:51.621479 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837f5f6-da18-4ea3-910b-cec86eb96de4 service nova] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:51.695181 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9801e69-dd47-4395-83ac-8c4cfd6b2acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:51.696054 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9801e69-dd47-4395-83ac-8c4cfd6b2acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:51.696332 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9801e69-dd47-4395-83ac-8c4cfd6b2acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:51.696602 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9801e69-dd47-4395-83ac-8c4cfd6b2acd admin admin] PATH_INFO: `/v3/users/f4c36c8c0a9e4642b3b08614c78d8340` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:51.697778 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9801e69-dd47-4395-83ac-8c4cfd6b2acd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4c36c8c0a9e4642b3b08614c78d8340)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:51.699734 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9801e69-dd47-4395-83ac-8c4cfd6b2acd admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:51.874043 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a9801e69-dd47-4395-83ac-8c4cfd6b2acd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4c36c8c0a9e4642b3b08614c78d8340'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:51.940300 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a9801e69-dd47-4395-83ac-8c4cfd6b2acd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4c36c8c0a9e4642b3b08614c78d8340'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:51.940954 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a9801e69-dd47-4395-83ac-8c4cfd6b2acd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4c36c8c0a9e4642b3b08614c78d8340'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:51.952888 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a9801e69-dd47-4395-83ac-8c4cfd6b2acd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4c36c8c0a9e4642b3b08614c78d8340'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:51.953527 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a9801e69-dd47-4395-83ac-8c4cfd6b2acd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4c36c8c0a9e4642b3b08614c78d8340'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:51.965212 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 918/1843] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:21:51 2022] DELETE /identity/v3/users/f4c36c8c0a9e4642b3b08614c78d8340 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:52.596531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e7d44-c8e5-4433-ba63-d275c1947853 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:52.596531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ab6e7d44-c8e5-4433-ba63-d275c1947853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:52.611597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e7d44-c8e5-4433-ba63-d275c1947853 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:52.691380 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23a94f-e66f-471e-8230-a76846ee3fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:52.692339 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23a94f-e66f-471e-8230-a76846ee3fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:52.692629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23a94f-e66f-471e-8230-a76846ee3fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:52.692906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23a94f-e66f-471e-8230-a76846ee3fb7 admin admin] PATH_INFO: `/v3/projects/6396736e94eb46e6b1d3b4b1ed1adff4` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:52.694547 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23a94f-e66f-471e-8230-a76846ee3fb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6396736e94eb46e6b1d3b4b1ed1adff4)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:52.696528 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23a94f-e66f-471e-8230-a76846ee3fb7 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:52.803144 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-aa23a94f-e66f-471e-8230-a76846ee3fb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6396736e94eb46e6b1d3b4b1ed1adff4', 'request_id': 'req-aa23a94f-e66f-471e-8230-a76846ee3fb7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:52.809135 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-aa23a94f-e66f-471e-8230-a76846ee3fb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6396736e94eb46e6b1d3b4b1ed1adff4', 'request_id': 'req-aa23a94f-e66f-471e-8230-a76846ee3fb7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:52.877556 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-aa23a94f-e66f-471e-8230-a76846ee3fb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6396736e94eb46e6b1d3b4b1ed1adff4', 'request_id': 'req-aa23a94f-e66f-471e-8230-a76846ee3fb7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:52.888433 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-aa23a94f-e66f-471e-8230-a76846ee3fb7 admin admin] The token cache is being invalidate because project 6396736e94eb46e6b1d3b4b1ed1adff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:21:52.888739 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-aa23a94f-e66f-471e-8230-a76846ee3fb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:52.889337 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-aa23a94f-e66f-471e-8230-a76846ee3fb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:52.890909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 926/1844] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:21:52 2022] DELETE /identity/v3/projects/6396736e94eb46e6b1d3b4b1ed1adff4 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:52.895971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a3cae-bd7a-492b-b636-b7d7a2420105 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:52.896436 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a3cae-bd7a-492b-b636-b7d7a2420105 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:52.896521 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a3cae-bd7a-492b-b636-b7d7a2420105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:52.914158 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-c21a3cae-bd7a-492b-b636-b7d7a2420105 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:52.915403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c21a3cae-bd7a-492b-b636-b7d7a2420105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:52.975734 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 919/1845] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:52.993609 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da630ec-b83a-42c1-8729-0f6e13aee2d4 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:52.993897 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da630ec-b83a-42c1-8729-0f6e13aee2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:52.994212 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da630ec-b83a-42c1-8729-0f6e13aee2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:53.012478 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-4da630ec-b83a-42c1-8729-0f6e13aee2d4 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:53.013679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4da630ec-b83a-42c1-8729-0f6e13aee2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:53.021488 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 927/1846] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:53.025581 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a3cae-bd7a-492b-b636-b7d7a2420105 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:53.035389 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a3cae-bd7a-492b-b636-b7d7a2420105 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:53.039925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e0c0a-53c9-4d6b-a498-79982dd08d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:53.040573 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e0c0a-53c9-4d6b-a498-79982dd08d62 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:53.040857 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e0c0a-53c9-4d6b-a498-79982dd08d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:53.041135 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e0c0a-53c9-4d6b-a498-79982dd08d62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:53.041862 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e0c0a-53c9-4d6b-a498-79982dd08d62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:21:53.042197 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e0c0a-53c9-4d6b-a498-79982dd08d62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:53.044354 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e0c0a-53c9-4d6b-a498-79982dd08d62 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:53.055517 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 920/1847] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:21:53.059660 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da630ec-b83a-42c1-8729-0f6e13aee2d4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:53.068799 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da630ec-b83a-42c1-8729-0f6e13aee2d4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:53.073290 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2c0fb-aafb-4dbb-9559-5b02a71f6c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:53.073926 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2c0fb-aafb-4dbb-9559-5b02a71f6c36 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:53.074243 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2c0fb-aafb-4dbb-9559-5b02a71f6c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:53.074517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2c0fb-aafb-4dbb-9559-5b02a71f6c36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:53.075199 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2c0fb-aafb-4dbb-9559-5b02a71f6c36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:53.077508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2c0fb-aafb-4dbb-9559-5b02a71f6c36 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:53.176710 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 928/1848] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:21:53 2022] POST /identity/v3/projects => generated 405 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:53.180887 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e0c0a-53c9-4d6b-a498-79982dd08d62 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:53.190727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e0c0a-53c9-4d6b-a498-79982dd08d62 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:53.249385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1241c1-4dae-4b27-8b28-4d23d747c4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:53.250059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1241c1-4dae-4b27-8b28-4d23d747c4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:53.250371 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1241c1-4dae-4b27-8b28-4d23d747c4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:53.250645 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1241c1-4dae-4b27-8b28-4d23d747c4c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:53.251344 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1241c1-4dae-4b27-8b28-4d23d747c4c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:53.253275 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1241c1-4dae-4b27-8b28-4d23d747c4c4 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:53.363954 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 921/1849] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:21:53 2022] POST /identity/v3/users => generated 303 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:53.368047 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2c0fb-aafb-4dbb-9559-5b02a71f6c36 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:53.378550 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2c0fb-aafb-4dbb-9559-5b02a71f6c36 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:53.383167 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c45d6-dc80-466a-9f66-8ea40996aa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:53.383821 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c45d6-dc80-466a-9f66-8ea40996aa91 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:53.384101 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c45d6-dc80-466a-9f66-8ea40996aa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:53.384375 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c45d6-dc80-466a-9f66-8ea40996aa91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:53.385102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c45d6-dc80-466a-9f66-8ea40996aa91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:53.386719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c45d6-dc80-466a-9f66-8ea40996aa91 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:53.398214 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 929/1850] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:53.402354 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1241c1-4dae-4b27-8b28-4d23d747c4c4 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:53.413389 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1241c1-4dae-4b27-8b28-4d23d747c4c4 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:53.417971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a2571-8396-447b-8652-defcc78fc2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:53.418735 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a2571-8396-447b-8652-defcc78fc2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:53.418969 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a2571-8396-447b-8652-defcc78fc2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:53.419243 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a2571-8396-447b-8652-defcc78fc2d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:53.419964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a2571-8396-447b-8652-defcc78fc2d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:53.425314 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a2571-8396-447b-8652-defcc78fc2d6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:53.431899 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 922/1851] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:53.436025 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c45d6-dc80-466a-9f66-8ea40996aa91 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:53.445943 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c45d6-dc80-466a-9f66-8ea40996aa91 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:53.451095 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bc75f-fd84-484d-8e96-a0d9e95ec25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:53.451963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bc75f-fd84-484d-8e96-a0d9e95ec25a admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:53.452241 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bc75f-fd84-484d-8e96-a0d9e95ec25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:53.452512 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bc75f-fd84-484d-8e96-a0d9e95ec25a admin admin] PATH_INFO: `/v3/projects/24d03716d6dc4108966628fa296cb937/users/0212866a023247679c1ff1e040588365/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:53.474701 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705bc75f-fd84-484d-8e96-a0d9e95ec25a admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d03716d6dc4108966628fa296cb937, user_id=0212866a023247679c1ff1e040588365, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:53.477440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705bc75f-fd84-484d-8e96-a0d9e95ec25a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:53.530893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 930/1852] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:53 2022] PUT /identity/v3/projects/24d03716d6dc4108966628fa296cb937/users/0212866a023247679c1ff1e040588365/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:53.543105 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb089b70-731c-4d47-8a8f-b8d8f1c191f5 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:53.543105 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb089b70-731c-4d47-8a8f-b8d8f1c191f5 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:53.543105 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb089b70-731c-4d47-8a8f-b8d8f1c191f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:53.568905 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-cb089b70-731c-4d47-8a8f-b8d8f1c191f5 None None] MFA Rules not processed for user `0212866a023247679c1ff1e040588365`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:53.570178 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-cb089b70-731c-4d47-8a8f-b8d8f1c191f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:53.651193 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 923/1853] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:53 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:53.652400 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bc75f-fd84-484d-8e96-a0d9e95ec25a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:53.737357 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bc75f-fd84-484d-8e96-a0d9e95ec25a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:53.742528 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3472c2c-4b76-4fa3-9955-e16d5e8a0ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:53.743285 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3472c2c-4b76-4fa3-9955-e16d5e8a0ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:53.743774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3472c2c-4b76-4fa3-9955-e16d5e8a0ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:53.744090 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3472c2c-4b76-4fa3-9955-e16d5e8a0ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:53.744768 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3472c2c-4b76-4fa3-9955-e16d5e8a0ae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:53.749002 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3472c2c-4b76-4fa3-9955-e16d5e8a0ae6 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:53.870710 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 931/1854] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:21:53 2022] POST /identity/v3/projects => generated 409 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:53.875094 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb089b70-731c-4d47-8a8f-b8d8f1c191f5 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:53.886587 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb089b70-731c-4d47-8a8f-b8d8f1c191f5 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:53.953438 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5a049-4472-4183-a60f-1766f02bf9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:53.955215 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5a049-4472-4183-a60f-1766f02bf9cd admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:53.955683 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5a049-4472-4183-a60f-1766f02bf9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:53.956279 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5a049-4472-4183-a60f-1766f02bf9cd admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:53.957254 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5a049-4472-4183-a60f-1766f02bf9cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:53.959253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5a049-4472-4183-a60f-1766f02bf9cd admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:54.044091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 924/1855] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:21:53 2022] POST /identity/v3/users => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:54.048235 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3472c2c-4b76-4fa3-9955-e16d5e8a0ae6 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:54.058688 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3472c2c-4b76-4fa3-9955-e16d5e8a0ae6 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:54.063657 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ddcd24-533a-4778-9eb9-a4f9cc500ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:54.064359 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddcd24-533a-4778-9eb9-a4f9cc500ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:54.064640 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddcd24-533a-4778-9eb9-a4f9cc500ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:54.064918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddcd24-533a-4778-9eb9-a4f9cc500ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:54.065651 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ddcd24-533a-4778-9eb9-a4f9cc500ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:54.069625 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ddcd24-533a-4778-9eb9-a4f9cc500ec0 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:54.082435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 932/1856] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:54.083564 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5a049-4472-4183-a60f-1766f02bf9cd admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:54.093953 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5a049-4472-4183-a60f-1766f02bf9cd admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:54.098514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133934e8-7fe2-4d26-9fec-62e6b9d06f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:54.099385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133934e8-7fe2-4d26-9fec-62e6b9d06f7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:54.099665 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133934e8-7fe2-4d26-9fec-62e6b9d06f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:54.099937 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133934e8-7fe2-4d26-9fec-62e6b9d06f7d admin admin] PATH_INFO: `/v3/projects/3df724151dd84f2d8a89405549e75ab6/users/a1856b2f03ab437bbda715e484605c90/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:54.114288 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133934e8-7fe2-4d26-9fec-62e6b9d06f7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df724151dd84f2d8a89405549e75ab6, user_id=a1856b2f03ab437bbda715e484605c90, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:54.117048 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133934e8-7fe2-4d26-9fec-62e6b9d06f7d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:54.210459 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 925/1857] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:54 2022] PUT /identity/v3/projects/3df724151dd84f2d8a89405549e75ab6/users/a1856b2f03ab437bbda715e484605c90/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:54.211512 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ddcd24-533a-4778-9eb9-a4f9cc500ec0 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:54.223756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ddcd24-533a-4778-9eb9-a4f9cc500ec0 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:54.291383 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482bf58-94f4-46b9-8c7c-09e40875de7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:54.292194 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482bf58-94f4-46b9-8c7c-09e40875de7d admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:54.292484 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482bf58-94f4-46b9-8c7c-09e40875de7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:54.292759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482bf58-94f4-46b9-8c7c-09e40875de7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:54.293519 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6482bf58-94f4-46b9-8c7c-09e40875de7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:54.295180 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6482bf58-94f4-46b9-8c7c-09e40875de7d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:54.311846 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133934e8-7fe2-4d26-9fec-62e6b9d06f7d admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:54.316686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 933/1858] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:54.322846 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133934e8-7fe2-4d26-9fec-62e6b9d06f7d admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:54.328979 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1548047-9155-4640-8d4a-23298be6c4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:54.330661 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1548047-9155-4640-8d4a-23298be6c4f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:54.331071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1548047-9155-4640-8d4a-23298be6c4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:54.331562 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1548047-9155-4640-8d4a-23298be6c4f6 admin admin] PATH_INFO: `/v3/projects/3df724151dd84f2d8a89405549e75ab6/users/a1856b2f03ab437bbda715e484605c90/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:54.333793 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1548047-9155-4640-8d4a-23298be6c4f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df724151dd84f2d8a89405549e75ab6, user_id=a1856b2f03ab437bbda715e484605c90, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:54.336756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1548047-9155-4640-8d4a-23298be6c4f6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:54.351059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 926/1859] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:21:54 2022] PUT /identity/v3/projects/3df724151dd84f2d8a89405549e75ab6/users/a1856b2f03ab437bbda715e484605c90/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:54.362826 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f96c04-3a25-41c1-b1cc-3c141977da96 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:54.363187 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f96c04-3a25-41c1-b1cc-3c141977da96 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:54.363540 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f96c04-3a25-41c1-b1cc-3c141977da96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:54.401327 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b8f96c04-3a25-41c1-b1cc-3c141977da96 None None] MFA Rules not processed for user `a1856b2f03ab437bbda715e484605c90`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:54.403146 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b8f96c04-3a25-41c1-b1cc-3c141977da96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:54.488347 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 934/1860] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:21:54 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:54.647731 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1548047-9155-4640-8d4a-23298be6c4f6 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:54.648919 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d1548047-9155-4640-8d4a-23298be6c4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:54.710807 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1548047-9155-4640-8d4a-23298be6c4f6 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:54.715286 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42e164-d879-405a-ab50-696e97c40734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:54.715996 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42e164-d879-405a-ab50-696e97c40734 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:54.716285 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42e164-d879-405a-ab50-696e97c40734 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:54.716554 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42e164-d879-405a-ab50-696e97c40734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:54.726865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42e164-d879-405a-ab50-696e97c40734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:54.728335 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42e164-d879-405a-ab50-696e97c40734 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:54.739681 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 927/1861] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:54 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:55.418507 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f96c04-3a25-41c1-b1cc-3c141977da96 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:55.430810 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f96c04-3a25-41c1-b1cc-3c141977da96 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:55.435782 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a4d71-96c8-4763-bba8-f83a088b2a58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:55.436463 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a4d71-96c8-4763-bba8-f83a088b2a58 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:55.436740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a4d71-96c8-4763-bba8-f83a088b2a58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:55.437040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a4d71-96c8-4763-bba8-f83a088b2a58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:55.537617 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a4d71-96c8-4763-bba8-f83a088b2a58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:55.539155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a4d71-96c8-4763-bba8-f83a088b2a58 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:55.550975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 935/1862] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:21:55 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:12.503411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42e164-d879-405a-ab50-696e97c40734 service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:12.504914 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4a42e164-d879-405a-ab50-696e97c40734 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:12.573970 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42e164-d879-405a-ab50-696e97c40734 service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:12.579531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36481547-b7f4-485d-bf8d-73f797fef9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:12.580416 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36481547-b7f4-485d-bf8d-73f797fef9b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:12.580693 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36481547-b7f4-485d-bf8d-73f797fef9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:12.580974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36481547-b7f4-485d-bf8d-73f797fef9b6 admin admin] PATH_INFO: `/v3/users/70cf2c61e55f4a5e83eca3937ac835e8` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:12.582305 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36481547-b7f4-485d-bf8d-73f797fef9b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70cf2c61e55f4a5e83eca3937ac835e8)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:12.584326 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36481547-b7f4-485d-bf8d-73f797fef9b6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:12.798939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-36481547-b7f4-485d-bf8d-73f797fef9b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70cf2c61e55f4a5e83eca3937ac835e8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:12.911333 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-36481547-b7f4-485d-bf8d-73f797fef9b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70cf2c61e55f4a5e83eca3937ac835e8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:12.912077 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-36481547-b7f4-485d-bf8d-73f797fef9b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70cf2c61e55f4a5e83eca3937ac835e8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:12.931060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-36481547-b7f4-485d-bf8d-73f797fef9b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70cf2c61e55f4a5e83eca3937ac835e8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:12.931801 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-36481547-b7f4-485d-bf8d-73f797fef9b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70cf2c61e55f4a5e83eca3937ac835e8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:12.945153 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 928/1863] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:22:12 2022] DELETE /identity/v3/users/70cf2c61e55f4a5e83eca3937ac835e8 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:12.949394 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0573a2-5948-4829-a93e-d11c29a387ca None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:12.949874 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0573a2-5948-4829-a93e-d11c29a387ca None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:12.949971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0573a2-5948-4829-a93e-d11c29a387ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:12.999215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7f0573a2-5948-4829-a93e-d11c29a387ca None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:13.001506 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7f0573a2-5948-4829-a93e-d11c29a387ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:13.067519 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 936/1864] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:13.077203 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36481547-b7f4-485d-bf8d-73f797fef9b6 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:13.079352 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-36481547-b7f4-485d-bf8d-73f797fef9b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:13.147163 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36481547-b7f4-485d-bf8d-73f797fef9b6 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:13.151326 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7941a-5e56-47aa-b480-98053ae0e1a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:13.156368 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7941a-5e56-47aa-b480-98053ae0e1a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:13.156368 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7941a-5e56-47aa-b480-98053ae0e1a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:13.156368 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7941a-5e56-47aa-b480-98053ae0e1a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:13.162849 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7941a-5e56-47aa-b480-98053ae0e1a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:13.164322 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7941a-5e56-47aa-b480-98053ae0e1a3 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:13.184461 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 929/1865] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:13.704586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0573a2-5948-4829-a93e-d11c29a387ca None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:13.706041 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7f0573a2-5948-4829-a93e-d11c29a387ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:13.718604 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0573a2-5948-4829-a93e-d11c29a387ca None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:13.723347 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f601b-07fc-40af-b117-2d29d44f62de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:13.724206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f601b-07fc-40af-b117-2d29d44f62de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:13.724509 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f601b-07fc-40af-b117-2d29d44f62de admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:13.724786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f601b-07fc-40af-b117-2d29d44f62de admin admin] PATH_INFO: `/v3/users/0212866a023247679c1ff1e040588365` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:13.726081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f601b-07fc-40af-b117-2d29d44f62de admin admin] RBAC: Authorizing `identity:delete_user(user_id=0212866a023247679c1ff1e040588365)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:13.728099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f601b-07fc-40af-b117-2d29d44f62de admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:13.735717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7941a-5e56-47aa-b480-98053ae0e1a3 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:13.737221 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9da7941a-5e56-47aa-b480-98053ae0e1a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:13.750815 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7941a-5e56-47aa-b480-98053ae0e1a3 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:13.755865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad91d21-88ac-4569-9999-d3e0761627fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:13.757035 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad91d21-88ac-4569-9999-d3e0761627fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:13.757400 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad91d21-88ac-4569-9999-d3e0761627fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:13.757678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad91d21-88ac-4569-9999-d3e0761627fa admin admin] PATH_INFO: `/v3/projects/69e315bc0b0748c2831dd81c127e491a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:13.758943 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad91d21-88ac-4569-9999-d3e0761627fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=69e315bc0b0748c2831dd81c127e491a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:13.761040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad91d21-88ac-4569-9999-d3e0761627fa admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:13.901548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-cad91d21-88ac-4569-9999-d3e0761627fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69e315bc0b0748c2831dd81c127e491a', 'request_id': 'req-cad91d21-88ac-4569-9999-d3e0761627fa'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:13.902633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4e5f601b-07fc-40af-b117-2d29d44f62de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0212866a023247679c1ff1e040588365'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:13.914358 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4e5f601b-07fc-40af-b117-2d29d44f62de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0212866a023247679c1ff1e040588365'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:13.915024 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4e5f601b-07fc-40af-b117-2d29d44f62de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0212866a023247679c1ff1e040588365'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:13.915671 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4e5f601b-07fc-40af-b117-2d29d44f62de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0212866a023247679c1ff1e040588365'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:13.922551 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4e5f601b-07fc-40af-b117-2d29d44f62de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0212866a023247679c1ff1e040588365'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:13.973516 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-cad91d21-88ac-4569-9999-d3e0761627fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69e315bc0b0748c2831dd81c127e491a', 'request_id': 'req-cad91d21-88ac-4569-9999-d3e0761627fa'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:13.980420 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-cad91d21-88ac-4569-9999-d3e0761627fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69e315bc0b0748c2831dd81c127e491a', 'request_id': 'req-cad91d21-88ac-4569-9999-d3e0761627fa'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:13.990532 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-cad91d21-88ac-4569-9999-d3e0761627fa admin admin] The token cache is being invalidate because project 69e315bc0b0748c2831dd81c127e491a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:13.990824 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-cad91d21-88ac-4569-9999-d3e0761627fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:13.991460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-cad91d21-88ac-4569-9999-d3e0761627fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:13.993022 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 930/1866] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:22:13 2022] DELETE /identity/v3/projects/69e315bc0b0748c2831dd81c127e491a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:13.996801 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad91d21-88ac-4569-9999-d3e0761627fa admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:13.998899 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-cad91d21-88ac-4569-9999-d3e0761627fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:14.063569 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad91d21-88ac-4569-9999-d3e0761627fa admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:14.070097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf71c4-31ad-4f25-ad53-c1d4c02833ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:14.071902 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf71c4-31ad-4f25-ad53-c1d4c02833ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:14.072025 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 937/1867] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:22:13 2022] DELETE /identity/v3/users/0212866a023247679c1ff1e040588365 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:14.072476 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf71c4-31ad-4f25-ad53-c1d4c02833ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:14.072476 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf71c4-31ad-4f25-ad53-c1d4c02833ab admin admin] PATH_INFO: `/v3/users/bc5d6012137647169ad726b7295969cc` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:14.072837 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf71c4-31ad-4f25-ad53-c1d4c02833ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc5d6012137647169ad726b7295969cc)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:14.074960 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf71c4-31ad-4f25-ad53-c1d4c02833ab admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:14.076337 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034db504-6141-4fc8-a88b-0a7742998a8b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:14.076642 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034db504-6141-4fc8-a88b-0a7742998a8b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:14.076924 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034db504-6141-4fc8-a88b-0a7742998a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:14.094619 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-034db504-6141-4fc8-a88b-0a7742998a8b None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:14.095882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-034db504-6141-4fc8-a88b-0a7742998a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:14.155802 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 938/1868] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:14.165917 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034db504-6141-4fc8-a88b-0a7742998a8b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:14.167330 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-034db504-6141-4fc8-a88b-0a7742998a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:14.222042 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-4ddf71c4-31ad-4f25-ad53-c1d4c02833ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc5d6012137647169ad726b7295969cc'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:14.225890 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034db504-6141-4fc8-a88b-0a7742998a8b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:14.229931 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e15f4-098f-4fdf-bb1c-6021784a4c45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:14.230662 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e15f4-098f-4fdf-bb1c-6021784a4c45 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:14.230941 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e15f4-098f-4fdf-bb1c-6021784a4c45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:14.231281 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e15f4-098f-4fdf-bb1c-6021784a4c45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:14.241050 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e15f4-098f-4fdf-bb1c-6021784a4c45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:14.242490 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e15f4-098f-4fdf-bb1c-6021784a4c45 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:14.252965 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 939/1869] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:14.288335 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-4ddf71c4-31ad-4f25-ad53-c1d4c02833ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc5d6012137647169ad726b7295969cc'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:14.289414 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-4ddf71c4-31ad-4f25-ad53-c1d4c02833ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc5d6012137647169ad726b7295969cc'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:14.304484 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-4ddf71c4-31ad-4f25-ad53-c1d4c02833ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc5d6012137647169ad726b7295969cc'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:14.305335 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-4ddf71c4-31ad-4f25-ad53-c1d4c02833ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc5d6012137647169ad726b7295969cc'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:14.322543 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 931/1870] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:22:13 2022] DELETE /identity/v3/users/bc5d6012137647169ad726b7295969cc => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:14.754751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e15f4-098f-4fdf-bb1c-6021784a4c45 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:14.756516 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-dd5e15f4-098f-4fdf-bb1c-6021784a4c45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:14.770439 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e15f4-098f-4fdf-bb1c-6021784a4c45 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:14.855275 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf71c4-31ad-4f25-ad53-c1d4c02833ab admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:14.857360 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4ddf71c4-31ad-4f25-ad53-c1d4c02833ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:14.874424 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee684f09-37ff-44b6-8a7d-b786bd1ce050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:14.875296 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee684f09-37ff-44b6-8a7d-b786bd1ce050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:14.875580 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee684f09-37ff-44b6-8a7d-b786bd1ce050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:14.875949 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee684f09-37ff-44b6-8a7d-b786bd1ce050 admin admin] PATH_INFO: `/v3/projects/24d03716d6dc4108966628fa296cb937` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:14.877877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee684f09-37ff-44b6-8a7d-b786bd1ce050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d03716d6dc4108966628fa296cb937)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:14.881382 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee684f09-37ff-44b6-8a7d-b786bd1ce050 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:14.923833 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf71c4-31ad-4f25-ad53-c1d4c02833ab admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:14.928474 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a02a8-776b-450a-8803-c33ae244e667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:14.929329 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a02a8-776b-450a-8803-c33ae244e667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:14.929613 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a02a8-776b-450a-8803-c33ae244e667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:14.929887 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a02a8-776b-450a-8803-c33ae244e667 admin admin] PATH_INFO: `/v3/projects/6017e7ef523d4250af7aa71d704795a9` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:14.931097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a02a8-776b-450a-8803-c33ae244e667 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6017e7ef523d4250af7aa71d704795a9)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:14.933084 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a02a8-776b-450a-8803-c33ae244e667 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:15.007893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ee684f09-37ff-44b6-8a7d-b786bd1ce050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d03716d6dc4108966628fa296cb937', 'request_id': 'req-ee684f09-37ff-44b6-8a7d-b786bd1ce050'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:15.014485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ee684f09-37ff-44b6-8a7d-b786bd1ce050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d03716d6dc4108966628fa296cb937', 'request_id': 'req-ee684f09-37ff-44b6-8a7d-b786bd1ce050'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:15.043193 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0f6a02a8-776b-450a-8803-c33ae244e667 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6017e7ef523d4250af7aa71d704795a9', 'request_id': 'req-0f6a02a8-776b-450a-8803-c33ae244e667'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:15.070957 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ee684f09-37ff-44b6-8a7d-b786bd1ce050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d03716d6dc4108966628fa296cb937', 'request_id': 'req-ee684f09-37ff-44b6-8a7d-b786bd1ce050'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:15.082078 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ee684f09-37ff-44b6-8a7d-b786bd1ce050 admin admin] The token cache is being invalidate because project 24d03716d6dc4108966628fa296cb937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:15.082663 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ee684f09-37ff-44b6-8a7d-b786bd1ce050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:15.083058 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ee684f09-37ff-44b6-8a7d-b786bd1ce050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:15.084612 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 940/1871] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:22:14 2022] DELETE /identity/v3/projects/24d03716d6dc4108966628fa296cb937 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:15.088349 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee684f09-37ff-44b6-8a7d-b786bd1ce050 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:15.089632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ee684f09-37ff-44b6-8a7d-b786bd1ce050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:15.145228 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0f6a02a8-776b-450a-8803-c33ae244e667 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6017e7ef523d4250af7aa71d704795a9', 'request_id': 'req-0f6a02a8-776b-450a-8803-c33ae244e667'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:15.150769 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee684f09-37ff-44b6-8a7d-b786bd1ce050 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:15.151962 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0f6a02a8-776b-450a-8803-c33ae244e667 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6017e7ef523d4250af7aa71d704795a9', 'request_id': 'req-0f6a02a8-776b-450a-8803-c33ae244e667'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:15.163188 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0f6a02a8-776b-450a-8803-c33ae244e667 admin admin] The token cache is being invalidate because project 6017e7ef523d4250af7aa71d704795a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:15.163476 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0f6a02a8-776b-450a-8803-c33ae244e667 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:15.164115 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0f6a02a8-776b-450a-8803-c33ae244e667 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:15.165744 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 932/1872] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:22:14 2022] DELETE /identity/v3/projects/6017e7ef523d4250af7aa71d704795a9 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:15.170466 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e450f9-2b9e-4a95-af30-f2f528e605b8 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:15.170753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e450f9-2b9e-4a95-af30-f2f528e605b8 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:15.171036 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e450f9-2b9e-4a95-af30-f2f528e605b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:15.188435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d6e450f9-2b9e-4a95-af30-f2f528e605b8 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:15.189645 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d6e450f9-2b9e-4a95-af30-f2f528e605b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:15.219786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7059f2-4e8b-41f4-9ed8-15248fbc8077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:15.220664 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7059f2-4e8b-41f4-9ed8-15248fbc8077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:15.223922 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7059f2-4e8b-41f4-9ed8-15248fbc8077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:15.223922 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7059f2-4e8b-41f4-9ed8-15248fbc8077 admin admin] PATH_INFO: `/v3/users/a1856b2f03ab437bbda715e484605c90` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:15.223922 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7059f2-4e8b-41f4-9ed8-15248fbc8077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1856b2f03ab437bbda715e484605c90)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:15.224684 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7059f2-4e8b-41f4-9ed8-15248fbc8077 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:15.253400 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 933/1873] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:15.261516 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ab17f-20fb-477d-ac88-08c56f370e65 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:15.261757 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ab17f-20fb-477d-ac88-08c56f370e65 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:15.262118 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ab17f-20fb-477d-ac88-08c56f370e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:15.281685 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-976ab17f-20fb-477d-ac88-08c56f370e65 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:15.283022 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-976ab17f-20fb-477d-ac88-08c56f370e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:15.296411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 934/1874] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:15.298989 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ab17f-20fb-477d-ac88-08c56f370e65 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:15.308093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ab17f-20fb-477d-ac88-08c56f370e65 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:15.313929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f5fff-01b7-4d29-9735-c239b002a670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:15.314665 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f5fff-01b7-4d29-9735-c239b002a670 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:15.314952 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f5fff-01b7-4d29-9735-c239b002a670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:15.315236 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f5fff-01b7-4d29-9735-c239b002a670 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:15.315971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f5fff-01b7-4d29-9735-c239b002a670 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:22:15.316280 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f5fff-01b7-4d29-9735-c239b002a670 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:15.317928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f5fff-01b7-4d29-9735-c239b002a670 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:15.330779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 935/1875] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:22:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:22:15.334935 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f5fff-01b7-4d29-9735-c239b002a670 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:15.345299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f5fff-01b7-4d29-9735-c239b002a670 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:15.357372 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ce164-bd60-403e-ac33-5e735988f948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:15.358038 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ce164-bd60-403e-ac33-5e735988f948 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:15.358356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ce164-bd60-403e-ac33-5e735988f948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:15.358638 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ce164-bd60-403e-ac33-5e735988f948 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:15.359344 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ce164-bd60-403e-ac33-5e735988f948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:15.361334 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ce164-bd60-403e-ac33-5e735988f948 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:15.569871 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 936/1876] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:22:15 2022] POST /identity/v3/projects => generated 385 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:15.573428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ce164-bd60-403e-ac33-5e735988f948 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:15.625702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4a7059f2-4e8b-41f4-9ed8-15248fbc8077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1856b2f03ab437bbda715e484605c90'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:15.637894 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4a7059f2-4e8b-41f4-9ed8-15248fbc8077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1856b2f03ab437bbda715e484605c90'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:15.639207 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4a7059f2-4e8b-41f4-9ed8-15248fbc8077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1856b2f03ab437bbda715e484605c90'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:15.639852 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4a7059f2-4e8b-41f4-9ed8-15248fbc8077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1856b2f03ab437bbda715e484605c90'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:15.643847 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ce164-bd60-403e-ac33-5e735988f948 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:15.649777 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744afb7b-f0e6-48ed-bb7c-84f89a4709ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:15.650494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744afb7b-f0e6-48ed-bb7c-84f89a4709ca admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:15.650773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744afb7b-f0e6-48ed-bb7c-84f89a4709ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:15.651048 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744afb7b-f0e6-48ed-bb7c-84f89a4709ca admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:15.651744 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744afb7b-f0e6-48ed-bb7c-84f89a4709ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:15.654054 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744afb7b-f0e6-48ed-bb7c-84f89a4709ca admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:15.656918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4a7059f2-4e8b-41f4-9ed8-15248fbc8077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1856b2f03ab437bbda715e484605c90'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:15.781041 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 941/1877] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:22:15 2022] DELETE /identity/v3/users/a1856b2f03ab437bbda715e484605c90 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:15.805372 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 937/1878] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:22:15 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:15.813426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7059f2-4e8b-41f4-9ed8-15248fbc8077 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:15.814844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4a7059f2-4e8b-41f4-9ed8-15248fbc8077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:15.922080 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7059f2-4e8b-41f4-9ed8-15248fbc8077 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:15.927871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10afd693-a776-452f-a590-820db5d47f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:15.928547 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afd693-a776-452f-a590-820db5d47f7a admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:15.929003 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afd693-a776-452f-a590-820db5d47f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:15.929118 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afd693-a776-452f-a590-820db5d47f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:15.929892 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10afd693-a776-452f-a590-820db5d47f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:15.931660 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10afd693-a776-452f-a590-820db5d47f7a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:15.945807 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 942/1879] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:15.953226 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744afb7b-f0e6-48ed-bb7c-84f89a4709ca admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:15.964096 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744afb7b-f0e6-48ed-bb7c-84f89a4709ca admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:15.969530 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff51ae-79c2-4455-9895-8b5f7e69a282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:15.970486 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff51ae-79c2-4455-9895-8b5f7e69a282 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:15.970965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff51ae-79c2-4455-9895-8b5f7e69a282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:15.971339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff51ae-79c2-4455-9895-8b5f7e69a282 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:15.972129 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff51ae-79c2-4455-9895-8b5f7e69a282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:15.974097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff51ae-79c2-4455-9895-8b5f7e69a282 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:15.989740 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 938/1880] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:15.991622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10afd693-a776-452f-a590-820db5d47f7a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:16.009880 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10afd693-a776-452f-a590-820db5d47f7a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:16.014351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f37b78-ca0a-48c1-9874-e5f45d6f080c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:16.015445 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f37b78-ca0a-48c1-9874-e5f45d6f080c admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:16.015779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f37b78-ca0a-48c1-9874-e5f45d6f080c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:16.016255 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f37b78-ca0a-48c1-9874-e5f45d6f080c admin admin] PATH_INFO: `/v3/projects/b41de0c6d1d444258e4dd80d491bd2fb/users/63d09216a1bb49d195f6ed5f39cd2d9f/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:16.039161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f37b78-ca0a-48c1-9874-e5f45d6f080c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b41de0c6d1d444258e4dd80d491bd2fb, user_id=63d09216a1bb49d195f6ed5f39cd2d9f, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:16.042047 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f37b78-ca0a-48c1-9874-e5f45d6f080c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:16.120427 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 943/1881] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:15 2022] PUT /identity/v3/projects/b41de0c6d1d444258e4dd80d491bd2fb/users/63d09216a1bb49d195f6ed5f39cd2d9f/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:16.133899 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c36566-1ba0-4fe3-83e3-909d2bc5aabe None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:16.134852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c36566-1ba0-4fe3-83e3-909d2bc5aabe None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:16.135145 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c36566-1ba0-4fe3-83e3-909d2bc5aabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:16.167291 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-69c36566-1ba0-4fe3-83e3-909d2bc5aabe None None] MFA Rules not processed for user `63d09216a1bb49d195f6ed5f39cd2d9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:16.168588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-69c36566-1ba0-4fe3-83e3-909d2bc5aabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:16.240629 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 939/1882] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:16.245647 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f37b78-ca0a-48c1-9874-e5f45d6f080c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:16.310656 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c36566-1ba0-4fe3-83e3-909d2bc5aabe None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:16.314896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-69c36566-1ba0-4fe3-83e3-909d2bc5aabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:16.351530 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f37b78-ca0a-48c1-9874-e5f45d6f080c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:16.363013 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7f0a1-b232-4229-bc28-256e1b5f0744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:16.364200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7f0a1-b232-4229-bc28-256e1b5f0744 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:16.364782 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7f0a1-b232-4229-bc28-256e1b5f0744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:16.365288 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7f0a1-b232-4229-bc28-256e1b5f0744 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:16.366315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7f0a1-b232-4229-bc28-256e1b5f0744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:16.368702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7f0a1-b232-4229-bc28-256e1b5f0744 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:16.418947 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c36566-1ba0-4fe3-83e3-909d2bc5aabe None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:16.424737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eea7aa-e539-4178-834f-38e1707515df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:16.425579 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eea7aa-e539-4178-834f-38e1707515df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:16.425900 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eea7aa-e539-4178-834f-38e1707515df admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:16.426191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eea7aa-e539-4178-834f-38e1707515df admin admin] PATH_INFO: `/v3/projects/3df724151dd84f2d8a89405549e75ab6` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:16.427446 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eea7aa-e539-4178-834f-38e1707515df admin admin] RBAC: Authorizing `identity:delete_project(project_id=3df724151dd84f2d8a89405549e75ab6)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:16.431807 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eea7aa-e539-4178-834f-38e1707515df admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:16.507461 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 944/1883] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:22:16 2022] POST /identity/v3/projects => generated 385 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:16.512256 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7f0a1-b232-4229-bc28-256e1b5f0744 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:16.566466 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-34eea7aa-e539-4178-834f-38e1707515df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3df724151dd84f2d8a89405549e75ab6', 'request_id': 'req-34eea7aa-e539-4178-834f-38e1707515df'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:16.585024 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7f0a1-b232-4229-bc28-256e1b5f0744 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:16.625295 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-34eea7aa-e539-4178-834f-38e1707515df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3df724151dd84f2d8a89405549e75ab6', 'request_id': 'req-34eea7aa-e539-4178-834f-38e1707515df'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:16.631933 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-34eea7aa-e539-4178-834f-38e1707515df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3df724151dd84f2d8a89405549e75ab6', 'request_id': 'req-34eea7aa-e539-4178-834f-38e1707515df'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:16.640456 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfc397-7693-496d-a59b-c7322d634b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:16.643604 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfc397-7693-496d-a59b-c7322d634b56 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:16.643604 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfc397-7693-496d-a59b-c7322d634b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:16.643604 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfc397-7693-496d-a59b-c7322d634b56 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:16.643861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-34eea7aa-e539-4178-834f-38e1707515df admin admin] The token cache is being invalidate because project 3df724151dd84f2d8a89405549e75ab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:16.644038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfc397-7693-496d-a59b-c7322d634b56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:16.644132 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-34eea7aa-e539-4178-834f-38e1707515df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:16.644132 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-34eea7aa-e539-4178-834f-38e1707515df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:16.644466 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfc397-7693-496d-a59b-c7322d634b56 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:16.644627 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 940/1884] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:22:16 2022] DELETE /identity/v3/projects/3df724151dd84f2d8a89405549e75ab6 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:16.649288 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9437b-29e9-4c63-becf-2c9df17d7850 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:16.649569 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9437b-29e9-4c63-becf-2c9df17d7850 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:16.649868 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9437b-29e9-4c63-becf-2c9df17d7850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:16.668117 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-29e9437b-29e9-4c63-becf-2c9df17d7850 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:16.669845 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-29e9437b-29e9-4c63-becf-2c9df17d7850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:16.678016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 941/1885] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:16.686038 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e826af6-75ce-4d3e-945e-3a40af145622 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:16.686354 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e826af6-75ce-4d3e-945e-3a40af145622 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:16.686626 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e826af6-75ce-4d3e-945e-3a40af145622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:16.704383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5e826af6-75ce-4d3e-945e-3a40af145622 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:16.705614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5e826af6-75ce-4d3e-945e-3a40af145622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:16.714061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 942/1886] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:16.718988 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e826af6-75ce-4d3e-945e-3a40af145622 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:16.727937 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e826af6-75ce-4d3e-945e-3a40af145622 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:16.728803 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 945/1887] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:22:16 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:16.732956 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfc397-7693-496d-a59b-c7322d634b56 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:16.733355 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c6836-08f0-4c0d-aef5-d1f7e3a64a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:16.734004 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c6836-08f0-4c0d-aef5-d1f7e3a64a65 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:16.734319 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c6836-08f0-4c0d-aef5-d1f7e3a64a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:16.734594 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c6836-08f0-4c0d-aef5-d1f7e3a64a65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:16.734812 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d8cfc397-7693-496d-a59b-c7322d634b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:16.735315 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c6836-08f0-4c0d-aef5-d1f7e3a64a65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:22:16.735620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c6836-08f0-4c0d-aef5-d1f7e3a64a65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:16.737251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c6836-08f0-4c0d-aef5-d1f7e3a64a65 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:16.746150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfc397-7693-496d-a59b-c7322d634b56 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:16.753533 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 943/1888] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:22:16.753664 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1b4e9-22cb-41eb-a9b2-00fea3152bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:16.753664 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1b4e9-22cb-41eb-a9b2-00fea3152bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:16.753664 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1b4e9-22cb-41eb-a9b2-00fea3152bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:16.753664 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1b4e9-22cb-41eb-a9b2-00fea3152bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:16.753994 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1b4e9-22cb-41eb-a9b2-00fea3152bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:16.755263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c6836-08f0-4c0d-aef5-d1f7e3a64a65 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:16.755493 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1b4e9-22cb-41eb-a9b2-00fea3152bd4 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:16.764771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c6836-08f0-4c0d-aef5-d1f7e3a64a65 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:16.765674 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 946/1889] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:22:16.769233 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1b4e9-22cb-41eb-a9b2-00fea3152bd4 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:16.771826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb803bb-5908-490c-a06e-947b8eb02d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:16.772500 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb803bb-5908-490c-a06e-947b8eb02d17 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:16.772779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb803bb-5908-490c-a06e-947b8eb02d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:16.773055 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb803bb-5908-490c-a06e-947b8eb02d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:16.773737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb803bb-5908-490c-a06e-947b8eb02d17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:16.775671 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb803bb-5908-490c-a06e-947b8eb02d17 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:16.778869 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1b4e9-22cb-41eb-a9b2-00fea3152bd4 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:16.783523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59582edb-5a59-42f5-a016-42ba49295a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:16.786701 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59582edb-5a59-42f5-a016-42ba49295a8c admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:16.786701 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59582edb-5a59-42f5-a016-42ba49295a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:16.786701 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59582edb-5a59-42f5-a016-42ba49295a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:16.786701 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59582edb-5a59-42f5-a016-42ba49295a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:16.787124 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59582edb-5a59-42f5-a016-42ba49295a8c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:16.798420 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 947/1890] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:22:16.802457 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59582edb-5a59-42f5-a016-42ba49295a8c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:16.813191 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59582edb-5a59-42f5-a016-42ba49295a8c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:16.817900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db1e33-9f63-4abc-8ab6-af3ac9ab5bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:16.818882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db1e33-9f63-4abc-8ab6-af3ac9ab5bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:16.819166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db1e33-9f63-4abc-8ab6-af3ac9ab5bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:16.819438 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db1e33-9f63-4abc-8ab6-af3ac9ab5bbe admin admin] PATH_INFO: `/v3/projects/a934cf3cf8af4094aa47ca7b887d9e9d/users/d32a92f4b84d403094497a1c954e32bc/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:16.834719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db1e33-9f63-4abc-8ab6-af3ac9ab5bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a934cf3cf8af4094aa47ca7b887d9e9d, user_id=d32a92f4b84d403094497a1c954e32bc, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:16.837395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db1e33-9f63-4abc-8ab6-af3ac9ab5bbe admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:16.912553 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 944/1891] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:22:16 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:16.916448 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb803bb-5908-490c-a06e-947b8eb02d17 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:16.956542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 948/1892] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:16 2022] PUT /identity/v3/projects/a934cf3cf8af4094aa47ca7b887d9e9d/users/d32a92f4b84d403094497a1c954e32bc/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:16.958119 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3517b5-04fc-4b9d-9bec-ab91d59a881e None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:16.958440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3517b5-04fc-4b9d-9bec-ab91d59a881e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:16.958845 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3517b5-04fc-4b9d-9bec-ab91d59a881e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:16.986360 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb803bb-5908-490c-a06e-947b8eb02d17 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:17.088161 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4373e0-4de2-4712-b7e1-cbb80ae2bca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:17.088938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4373e0-4de2-4712-b7e1-cbb80ae2bca6 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:17.089211 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4373e0-4de2-4712-b7e1-cbb80ae2bca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:17.089493 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4373e0-4de2-4712-b7e1-cbb80ae2bca6 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:17.090231 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4373e0-4de2-4712-b7e1-cbb80ae2bca6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:17.093688 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4373e0-4de2-4712-b7e1-cbb80ae2bca6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:17.163207 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ad3517b5-04fc-4b9d-9bec-ab91d59a881e None None] MFA Rules not processed for user `d32a92f4b84d403094497a1c954e32bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:17.175992 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ad3517b5-04fc-4b9d-9bec-ab91d59a881e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:17.258522 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 945/1893] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:22:16 2022] POST /identity/v3/users => generated 287 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:17.258689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4373e0-4de2-4712-b7e1-cbb80ae2bca6 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:17.276005 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 949/1894] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:17.281161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3517b5-04fc-4b9d-9bec-ab91d59a881e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:17.292081 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4373e0-4de2-4712-b7e1-cbb80ae2bca6 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:17.294040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3517b5-04fc-4b9d-9bec-ab91d59a881e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:17.299741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23bda6-0dfa-415d-9b14-0a467087be00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:17.299919 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78211f2a-472e-40f1-9795-c1fd05ab9f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:17.300408 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23bda6-0dfa-415d-9b14-0a467087be00 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:17.310604 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23bda6-0dfa-415d-9b14-0a467087be00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:17.310604 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23bda6-0dfa-415d-9b14-0a467087be00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:17.311063 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78211f2a-472e-40f1-9795-c1fd05ab9f9f admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:17.311063 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78211f2a-472e-40f1-9795-c1fd05ab9f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:17.311224 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23bda6-0dfa-415d-9b14-0a467087be00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:17.311319 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78211f2a-472e-40f1-9795-c1fd05ab9f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:17.311319 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78211f2a-472e-40f1-9795-c1fd05ab9f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:17.311500 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23bda6-0dfa-415d-9b14-0a467087be00 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:17.311582 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78211f2a-472e-40f1-9795-c1fd05ab9f9f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:17.318233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 946/1895] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:22:17.321350 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78211f2a-472e-40f1-9795-c1fd05ab9f9f admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:17.331682 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78211f2a-472e-40f1-9795-c1fd05ab9f9f admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:17.336526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47784784-5ead-4fda-bbc4-af368fecc43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:17.337178 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47784784-5ead-4fda-bbc4-af368fecc43e admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:17.337479 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47784784-5ead-4fda-bbc4-af368fecc43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:17.337737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47784784-5ead-4fda-bbc4-af368fecc43e admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:17.338518 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47784784-5ead-4fda-bbc4-af368fecc43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:17.340125 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47784784-5ead-4fda-bbc4-af368fecc43e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:17.351273 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 947/1896] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:22:17.355679 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47784784-5ead-4fda-bbc4-af368fecc43e admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:17.365263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47784784-5ead-4fda-bbc4-af368fecc43e admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:17.370680 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6b327-4454-4248-b686-9eb59bfc6e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:17.371270 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6b327-4454-4248-b686-9eb59bfc6e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:17.371549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6b327-4454-4248-b686-9eb59bfc6e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:17.372105 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6b327-4454-4248-b686-9eb59bfc6e1c admin admin] PATH_INFO: `/v3/projects/48c29f01f94f4ee994cf7904c9cb0e3d/users/8ead6bf8ee0f4fa995864d331e631a15/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:17.387565 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6b327-4454-4248-b686-9eb59bfc6e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c29f01f94f4ee994cf7904c9cb0e3d, user_id=8ead6bf8ee0f4fa995864d331e631a15, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:17.390843 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6b327-4454-4248-b686-9eb59bfc6e1c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:17.406595 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 950/1897] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:22:17 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:17.410594 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23bda6-0dfa-415d-9b14-0a467087be00 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:17.477776 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23bda6-0dfa-415d-9b14-0a467087be00 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:17.488562 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 948/1898] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:17 2022] PUT /identity/v3/projects/48c29f01f94f4ee994cf7904c9cb0e3d/users/8ead6bf8ee0f4fa995864d331e631a15/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:17.491093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23488c1-e0d3-4cfa-a640-42e25f5c37b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:17.491810 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23488c1-e0d3-4cfa-a640-42e25f5c37b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:17.492096 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23488c1-e0d3-4cfa-a640-42e25f5c37b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:17.492398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23488c1-e0d3-4cfa-a640-42e25f5c37b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:17.493123 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23488c1-e0d3-4cfa-a640-42e25f5c37b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:17.495139 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23488c1-e0d3-4cfa-a640-42e25f5c37b8 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:17.499598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7186c-786e-4b68-9560-787987d3e0dc None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:17.500002 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7186c-786e-4b68-9560-787987d3e0dc None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:17.500288 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7186c-786e-4b68-9560-787987d3e0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:17.527804 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5fe7186c-786e-4b68-9560-787987d3e0dc None None] MFA Rules not processed for user `8ead6bf8ee0f4fa995864d331e631a15`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:17.530156 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5fe7186c-786e-4b68-9560-787987d3e0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:17.592830 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 949/1899] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:17.597568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7186c-786e-4b68-9560-787987d3e0dc None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:17.616266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 951/1900] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:22:17 2022] POST /identity/v3/users => generated 300 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:17.624998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23488c1-e0d3-4cfa-a640-42e25f5c37b8 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:17.636372 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23488c1-e0d3-4cfa-a640-42e25f5c37b8 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:17.662866 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7186c-786e-4b68-9560-787987d3e0dc None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:17.670352 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f5847-5f5f-49d9-8630-6be7adfb7728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:17.671032 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f5847-5f5f-49d9-8630-6be7adfb7728 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:17.671319 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f5847-5f5f-49d9-8630-6be7adfb7728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:17.671593 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f5847-5f5f-49d9-8630-6be7adfb7728 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:17.672286 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f5847-5f5f-49d9-8630-6be7adfb7728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:17.674245 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f5847-5f5f-49d9-8630-6be7adfb7728 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:17.699218 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63934d-4188-4f30-8bd1-27e47eca7950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:17.699916 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63934d-4188-4f30-8bd1-27e47eca7950 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:17.702187 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63934d-4188-4f30-8bd1-27e47eca7950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:17.702187 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63934d-4188-4f30-8bd1-27e47eca7950 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:17.702187 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63934d-4188-4f30-8bd1-27e47eca7950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:17.702929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63934d-4188-4f30-8bd1-27e47eca7950 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:17.718188 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 952/1901] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:22:17.719441 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63934d-4188-4f30-8bd1-27e47eca7950 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:17.729554 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63934d-4188-4f30-8bd1-27e47eca7950 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:17.735569 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b505df-651e-4eee-8b62-cda92aafb8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:17.736445 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b505df-651e-4eee-8b62-cda92aafb8e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:17.736721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b505df-651e-4eee-8b62-cda92aafb8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:17.737100 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b505df-651e-4eee-8b62-cda92aafb8e8 admin admin] PATH_INFO: `/v3/projects/4aa7f13f17f24f838bdf6599a4e8e473/users/e2f29ae37004445096f0fabe2b59b360/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:17.753649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b505df-651e-4eee-8b62-cda92aafb8e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa7f13f17f24f838bdf6599a4e8e473, user_id=e2f29ae37004445096f0fabe2b59b360, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:17.757139 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b505df-651e-4eee-8b62-cda92aafb8e8 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:17.769572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 950/1902] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:22:17 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:17.773380 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f5847-5f5f-49d9-8630-6be7adfb7728 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:17.831697 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f5847-5f5f-49d9-8630-6be7adfb7728 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:17.836537 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546dc80-39ee-4e65-90ee-3f33c8cadd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:17.837193 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546dc80-39ee-4e65-90ee-3f33c8cadd6d admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:17.837472 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546dc80-39ee-4e65-90ee-3f33c8cadd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:17.837746 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546dc80-39ee-4e65-90ee-3f33c8cadd6d admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:17.838498 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546dc80-39ee-4e65-90ee-3f33c8cadd6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:17.840488 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546dc80-39ee-4e65-90ee-3f33c8cadd6d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:17.870820 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 953/1903] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:17 2022] PUT /identity/v3/projects/4aa7f13f17f24f838bdf6599a4e8e473/users/e2f29ae37004445096f0fabe2b59b360/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:17.874999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b505df-651e-4eee-8b62-cda92aafb8e8 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:17.933591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b505df-651e-4eee-8b62-cda92aafb8e8 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:17.938334 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb928ce-80c7-4f3d-85f7-36df3a850abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:17.939686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb928ce-80c7-4f3d-85f7-36df3a850abf admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:17.939686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb928ce-80c7-4f3d-85f7-36df3a850abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:17.939686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb928ce-80c7-4f3d-85f7-36df3a850abf admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:17.940340 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb928ce-80c7-4f3d-85f7-36df3a850abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:17.941938 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb928ce-80c7-4f3d-85f7-36df3a850abf admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:17.948395 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 951/1904] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:22:17 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:17.949552 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546dc80-39ee-4e65-90ee-3f33c8cadd6d admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:17.955258 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 954/1905] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:17.956243 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb928ce-80c7-4f3d-85f7-36df3a850abf admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:17.960249 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546dc80-39ee-4e65-90ee-3f33c8cadd6d admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:17.965347 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30f150-c06a-4dde-8d40-eb72342e1501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:17.965655 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb928ce-80c7-4f3d-85f7-36df3a850abf admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:17.966876 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30f150-c06a-4dde-8d40-eb72342e1501 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:17.967161 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30f150-c06a-4dde-8d40-eb72342e1501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:17.967438 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30f150-c06a-4dde-8d40-eb72342e1501 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:17.968164 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30f150-c06a-4dde-8d40-eb72342e1501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:17.969788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30f150-c06a-4dde-8d40-eb72342e1501 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:17.970943 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c9f25-8d99-435c-b18e-a34dc773c5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:17.971801 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c9f25-8d99-435c-b18e-a34dc773c5f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:17.974108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c9f25-8d99-435c-b18e-a34dc773c5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:17.974108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c9f25-8d99-435c-b18e-a34dc773c5f1 admin admin] PATH_INFO: `/v3/projects/4aa7f13f17f24f838bdf6599a4e8e473/users/e2f29ae37004445096f0fabe2b59b360/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:17.974312 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c9f25-8d99-435c-b18e-a34dc773c5f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa7f13f17f24f838bdf6599a4e8e473, user_id=e2f29ae37004445096f0fabe2b59b360, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:17.976906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c9f25-8d99-435c-b18e-a34dc773c5f1 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:17.979986 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 952/1906] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:17.984022 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30f150-c06a-4dde-8d40-eb72342e1501 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:17.989612 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 955/1907] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:17 2022] PUT /identity/v3/projects/4aa7f13f17f24f838bdf6599a4e8e473/users/e2f29ae37004445096f0fabe2b59b360/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:17.998537 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30f150-c06a-4dde-8d40-eb72342e1501 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:17.999945 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce8cd9-d69f-4904-83c6-6d97176f53be None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:18.000234 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce8cd9-d69f-4904-83c6-6d97176f53be None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:18.000508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce8cd9-d69f-4904-83c6-6d97176f53be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:18.026173 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-2cce8cd9-d69f-4904-83c6-6d97176f53be None None] MFA Rules not processed for user `e2f29ae37004445096f0fabe2b59b360`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:18.027541 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2cce8cd9-d69f-4904-83c6-6d97176f53be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:18.050446 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdb759-28c2-402c-b806-2a416aa18e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:18.051338 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdb759-28c2-402c-b806-2a416aa18e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:18.051626 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdb759-28c2-402c-b806-2a416aa18e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:18.051903 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdb759-28c2-402c-b806-2a416aa18e83 admin admin] PATH_INFO: `/v3/projects/7ef4e7a94af44d5d903f76c66121f7f1/users/d3205bbad6e74f408658a5d22a20de14/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:18.065755 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdb759-28c2-402c-b806-2a416aa18e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef4e7a94af44d5d903f76c66121f7f1, user_id=d3205bbad6e74f408658a5d22a20de14, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:18.068761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdb759-28c2-402c-b806-2a416aa18e83 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:18.093976 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 956/1908] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:18.104775 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce8cd9-d69f-4904-83c6-6d97176f53be None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:18.106217 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2cce8cd9-d69f-4904-83c6-6d97176f53be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:18.122509 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 953/1909] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:17 2022] PUT /identity/v3/projects/7ef4e7a94af44d5d903f76c66121f7f1/users/d3205bbad6e74f408658a5d22a20de14/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:18.126297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdb759-28c2-402c-b806-2a416aa18e83 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:18.161448 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce8cd9-d69f-4904-83c6-6d97176f53be None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:18.186276 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdb759-28c2-402c-b806-2a416aa18e83 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:18.190891 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2eeea6-43fc-4aa3-9de3-be59fcd49e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:18.191559 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2eeea6-43fc-4aa3-9de3-be59fcd49e50 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:18.191844 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2eeea6-43fc-4aa3-9de3-be59fcd49e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:18.192123 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2eeea6-43fc-4aa3-9de3-be59fcd49e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:18.192849 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2eeea6-43fc-4aa3-9de3-be59fcd49e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:18.194496 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2eeea6-43fc-4aa3-9de3-be59fcd49e50 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:18.205295 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 954/1910] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:22:18.207862 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1288b31-2d0d-4524-b101-9d87479af129 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:18.208514 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1288b31-2d0d-4524-b101-9d87479af129 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:18.208797 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1288b31-2d0d-4524-b101-9d87479af129 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:18.209076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1288b31-2d0d-4524-b101-9d87479af129 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:18.211153 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2eeea6-43fc-4aa3-9de3-be59fcd49e50 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:18.220916 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2eeea6-43fc-4aa3-9de3-be59fcd49e50 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:18.225573 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1472d93-ccce-4027-981d-7bf660439786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:18.226481 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1472d93-ccce-4027-981d-7bf660439786 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:18.226763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1472d93-ccce-4027-981d-7bf660439786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:18.227040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1472d93-ccce-4027-981d-7bf660439786 admin admin] PATH_INFO: `/v3/projects/7ef4e7a94af44d5d903f76c66121f7f1/users/d3205bbad6e74f408658a5d22a20de14/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:18.229037 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1472d93-ccce-4027-981d-7bf660439786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef4e7a94af44d5d903f76c66121f7f1, user_id=d3205bbad6e74f408658a5d22a20de14, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:18.232397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1472d93-ccce-4027-981d-7bf660439786 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:18.242745 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 955/1911] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:18 2022] PUT /identity/v3/projects/7ef4e7a94af44d5d903f76c66121f7f1/users/d3205bbad6e74f408658a5d22a20de14/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:18.254782 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5193fbf-09eb-4d36-b8ec-97ae4e5dbabb None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:18.255077 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5193fbf-09eb-4d36-b8ec-97ae4e5dbabb None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:18.255304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5193fbf-09eb-4d36-b8ec-97ae4e5dbabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:18.281077 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1288b31-2d0d-4524-b101-9d87479af129 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:18.282652 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1288b31-2d0d-4524-b101-9d87479af129 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:18.289277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-b5193fbf-09eb-4d36-b8ec-97ae4e5dbabb None None] MFA Rules not processed for user `d3205bbad6e74f408658a5d22a20de14`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:18.289277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b5193fbf-09eb-4d36-b8ec-97ae4e5dbabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:18.295943 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 957/1912] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:22:18.397224 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 956/1913] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:18.408763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1288b31-2d0d-4524-b101-9d87479af129 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:18.417449 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1288b31-2d0d-4524-b101-9d87479af129 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:18.510200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6447757-7a04-4c64-8703-b419e76ea0d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:18.511004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6447757-7a04-4c64-8703-b419e76ea0d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:18.516249 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6447757-7a04-4c64-8703-b419e76ea0d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:18.516249 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6447757-7a04-4c64-8703-b419e76ea0d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:18.599042 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6447757-7a04-4c64-8703-b419e76ea0d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:18.600519 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6447757-7a04-4c64-8703-b419e76ea0d7 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:18.610088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 958/1914] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:20.248318 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5193fbf-09eb-4d36-b8ec-97ae4e5dbabb None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:20.257328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5193fbf-09eb-4d36-b8ec-97ae4e5dbabb None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:20.260949 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677bcfa-737d-42ea-a99d-07529e49070a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:20.261592 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677bcfa-737d-42ea-a99d-07529e49070a service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:20.261874 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677bcfa-737d-42ea-a99d-07529e49070a service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:20.262171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677bcfa-737d-42ea-a99d-07529e49070a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:20.264000 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d677bcfa-737d-42ea-a99d-07529e49070a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:20.328015 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677bcfa-737d-42ea-a99d-07529e49070a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:20.329673 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677bcfa-737d-42ea-a99d-07529e49070a service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:20.342045 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 957/1915] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:26.661336 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6447757-7a04-4c64-8703-b419e76ea0d7 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:26.666780 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b6447757-7a04-4c64-8703-b419e76ea0d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:26.778599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6447757-7a04-4c64-8703-b419e76ea0d7 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:26.784566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04978c14-186e-4c95-a374-b684e7ebd9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:26.785474 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04978c14-186e-4c95-a374-b684e7ebd9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:26.785735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04978c14-186e-4c95-a374-b684e7ebd9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:26.786229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04978c14-186e-4c95-a374-b684e7ebd9ea admin admin] PATH_INFO: `/v3/users/5744c94f9d3a4a268f3ec61851923876` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:26.787617 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04978c14-186e-4c95-a374-b684e7ebd9ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=5744c94f9d3a4a268f3ec61851923876)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:26.790548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04978c14-186e-4c95-a374-b684e7ebd9ea admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:26.986971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677bcfa-737d-42ea-a99d-07529e49070a service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:26.997790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677bcfa-737d-42ea-a99d-07529e49070a service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:27.002990 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d0c01-aa24-42dc-b027-c721887db26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:27.004000 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d0c01-aa24-42dc-b027-c721887db26a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:27.004179 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d0c01-aa24-42dc-b027-c721887db26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:27.004457 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d0c01-aa24-42dc-b027-c721887db26a admin admin] PATH_INFO: `/v3/users/8ead6bf8ee0f4fa995864d331e631a15` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:27.005647 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d0c01-aa24-42dc-b027-c721887db26a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ead6bf8ee0f4fa995864d331e631a15)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:27.007613 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d0c01-aa24-42dc-b027-c721887db26a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:27.211643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-04978c14-186e-4c95-a374-b684e7ebd9ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5744c94f9d3a4a268f3ec61851923876'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:27.227408 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-04978c14-186e-4c95-a374-b684e7ebd9ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5744c94f9d3a4a268f3ec61851923876'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:27.228183 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-04978c14-186e-4c95-a374-b684e7ebd9ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5744c94f9d3a4a268f3ec61851923876'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:27.229524 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-04978c14-186e-4c95-a374-b684e7ebd9ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5744c94f9d3a4a268f3ec61851923876'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:27.238896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-04978c14-186e-4c95-a374-b684e7ebd9ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5744c94f9d3a4a268f3ec61851923876'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:27.414095 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c66d0c01-aa24-42dc-b027-c721887db26a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ead6bf8ee0f4fa995864d331e631a15'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:27.615994 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 959/1916] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:22:26 2022] DELETE /identity/v3/users/5744c94f9d3a4a268f3ec61851923876 => generated 0 bytes in 952 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:27.621327 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8b576-b8d1-44fa-a586-5f62c3075646 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:27.621327 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8b576-b8d1-44fa-a586-5f62c3075646 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:27.621327 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8b576-b8d1-44fa-a586-5f62c3075646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:27.643907 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-0fa8b576-b8d1-44fa-a586-5f62c3075646 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:27.645262 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0fa8b576-b8d1-44fa-a586-5f62c3075646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:27.731427 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 960/1917] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:27.738983 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8b576-b8d1-44fa-a586-5f62c3075646 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:27.739333 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c66d0c01-aa24-42dc-b027-c721887db26a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ead6bf8ee0f4fa995864d331e631a15'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:27.740012 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c66d0c01-aa24-42dc-b027-c721887db26a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ead6bf8ee0f4fa995864d331e631a15'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:27.740580 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0fa8b576-b8d1-44fa-a586-5f62c3075646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:27.753781 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c66d0c01-aa24-42dc-b027-c721887db26a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ead6bf8ee0f4fa995864d331e631a15'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:27.754474 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c66d0c01-aa24-42dc-b027-c721887db26a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ead6bf8ee0f4fa995864d331e631a15'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:27.767829 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 958/1918] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:22:26 2022] DELETE /identity/v3/users/8ead6bf8ee0f4fa995864d331e631a15 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:27.772161 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34457461-4fb5-4cc4-9c6e-2c94ab04e0ae None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:27.772507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34457461-4fb5-4cc4-9c6e-2c94ab04e0ae None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:27.772785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34457461-4fb5-4cc4-9c6e-2c94ab04e0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:27.791283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-34457461-4fb5-4cc4-9c6e-2c94ab04e0ae None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:27.792757 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-34457461-4fb5-4cc4-9c6e-2c94ab04e0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:27.801899 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8b576-b8d1-44fa-a586-5f62c3075646 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:27.854519 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f87bb4-13a1-43c4-b145-d4e2ee183849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:27.856170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f87bb4-13a1-43c4-b145-d4e2ee183849 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:27.856467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f87bb4-13a1-43c4-b145-d4e2ee183849 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:27.856746 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f87bb4-13a1-43c4-b145-d4e2ee183849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:27.858944 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a9f87bb4-13a1-43c4-b145-d4e2ee183849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:27.865748 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 959/1919] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:27.875448 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f87bb4-13a1-43c4-b145-d4e2ee183849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:27.876493 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34457461-4fb5-4cc4-9c6e-2c94ab04e0ae None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:27.877559 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f87bb4-13a1-43c4-b145-d4e2ee183849 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:27.878451 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-34457461-4fb5-4cc4-9c6e-2c94ab04e0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:27.890259 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 961/1920] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:27.893381 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34457461-4fb5-4cc4-9c6e-2c94ab04e0ae None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:27.897394 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be44b7-9360-45d2-9830-d3278fe4df25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:27.898267 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be44b7-9360-45d2-9830-d3278fe4df25 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:27.898399 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be44b7-9360-45d2-9830-d3278fe4df25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:27.898675 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be44b7-9360-45d2-9830-d3278fe4df25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:27.911578 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be44b7-9360-45d2-9830-d3278fe4df25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:27.913040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be44b7-9360-45d2-9830-d3278fe4df25 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:27.925037 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 960/1921] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:22:28.755971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f87bb4-13a1-43c4-b145-d4e2ee183849 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:28.756440 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be44b7-9360-45d2-9830-d3278fe4df25 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:28.757495 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-43be44b7-9360-45d2-9830-d3278fe4df25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:28.758732 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a9f87bb4-13a1-43c4-b145-d4e2ee183849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:28.771973 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f87bb4-13a1-43c4-b145-d4e2ee183849 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:28.777205 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe510a-a167-4a87-b1d2-e6a984b280c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:28.778196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe510a-a167-4a87-b1d2-e6a984b280c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:28.778558 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe510a-a167-4a87-b1d2-e6a984b280c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:28.779325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe510a-a167-4a87-b1d2-e6a984b280c3 admin admin] PATH_INFO: `/v3/projects/90ef2027e69a462b9f55af10229142a6` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:28.781995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe510a-a167-4a87-b1d2-e6a984b280c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90ef2027e69a462b9f55af10229142a6)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:28.785300 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be44b7-9360-45d2-9830-d3278fe4df25 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:28.785833 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe510a-a167-4a87-b1d2-e6a984b280c3 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:28.789516 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc4687-fc5c-49f8-a75c-c7b6c2ce7883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:28.790418 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc4687-fc5c-49f8-a75c-c7b6c2ce7883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:28.790699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc4687-fc5c-49f8-a75c-c7b6c2ce7883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:28.790972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc4687-fc5c-49f8-a75c-c7b6c2ce7883 admin admin] PATH_INFO: `/v3/projects/48c29f01f94f4ee994cf7904c9cb0e3d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:28.792218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc4687-fc5c-49f8-a75c-c7b6c2ce7883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48c29f01f94f4ee994cf7904c9cb0e3d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:28.794777 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc4687-fc5c-49f8-a75c-c7b6c2ce7883 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:28.956746 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e2fe510a-a167-4a87-b1d2-e6a984b280c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90ef2027e69a462b9f55af10229142a6', 'request_id': 'req-e2fe510a-a167-4a87-b1d2-e6a984b280c3'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:28.963137 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e2fe510a-a167-4a87-b1d2-e6a984b280c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90ef2027e69a462b9f55af10229142a6', 'request_id': 'req-e2fe510a-a167-4a87-b1d2-e6a984b280c3'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:29.001893 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-edfc4687-fc5c-49f8-a75c-c7b6c2ce7883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48c29f01f94f4ee994cf7904c9cb0e3d', 'request_id': 'req-edfc4687-fc5c-49f8-a75c-c7b6c2ce7883'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:29.116719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e2fe510a-a167-4a87-b1d2-e6a984b280c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90ef2027e69a462b9f55af10229142a6', 'request_id': 'req-e2fe510a-a167-4a87-b1d2-e6a984b280c3'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:29.128313 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e2fe510a-a167-4a87-b1d2-e6a984b280c3 admin admin] The token cache is being invalidate because project 90ef2027e69a462b9f55af10229142a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:29.128603 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e2fe510a-a167-4a87-b1d2-e6a984b280c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:29.129375 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e2fe510a-a167-4a87-b1d2-e6a984b280c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:29.131092 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 962/1922] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:22:28 2022] DELETE /identity/v3/projects/90ef2027e69a462b9f55af10229142a6 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:29.134890 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe510a-a167-4a87-b1d2-e6a984b280c3 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:29.136281 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e2fe510a-a167-4a87-b1d2-e6a984b280c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:29.184972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-edfc4687-fc5c-49f8-a75c-c7b6c2ce7883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48c29f01f94f4ee994cf7904c9cb0e3d', 'request_id': 'req-edfc4687-fc5c-49f8-a75c-c7b6c2ce7883'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:29.192242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-edfc4687-fc5c-49f8-a75c-c7b6c2ce7883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48c29f01f94f4ee994cf7904c9cb0e3d', 'request_id': 'req-edfc4687-fc5c-49f8-a75c-c7b6c2ce7883'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:29.204679 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-edfc4687-fc5c-49f8-a75c-c7b6c2ce7883 admin admin] The token cache is being invalidate because project 48c29f01f94f4ee994cf7904c9cb0e3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:29.204971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-edfc4687-fc5c-49f8-a75c-c7b6c2ce7883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:29.205697 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-edfc4687-fc5c-49f8-a75c-c7b6c2ce7883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:29.207304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 961/1923] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:22:28 2022] DELETE /identity/v3/projects/48c29f01f94f4ee994cf7904c9cb0e3d => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:29.212142 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc4687-fc5c-49f8-a75c-c7b6c2ce7883 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:29.213592 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-edfc4687-fc5c-49f8-a75c-c7b6c2ce7883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:29.214621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe510a-a167-4a87-b1d2-e6a984b280c3 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:29.283964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc4687-fc5c-49f8-a75c-c7b6c2ce7883 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:29.288699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58509711-a8d2-4492-8a89-f5924c93d45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:29.289585 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58509711-a8d2-4492-8a89-f5924c93d45f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:29.290337 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58509711-a8d2-4492-8a89-f5924c93d45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:29.290337 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58509711-a8d2-4492-8a89-f5924c93d45f admin admin] PATH_INFO: `/v3/users/d3205bbad6e74f408658a5d22a20de14` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:29.291325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58509711-a8d2-4492-8a89-f5924c93d45f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3205bbad6e74f408658a5d22a20de14)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:29.291456 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edc79d-d3ce-4ea3-9e50-1d49ec38eb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:29.292295 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edc79d-d3ce-4ea3-9e50-1d49ec38eb86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:29.292580 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edc79d-d3ce-4ea3-9e50-1d49ec38eb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:29.292841 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edc79d-d3ce-4ea3-9e50-1d49ec38eb86 admin admin] PATH_INFO: `/v3/users/d4508876fd104267853d7d17643966e0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:29.293310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58509711-a8d2-4492-8a89-f5924c93d45f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:29.294294 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edc79d-d3ce-4ea3-9e50-1d49ec38eb86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4508876fd104267853d7d17643966e0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:29.296247 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edc79d-d3ce-4ea3-9e50-1d49ec38eb86 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:29.529176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-15edc79d-d3ce-4ea3-9e50-1d49ec38eb86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4508876fd104267853d7d17643966e0'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:29.532160 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-58509711-a8d2-4492-8a89-f5924c93d45f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3205bbad6e74f408658a5d22a20de14'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:29.546959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-15edc79d-d3ce-4ea3-9e50-1d49ec38eb86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4508876fd104267853d7d17643966e0'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:29.546959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-15edc79d-d3ce-4ea3-9e50-1d49ec38eb86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4508876fd104267853d7d17643966e0'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:29.546959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-15edc79d-d3ce-4ea3-9e50-1d49ec38eb86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4508876fd104267853d7d17643966e0'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:29.552907 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-15edc79d-d3ce-4ea3-9e50-1d49ec38eb86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4508876fd104267853d7d17643966e0'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:29.613032 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-58509711-a8d2-4492-8a89-f5924c93d45f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3205bbad6e74f408658a5d22a20de14'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:29.613747 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-58509711-a8d2-4492-8a89-f5924c93d45f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3205bbad6e74f408658a5d22a20de14'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:29.627476 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-58509711-a8d2-4492-8a89-f5924c93d45f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3205bbad6e74f408658a5d22a20de14'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:29.628560 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-58509711-a8d2-4492-8a89-f5924c93d45f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3205bbad6e74f408658a5d22a20de14'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:29.641753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 962/1924] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:22:29 2022] DELETE /identity/v3/users/d3205bbad6e74f408658a5d22a20de14 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:29.660512 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 963/1925] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:22:29 2022] DELETE /identity/v3/users/d4508876fd104267853d7d17643966e0 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:29.698577 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58509711-a8d2-4492-8a89-f5924c93d45f admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:29.700918 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-58509711-a8d2-4492-8a89-f5924c93d45f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:29.786658 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58509711-a8d2-4492-8a89-f5924c93d45f admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:29.864897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ae457-cc56-4c73-8066-4eae84bce49a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:29.866276 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ae457-cc56-4c73-8066-4eae84bce49a service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:29.867395 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ae457-cc56-4c73-8066-4eae84bce49a service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:29.868030 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ae457-cc56-4c73-8066-4eae84bce49a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:29.870937 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-fe1ae457-cc56-4c73-8066-4eae84bce49a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:29.975395 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ae457-cc56-4c73-8066-4eae84bce49a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:29.990933 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ae457-cc56-4c73-8066-4eae84bce49a service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:30.013042 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 963/1926] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:30.495993 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edc79d-d3ce-4ea3-9e50-1d49ec38eb86 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:30.499018 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-15edc79d-d3ce-4ea3-9e50-1d49ec38eb86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:30.590317 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edc79d-d3ce-4ea3-9e50-1d49ec38eb86 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:30.594904 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32808e23-c488-4c22-b599-0d1334ac5fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:30.595817 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32808e23-c488-4c22-b599-0d1334ac5fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:30.597641 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32808e23-c488-4c22-b599-0d1334ac5fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:30.597641 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32808e23-c488-4c22-b599-0d1334ac5fd2 admin admin] PATH_INFO: `/v3/projects/1418654d879c45839c5573d103a44ee5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:30.597641 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32808e23-c488-4c22-b599-0d1334ac5fd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1418654d879c45839c5573d103a44ee5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:30.599499 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32808e23-c488-4c22-b599-0d1334ac5fd2 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:30.626750 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ae457-cc56-4c73-8066-4eae84bce49a service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:30.628308 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-fe1ae457-cc56-4c73-8066-4eae84bce49a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:30.643498 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ae457-cc56-4c73-8066-4eae84bce49a service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:30.648467 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0a164-d4c4-4841-a3b8-89e692dbce2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:30.659737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0a164-d4c4-4841-a3b8-89e692dbce2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:30.659737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0a164-d4c4-4841-a3b8-89e692dbce2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:30.659737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0a164-d4c4-4841-a3b8-89e692dbce2b admin admin] PATH_INFO: `/v3/projects/7ef4e7a94af44d5d903f76c66121f7f1` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:30.659737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0a164-d4c4-4841-a3b8-89e692dbce2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ef4e7a94af44d5d903f76c66121f7f1)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:30.659737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0a164-d4c4-4841-a3b8-89e692dbce2b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:30.751818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-32808e23-c488-4c22-b599-0d1334ac5fd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1418654d879c45839c5573d103a44ee5', 'request_id': 'req-32808e23-c488-4c22-b599-0d1334ac5fd2'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:30.758187 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-32808e23-c488-4c22-b599-0d1334ac5fd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1418654d879c45839c5573d103a44ee5', 'request_id': 'req-32808e23-c488-4c22-b599-0d1334ac5fd2'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:30.801911 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b2c0a164-d4c4-4841-a3b8-89e692dbce2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ef4e7a94af44d5d903f76c66121f7f1', 'request_id': 'req-b2c0a164-d4c4-4841-a3b8-89e692dbce2b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:31.048443 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-32808e23-c488-4c22-b599-0d1334ac5fd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1418654d879c45839c5573d103a44ee5', 'request_id': 'req-32808e23-c488-4c22-b599-0d1334ac5fd2'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:31.059869 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-32808e23-c488-4c22-b599-0d1334ac5fd2 admin admin] The token cache is being invalidate because project 1418654d879c45839c5573d103a44ee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:31.060150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-32808e23-c488-4c22-b599-0d1334ac5fd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:31.060780 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-32808e23-c488-4c22-b599-0d1334ac5fd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:31.062367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 964/1927] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:22:30 2022] DELETE /identity/v3/projects/1418654d879c45839c5573d103a44ee5 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:31.077756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83127742-f0f6-4341-a83f-b6c1f4652bd8 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:31.077756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83127742-f0f6-4341-a83f-b6c1f4652bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:31.077756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83127742-f0f6-4341-a83f-b6c1f4652bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:31.087743 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-83127742-f0f6-4341-a83f-b6c1f4652bd8 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:31.088972 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-83127742-f0f6-4341-a83f-b6c1f4652bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:31.162548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 965/1928] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:31.170976 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c5245-e00e-4c7d-aa4d-4a03dd45ced2 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:31.171488 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c5245-e00e-4c7d-aa4d-4a03dd45ced2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:31.172040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c5245-e00e-4c7d-aa4d-4a03dd45ced2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:31.192983 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-841c5245-e00e-4c7d-aa4d-4a03dd45ced2 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:31.198395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-841c5245-e00e-4c7d-aa4d-4a03dd45ced2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:31.206909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 966/1929] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:31.208485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c5245-e00e-4c7d-aa4d-4a03dd45ced2 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:31.218570 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c5245-e00e-4c7d-aa4d-4a03dd45ced2 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:31.225119 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637fa23-2320-4fbc-b597-0245539c25ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:31.225849 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637fa23-2320-4fbc-b597-0245539c25ac admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:31.226264 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637fa23-2320-4fbc-b597-0245539c25ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:31.226787 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637fa23-2320-4fbc-b597-0245539c25ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:31.227688 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637fa23-2320-4fbc-b597-0245539c25ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:22:31.228092 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637fa23-2320-4fbc-b597-0245539c25ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:31.229790 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637fa23-2320-4fbc-b597-0245539c25ac admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:31.249674 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 967/1930] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:22:31.253110 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637fa23-2320-4fbc-b597-0245539c25ac admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:31.263564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637fa23-2320-4fbc-b597-0245539c25ac admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:31.273229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08066f61-e694-4434-8551-8aaa77be9ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:31.274822 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08066f61-e694-4434-8551-8aaa77be9ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:31.275112 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08066f61-e694-4434-8551-8aaa77be9ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:31.276042 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08066f61-e694-4434-8551-8aaa77be9ec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:31.276752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08066f61-e694-4434-8551-8aaa77be9ec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:31.280811 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08066f61-e694-4434-8551-8aaa77be9ec5 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:31.288398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b2c0a164-d4c4-4841-a3b8-89e692dbce2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ef4e7a94af44d5d903f76c66121f7f1', 'request_id': 'req-b2c0a164-d4c4-4841-a3b8-89e692dbce2b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:31.299876 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b2c0a164-d4c4-4841-a3b8-89e692dbce2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ef4e7a94af44d5d903f76c66121f7f1', 'request_id': 'req-b2c0a164-d4c4-4841-a3b8-89e692dbce2b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:31.323791 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b2c0a164-d4c4-4841-a3b8-89e692dbce2b admin admin] The token cache is being invalidate because project 7ef4e7a94af44d5d903f76c66121f7f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:31.324959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b2c0a164-d4c4-4841-a3b8-89e692dbce2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:31.326308 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b2c0a164-d4c4-4841-a3b8-89e692dbce2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:31.342049 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 964/1931] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:22:30 2022] DELETE /identity/v3/projects/7ef4e7a94af44d5d903f76c66121f7f1 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:31.343877 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dc972-7979-4d90-9b9e-2ada9f6a5934 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:31.345811 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dc972-7979-4d90-9b9e-2ada9f6a5934 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:31.346735 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dc972-7979-4d90-9b9e-2ada9f6a5934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:31.391378 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-040dc972-7979-4d90-9b9e-2ada9f6a5934 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:31.392670 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-040dc972-7979-4d90-9b9e-2ada9f6a5934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:31.409373 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 965/1932] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:31.411386 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec60e2-8f47-4e9a-ac98-4bc9e655d560 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:31.411689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec60e2-8f47-4e9a-ac98-4bc9e655d560 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:31.411968 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec60e2-8f47-4e9a-ac98-4bc9e655d560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:31.437056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-24ec60e2-8f47-4e9a-ac98-4bc9e655d560 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:31.437056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-24ec60e2-8f47-4e9a-ac98-4bc9e655d560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:31.446468 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 966/1933] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:31.447576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec60e2-8f47-4e9a-ac98-4bc9e655d560 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:31.458935 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec60e2-8f47-4e9a-ac98-4bc9e655d560 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:31.463974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09782de-1ac1-48d9-8178-b1948ff80d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:31.464652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09782de-1ac1-48d9-8178-b1948ff80d50 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:31.464934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09782de-1ac1-48d9-8178-b1948ff80d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:31.465236 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09782de-1ac1-48d9-8178-b1948ff80d50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:31.466545 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09782de-1ac1-48d9-8178-b1948ff80d50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:22:31.466847 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09782de-1ac1-48d9-8178-b1948ff80d50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:31.468498 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09782de-1ac1-48d9-8178-b1948ff80d50 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:31.485652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 967/1934] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:22:31.489910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09782de-1ac1-48d9-8178-b1948ff80d50 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:31.504858 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09782de-1ac1-48d9-8178-b1948ff80d50 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:31.507706 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 968/1935] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:22:31 2022] POST /identity/v3/projects => generated 381 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:31.509163 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08066f61-e694-4434-8551-8aaa77be9ec5 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:31.511048 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-08066f61-e694-4434-8551-8aaa77be9ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:31.594977 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f641b-db0d-4b87-8622-2d2251ad8ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:31.595790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f641b-db0d-4b87-8622-2d2251ad8ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:31.596201 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f641b-db0d-4b87-8622-2d2251ad8ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:31.596579 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f641b-db0d-4b87-8622-2d2251ad8ae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:31.597388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f641b-db0d-4b87-8622-2d2251ad8ae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:31.600162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f641b-db0d-4b87-8622-2d2251ad8ae2 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:31.617843 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08066f61-e694-4434-8551-8aaa77be9ec5 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:31.628754 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44328a-d3fb-4358-a2c6-2810326bb157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:31.629633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44328a-d3fb-4358-a2c6-2810326bb157 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:31.630016 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44328a-d3fb-4358-a2c6-2810326bb157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:31.630417 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44328a-d3fb-4358-a2c6-2810326bb157 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:31.631321 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44328a-d3fb-4358-a2c6-2810326bb157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:31.633880 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44328a-d3fb-4358-a2c6-2810326bb157 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:31.705182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 968/1936] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:22:31 2022] POST /identity/v3/projects => generated 377 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:31.709997 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f641b-db0d-4b87-8622-2d2251ad8ae2 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:31.729929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 969/1937] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:22:31 2022] POST /identity/v3/users => generated 291 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:31.747445 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44328a-d3fb-4358-a2c6-2810326bb157 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:31.771309 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44328a-d3fb-4358-a2c6-2810326bb157 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:31.824158 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f641b-db0d-4b87-8622-2d2251ad8ae2 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:31.838241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b98d5e-2e82-411c-9b2d-294fa5c25789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:31.841350 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b98d5e-2e82-411c-9b2d-294fa5c25789 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:31.841753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b98d5e-2e82-411c-9b2d-294fa5c25789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:31.842920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b98d5e-2e82-411c-9b2d-294fa5c25789 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:31.844407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b98d5e-2e82-411c-9b2d-294fa5c25789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:31.850697 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b98d5e-2e82-411c-9b2d-294fa5c25789 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:31.872003 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41b8dd-4148-4324-bb1b-931580ee4d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:31.872847 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41b8dd-4148-4324-bb1b-931580ee4d21 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:31.873237 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41b8dd-4148-4324-bb1b-931580ee4d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:31.873705 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41b8dd-4148-4324-bb1b-931580ee4d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:31.874515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41b8dd-4148-4324-bb1b-931580ee4d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:31.876492 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41b8dd-4148-4324-bb1b-931580ee4d21 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:31.897951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 970/1938] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:31.902483 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41b8dd-4148-4324-bb1b-931580ee4d21 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:31.915888 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41b8dd-4148-4324-bb1b-931580ee4d21 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:31.923143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58ff68-fd89-4f21-aeb1-0dbf744d3071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:31.924120 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58ff68-fd89-4f21-aeb1-0dbf744d3071 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:31.929099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58ff68-fd89-4f21-aeb1-0dbf744d3071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:31.929099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58ff68-fd89-4f21-aeb1-0dbf744d3071 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:31.929099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58ff68-fd89-4f21-aeb1-0dbf744d3071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:31.929099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58ff68-fd89-4f21-aeb1-0dbf744d3071 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:31.941336 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 971/1939] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:22:31.946371 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58ff68-fd89-4f21-aeb1-0dbf744d3071 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:31.962306 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58ff68-fd89-4f21-aeb1-0dbf744d3071 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:31.971037 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0dffcb-cfc2-47e2-90a6-85c0c8eb57ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:31.973125 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0dffcb-cfc2-47e2-90a6-85c0c8eb57ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:31.973877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0dffcb-cfc2-47e2-90a6-85c0c8eb57ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:31.974347 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0dffcb-cfc2-47e2-90a6-85c0c8eb57ce admin admin] PATH_INFO: `/v3/projects/52286e44907f43668536148181d75201/users/1f9ae86ea3364f39ba295eac1359eea7/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:31.989089 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 969/1940] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:22:31 2022] POST /identity/v3/users => generated 289 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:31.992875 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b98d5e-2e82-411c-9b2d-294fa5c25789 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:31.997442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0dffcb-cfc2-47e2-90a6-85c0c8eb57ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=52286e44907f43668536148181d75201, user_id=1f9ae86ea3364f39ba295eac1359eea7, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:32.004953 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b98d5e-2e82-411c-9b2d-294fa5c25789 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:32.006016 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0dffcb-cfc2-47e2-90a6-85c0c8eb57ce admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:32.011601 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c9254-208b-4cdd-afd5-edcae17d53e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:32.012596 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c9254-208b-4cdd-afd5-edcae17d53e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:32.013063 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c9254-208b-4cdd-afd5-edcae17d53e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:32.015427 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c9254-208b-4cdd-afd5-edcae17d53e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:32.015427 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c9254-208b-4cdd-afd5-edcae17d53e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:32.016844 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c9254-208b-4cdd-afd5-edcae17d53e0 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:32.028881 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 970/1941] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:22:32.034400 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c9254-208b-4cdd-afd5-edcae17d53e0 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:32.049774 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c9254-208b-4cdd-afd5-edcae17d53e0 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:32.054975 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff18f7a-65d4-4128-bbf5-d0b9280b7c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:32.055855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff18f7a-65d4-4128-bbf5-d0b9280b7c7f admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:32.056273 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff18f7a-65d4-4128-bbf5-d0b9280b7c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:32.056691 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff18f7a-65d4-4128-bbf5-d0b9280b7c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:32.057558 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff18f7a-65d4-4128-bbf5-d0b9280b7c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:32.059388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff18f7a-65d4-4128-bbf5-d0b9280b7c7f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:32.077249 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 971/1942] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:32.078681 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff18f7a-65d4-4128-bbf5-d0b9280b7c7f admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:32.090920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff18f7a-65d4-4128-bbf5-d0b9280b7c7f admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:32.097429 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4c68d-b4f6-4c0c-b430-9fa115b727ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:32.098509 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4c68d-b4f6-4c0c-b430-9fa115b727ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:32.098882 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4c68d-b4f6-4c0c-b430-9fa115b727ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:32.099233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4c68d-b4f6-4c0c-b430-9fa115b727ae admin admin] PATH_INFO: `/v3/projects/8af328b8403e46cdbb110f019219db2b/users/f58d23280fbb4e569875c576f6c0286f/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:32.121104 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4c68d-b4f6-4c0c-b430-9fa115b727ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=8af328b8403e46cdbb110f019219db2b, user_id=f58d23280fbb4e569875c576f6c0286f, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:32.130086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4c68d-b4f6-4c0c-b430-9fa115b727ae admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:32.163202 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 972/1943] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:31 2022] PUT /identity/v3/projects/52286e44907f43668536148181d75201/users/1f9ae86ea3364f39ba295eac1359eea7/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:32.174913 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4fdcd-dcc7-46d7-9eda-22329af91e35 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:32.175439 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4fdcd-dcc7-46d7-9eda-22329af91e35 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:32.176124 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4fdcd-dcc7-46d7-9eda-22329af91e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:32.213515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a9a4fdcd-dcc7-46d7-9eda-22329af91e35 None None] MFA Rules not processed for user `1f9ae86ea3364f39ba295eac1359eea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:32.220897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 972/1944] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:32 2022] PUT /identity/v3/projects/8af328b8403e46cdbb110f019219db2b/users/f58d23280fbb4e569875c576f6c0286f/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:32.222895 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a9a4fdcd-dcc7-46d7-9eda-22329af91e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:32.237613 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf16c1-9716-4002-8148-516ab3fad4f8 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:32.238017 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf16c1-9716-4002-8148-516ab3fad4f8 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:32.238340 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf16c1-9716-4002-8148-516ab3fad4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:32.288868 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-86cf16c1-9716-4002-8148-516ab3fad4f8 None None] MFA Rules not processed for user `f58d23280fbb4e569875c576f6c0286f`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:32.292696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-86cf16c1-9716-4002-8148-516ab3fad4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:32.334201 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 973/1945] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:32.336639 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4fdcd-dcc7-46d7-9eda-22329af91e35 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:32.390311 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 973/1946] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:32.395128 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf16c1-9716-4002-8148-516ab3fad4f8 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:32.427417 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4fdcd-dcc7-46d7-9eda-22329af91e35 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:32.434040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc0781-b241-44a9-b967-4df5bf26757e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:32.434505 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc0781-b241-44a9-b967-4df5bf26757e admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:32.434784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc0781-b241-44a9-b967-4df5bf26757e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:32.435238 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc0781-b241-44a9-b967-4df5bf26757e admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:32.443759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc0781-b241-44a9-b967-4df5bf26757e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:32.445926 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc0781-b241-44a9-b967-4df5bf26757e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:32.497606 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf16c1-9716-4002-8148-516ab3fad4f8 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:32.505277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb0c17-23a0-4125-9fee-d5b1d6376449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:32.505965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb0c17-23a0-4125-9fee-d5b1d6376449 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:32.506481 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb0c17-23a0-4125-9fee-d5b1d6376449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:32.506965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb0c17-23a0-4125-9fee-d5b1d6376449 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:32.507532 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb0c17-23a0-4125-9fee-d5b1d6376449 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:32.510522 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb0c17-23a0-4125-9fee-d5b1d6376449 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:32.614796 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 974/1947] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:22:32 2022] POST /identity/v3/projects => generated 379 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:32.618583 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc0781-b241-44a9-b967-4df5bf26757e admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:32.673474 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 974/1948] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:22:32 2022] POST /identity/v3/projects => generated 377 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:32.676087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb0c17-23a0-4125-9fee-d5b1d6376449 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:32.708611 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc0781-b241-44a9-b967-4df5bf26757e admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:32.751160 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb0c17-23a0-4125-9fee-d5b1d6376449 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:32.757310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1577b8-4a96-4f43-9ea5-b65be5821bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:32.757995 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1577b8-4a96-4f43-9ea5-b65be5821bad admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:32.758317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1577b8-4a96-4f43-9ea5-b65be5821bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:32.758595 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1577b8-4a96-4f43-9ea5-b65be5821bad admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:32.759296 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1577b8-4a96-4f43-9ea5-b65be5821bad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:32.761330 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1577b8-4a96-4f43-9ea5-b65be5821bad admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:32.768786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3ea99-40b2-4af5-bef1-253989bee15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:32.769464 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3ea99-40b2-4af5-bef1-253989bee15f admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:32.769753 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3ea99-40b2-4af5-bef1-253989bee15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:32.770021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3ea99-40b2-4af5-bef1-253989bee15f admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:32.770749 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d3ea99-40b2-4af5-bef1-253989bee15f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:32.772667 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d3ea99-40b2-4af5-bef1-253989bee15f admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:32.848412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 975/1949] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:22:32 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:32.852318 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1577b8-4a96-4f43-9ea5-b65be5821bad admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:32.862872 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1577b8-4a96-4f43-9ea5-b65be5821bad admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:32.867552 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327ed5d-a536-4139-8c38-f22b33ebd640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:32.868216 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327ed5d-a536-4139-8c38-f22b33ebd640 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:32.868495 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327ed5d-a536-4139-8c38-f22b33ebd640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:32.868769 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327ed5d-a536-4139-8c38-f22b33ebd640 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:32.869538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327ed5d-a536-4139-8c38-f22b33ebd640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:32.871163 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327ed5d-a536-4139-8c38-f22b33ebd640 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:32.881853 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 976/1950] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:22:32.885632 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327ed5d-a536-4139-8c38-f22b33ebd640 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:32.888679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 975/1951] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:22:32 2022] POST /identity/v3/users => generated 296 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:32.903719 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327ed5d-a536-4139-8c38-f22b33ebd640 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:32.903719 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85476fd-ef45-49a6-8667-ea2cef3dbe59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:32.903719 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85476fd-ef45-49a6-8667-ea2cef3dbe59 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:32.903719 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85476fd-ef45-49a6-8667-ea2cef3dbe59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:32.904058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85476fd-ef45-49a6-8667-ea2cef3dbe59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:32.904058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85476fd-ef45-49a6-8667-ea2cef3dbe59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:32.904561 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3ea99-40b2-4af5-bef1-253989bee15f admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:32.905257 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85476fd-ef45-49a6-8667-ea2cef3dbe59 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:32.915128 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3ea99-40b2-4af5-bef1-253989bee15f admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:32.919849 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 977/1952] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:22:32.923637 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85476fd-ef45-49a6-8667-ea2cef3dbe59 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:32.923763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb311890-f578-4b50-89a7-afaf923f3efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:32.924357 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb311890-f578-4b50-89a7-afaf923f3efd admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:32.924665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb311890-f578-4b50-89a7-afaf923f3efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:32.924974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb311890-f578-4b50-89a7-afaf923f3efd admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:32.925798 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb311890-f578-4b50-89a7-afaf923f3efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:32.927493 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb311890-f578-4b50-89a7-afaf923f3efd admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:32.930057 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85476fd-ef45-49a6-8667-ea2cef3dbe59 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:32.935351 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bc1c0-8ba2-4d73-9d0d-6b789a731505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:32.936216 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bc1c0-8ba2-4d73-9d0d-6b789a731505 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:32.936489 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bc1c0-8ba2-4d73-9d0d-6b789a731505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:32.936757 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bc1c0-8ba2-4d73-9d0d-6b789a731505 admin admin] PATH_INFO: `/v3/projects/4672c7dbc1884c819ab8bc3aaeb17829/users/1b41c91feda140dbafbad3cd0e5f5c5d/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:32.941299 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 976/1953] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:32.942329 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb311890-f578-4b50-89a7-afaf923f3efd admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:32.954529 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993bc1c0-8ba2-4d73-9d0d-6b789a731505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4672c7dbc1884c819ab8bc3aaeb17829, user_id=1b41c91feda140dbafbad3cd0e5f5c5d, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:32.956500 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb311890-f578-4b50-89a7-afaf923f3efd admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:32.957918 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993bc1c0-8ba2-4d73-9d0d-6b789a731505 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:32.961230 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a45ce-3542-4db7-9c7c-e1fc859ac4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:32.962107 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a45ce-3542-4db7-9c7c-e1fc859ac4da admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:32.962447 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a45ce-3542-4db7-9c7c-e1fc859ac4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:32.962712 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a45ce-3542-4db7-9c7c-e1fc859ac4da admin admin] PATH_INFO: `/v3/projects/edd1e72118e24b6d800e21705df04076/users/7d863c3ee4a44dfea9ebc6176c24b049/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:32.981621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a45ce-3542-4db7-9c7c-e1fc859ac4da admin admin] RBAC: Authorizing `identity:create_grant(project_id=edd1e72118e24b6d800e21705df04076, user_id=7d863c3ee4a44dfea9ebc6176c24b049, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:32.984710 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a45ce-3542-4db7-9c7c-e1fc859ac4da admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:33.060251 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 977/1954] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:32 2022] PUT /identity/v3/projects/edd1e72118e24b6d800e21705df04076/users/7d863c3ee4a44dfea9ebc6176c24b049/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:33.060816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 978/1955] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:32 2022] PUT /identity/v3/projects/4672c7dbc1884c819ab8bc3aaeb17829/users/1b41c91feda140dbafbad3cd0e5f5c5d/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:33.063741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a45ce-3542-4db7-9c7c-e1fc859ac4da admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:33.071718 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1fa30-a909-4a4e-993b-571e7e3b6a47 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:33.072007 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1fa30-a909-4a4e-993b-571e7e3b6a47 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:33.072283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1fa30-a909-4a4e-993b-571e7e3b6a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:33.103630 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-28e1fa30-a909-4a4e-993b-571e7e3b6a47 None None] MFA Rules not processed for user `1b41c91feda140dbafbad3cd0e5f5c5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:33.104858 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-28e1fa30-a909-4a4e-993b-571e7e3b6a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:33.140743 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a45ce-3542-4db7-9c7c-e1fc859ac4da admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:33.146104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a503b-4127-43b8-8a86-40e64b0da1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:33.147519 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a503b-4127-43b8-8a86-40e64b0da1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:33.150454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a503b-4127-43b8-8a86-40e64b0da1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:33.151239 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a503b-4127-43b8-8a86-40e64b0da1c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:33.152721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a503b-4127-43b8-8a86-40e64b0da1c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:33.154488 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a503b-4127-43b8-8a86-40e64b0da1c0 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:33.164993 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 978/1956] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:22:33.171635 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a503b-4127-43b8-8a86-40e64b0da1c0 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:33.184715 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a503b-4127-43b8-8a86-40e64b0da1c0 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:33.189997 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c7e63-6f85-4a91-bbb3-a32599654f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:33.191775 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c7e63-6f85-4a91-bbb3-a32599654f1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:33.192109 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c7e63-6f85-4a91-bbb3-a32599654f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:33.192381 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c7e63-6f85-4a91-bbb3-a32599654f1e admin admin] PATH_INFO: `/v3/projects/edd1e72118e24b6d800e21705df04076/users/7d863c3ee4a44dfea9ebc6176c24b049/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:33.194519 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c7e63-6f85-4a91-bbb3-a32599654f1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=edd1e72118e24b6d800e21705df04076, user_id=7d863c3ee4a44dfea9ebc6176c24b049, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:33.197129 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c7e63-6f85-4a91-bbb3-a32599654f1e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:33.203677 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 979/1957] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:33.208784 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1fa30-a909-4a4e-993b-571e7e3b6a47 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:33.210860 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 979/1958] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:33 2022] PUT /identity/v3/projects/edd1e72118e24b6d800e21705df04076/users/7d863c3ee4a44dfea9ebc6176c24b049/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:33.219237 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1fa30-a909-4a4e-993b-571e7e3b6a47 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:33.233225 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7b4ac-a046-44d4-bfd9-e37b660eacf0 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:33.233543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7b4ac-a046-44d4-bfd9-e37b660eacf0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:33.233823 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7b4ac-a046-44d4-bfd9-e37b660eacf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:33.262636 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-22e7b4ac-a046-44d4-bfd9-e37b660eacf0 None None] MFA Rules not processed for user `7d863c3ee4a44dfea9ebc6176c24b049`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:33.263852 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-22e7b4ac-a046-44d4-bfd9-e37b660eacf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:33.278785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669db606-7f87-4b29-812f-9ea0cf9cec23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:33.279477 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669db606-7f87-4b29-812f-9ea0cf9cec23 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:33.279764 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669db606-7f87-4b29-812f-9ea0cf9cec23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:33.280041 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669db606-7f87-4b29-812f-9ea0cf9cec23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:33.280788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669db606-7f87-4b29-812f-9ea0cf9cec23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:33.282875 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669db606-7f87-4b29-812f-9ea0cf9cec23 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:33.330539 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 980/1959] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:33.415028 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 980/1960] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:22:33 2022] POST /identity/v3/projects => generated 373 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:33.419818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7b4ac-a046-44d4-bfd9-e37b660eacf0 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:33.434036 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7b4ac-a046-44d4-bfd9-e37b660eacf0 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:33.507065 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766d602-fcae-484a-9453-1008ba711b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:33.507747 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766d602-fcae-484a-9453-1008ba711b26 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:33.508035 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766d602-fcae-484a-9453-1008ba711b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:33.508316 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766d602-fcae-484a-9453-1008ba711b26 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:33.509057 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766d602-fcae-484a-9453-1008ba711b26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:33.511119 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766d602-fcae-484a-9453-1008ba711b26 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:33.627109 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 981/1961] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:22:33 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:33.631192 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669db606-7f87-4b29-812f-9ea0cf9cec23 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:33.642296 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669db606-7f87-4b29-812f-9ea0cf9cec23 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:33.646877 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a618441-c42b-4961-afc8-fc63697a5e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:33.647535 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a618441-c42b-4961-afc8-fc63697a5e60 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:33.647818 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a618441-c42b-4961-afc8-fc63697a5e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:33.648095 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a618441-c42b-4961-afc8-fc63697a5e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:33.648817 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a618441-c42b-4961-afc8-fc63697a5e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:33.650450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a618441-c42b-4961-afc8-fc63697a5e60 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:33.660824 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 981/1962] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:33.665302 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766d602-fcae-484a-9453-1008ba711b26 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:33.675651 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766d602-fcae-484a-9453-1008ba711b26 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:33.680348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1789b1d-f417-476a-b844-7c2abbe54954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:33.681220 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1789b1d-f417-476a-b844-7c2abbe54954 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:33.681502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1789b1d-f417-476a-b844-7c2abbe54954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:33.681777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1789b1d-f417-476a-b844-7c2abbe54954 admin admin] PATH_INFO: `/v3/projects/8a19102deab342be92db3c461e8c6543/users/60f6c32dfc474f0ea62f47960ca5e5bb/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:33.696834 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1789b1d-f417-476a-b844-7c2abbe54954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a19102deab342be92db3c461e8c6543, user_id=60f6c32dfc474f0ea62f47960ca5e5bb, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:33.699634 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1789b1d-f417-476a-b844-7c2abbe54954 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:33.785506 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 982/1963] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:33 2022] PUT /identity/v3/projects/8a19102deab342be92db3c461e8c6543/users/60f6c32dfc474f0ea62f47960ca5e5bb/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:33.789819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a618441-c42b-4961-afc8-fc63697a5e60 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:33.799878 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a618441-c42b-4961-afc8-fc63697a5e60 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:33.855017 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f09f9-b4ab-43ea-b3c9-029df97c9c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:33.856214 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f09f9-b4ab-43ea-b3c9-029df97c9c53 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:33.856477 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f09f9-b4ab-43ea-b3c9-029df97c9c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:33.856748 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f09f9-b4ab-43ea-b3c9-029df97c9c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:33.857464 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f09f9-b4ab-43ea-b3c9-029df97c9c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:33.859083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f09f9-b4ab-43ea-b3c9-029df97c9c53 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:33.869159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 982/1964] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:33.874499 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1789b1d-f417-476a-b844-7c2abbe54954 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:33.884957 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1789b1d-f417-476a-b844-7c2abbe54954 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:33.889623 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62895c0f-b291-4514-9d19-4ac5df12b67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:33.890517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62895c0f-b291-4514-9d19-4ac5df12b67a admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:33.890793 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62895c0f-b291-4514-9d19-4ac5df12b67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:33.891063 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62895c0f-b291-4514-9d19-4ac5df12b67a admin admin] PATH_INFO: `/v3/projects/8a19102deab342be92db3c461e8c6543/users/60f6c32dfc474f0ea62f47960ca5e5bb/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:33.893022 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62895c0f-b291-4514-9d19-4ac5df12b67a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a19102deab342be92db3c461e8c6543, user_id=60f6c32dfc474f0ea62f47960ca5e5bb, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:33.895685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62895c0f-b291-4514-9d19-4ac5df12b67a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:33.906089 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 983/1965] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:33 2022] PUT /identity/v3/projects/8a19102deab342be92db3c461e8c6543/users/60f6c32dfc474f0ea62f47960ca5e5bb/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:33.916011 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018e154-7ad8-4019-abc0-be9dd5aa4136 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:33.916301 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018e154-7ad8-4019-abc0-be9dd5aa4136 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:33.916577 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018e154-7ad8-4019-abc0-be9dd5aa4136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:33.950377 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-e018e154-7ad8-4019-abc0-be9dd5aa4136 None None] MFA Rules not processed for user `60f6c32dfc474f0ea62f47960ca5e5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:33.951727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e018e154-7ad8-4019-abc0-be9dd5aa4136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:34.041443 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 983/1966] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:34.044317 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62895c0f-b291-4514-9d19-4ac5df12b67a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:34.046089 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-62895c0f-b291-4514-9d19-4ac5df12b67a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:34.107652 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62895c0f-b291-4514-9d19-4ac5df12b67a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:34.111540 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d3ca2-c28c-421a-ae89-3aae1ee5bba8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:34.112207 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d3ca2-c28c-421a-ae89-3aae1ee5bba8 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:34.112491 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d3ca2-c28c-421a-ae89-3aae1ee5bba8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:34.112766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d3ca2-c28c-421a-ae89-3aae1ee5bba8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:34.166930 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d3ca2-c28c-421a-ae89-3aae1ee5bba8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:34.168413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d3ca2-c28c-421a-ae89-3aae1ee5bba8 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:34.178178 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 984/1967] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:35.054009 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018e154-7ad8-4019-abc0-be9dd5aa4136 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:35.056005 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e018e154-7ad8-4019-abc0-be9dd5aa4136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:35.068586 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018e154-7ad8-4019-abc0-be9dd5aa4136 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:35.072613 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9316ba-e273-4a37-8131-7b60b665165a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:35.073272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9316ba-e273-4a37-8131-7b60b665165a service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:35.073748 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9316ba-e273-4a37-8131-7b60b665165a service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:35.074029 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9316ba-e273-4a37-8131-7b60b665165a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:35.136478 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9316ba-e273-4a37-8131-7b60b665165a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:35.138003 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9316ba-e273-4a37-8131-7b60b665165a service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:35.147698 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 984/1968] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:35.210609 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d3ca2-c28c-421a-ae89-3aae1ee5bba8 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:35.212062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a33d3ca2-c28c-421a-ae89-3aae1ee5bba8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:35.281748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d3ca2-c28c-421a-ae89-3aae1ee5bba8 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:35.286306 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce9eb8-1b15-4180-a4b4-d8d4df93db05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:35.287169 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce9eb8-1b15-4180-a4b4-d8d4df93db05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:35.287444 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce9eb8-1b15-4180-a4b4-d8d4df93db05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:35.287719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce9eb8-1b15-4180-a4b4-d8d4df93db05 admin admin] PATH_INFO: `/v3/users/63d09216a1bb49d195f6ed5f39cd2d9f` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:35.288918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce9eb8-1b15-4180-a4b4-d8d4df93db05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63d09216a1bb49d195f6ed5f39cd2d9f)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:35.290880 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce9eb8-1b15-4180-a4b4-d8d4df93db05 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:35.591456 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-27ce9eb8-1b15-4180-a4b4-d8d4df93db05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63d09216a1bb49d195f6ed5f39cd2d9f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:35.603123 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-27ce9eb8-1b15-4180-a4b4-d8d4df93db05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63d09216a1bb49d195f6ed5f39cd2d9f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:35.603818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-27ce9eb8-1b15-4180-a4b4-d8d4df93db05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63d09216a1bb49d195f6ed5f39cd2d9f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:35.604472 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-27ce9eb8-1b15-4180-a4b4-d8d4df93db05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63d09216a1bb49d195f6ed5f39cd2d9f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:35.611290 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-27ce9eb8-1b15-4180-a4b4-d8d4df93db05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63d09216a1bb49d195f6ed5f39cd2d9f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:35.733115 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 985/1969] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:22:35 2022] DELETE /identity/v3/users/63d09216a1bb49d195f6ed5f39cd2d9f => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:35.740164 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a1799-0527-487e-906b-021623eeaaa6 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:35.740164 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a1799-0527-487e-906b-021623eeaaa6 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:35.740164 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a1799-0527-487e-906b-021623eeaaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:35.757636 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-087a1799-0527-487e-906b-021623eeaaa6 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:35.758958 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-087a1799-0527-487e-906b-021623eeaaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:35.828426 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 985/1970] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:35.838210 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce9eb8-1b15-4180-a4b4-d8d4df93db05 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:35.839714 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-27ce9eb8-1b15-4180-a4b4-d8d4df93db05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:35.897594 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce9eb8-1b15-4180-a4b4-d8d4df93db05 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:35.901164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260099d-e5a5-4a92-b0da-11f50cba137e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:35.901803 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260099d-e5a5-4a92-b0da-11f50cba137e service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:35.902080 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260099d-e5a5-4a92-b0da-11f50cba137e service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:35.902754 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260099d-e5a5-4a92-b0da-11f50cba137e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:35.911849 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260099d-e5a5-4a92-b0da-11f50cba137e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:35.913325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260099d-e5a5-4a92-b0da-11f50cba137e service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:35.923936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 986/1971] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:36.271870 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a1799-0527-487e-906b-021623eeaaa6 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:36.279616 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-087a1799-0527-487e-906b-021623eeaaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:36.341456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a1799-0527-487e-906b-021623eeaaa6 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:36.347278 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa9693-0499-4a43-983d-ed3376adf1b0 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d863c3ee4a44dfea9ebc6176c24b049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd1e72118e24b6d800e21705df04076', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:36.347989 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa9693-0499-4a43-983d-ed3376adf1b0 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:36.348279 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa9693-0499-4a43-983d-ed3376adf1b0 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:36.348557 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa9693-0499-4a43-983d-ed3376adf1b0 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:36.349466 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa9693-0499-4a43-983d-ed3376adf1b0 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:22:36.349803 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa9693-0499-4a43-983d-ed3376adf1b0 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:36.351456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa9693-0499-4a43-983d-ed3376adf1b0 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:36.363551 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 986/1972] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:22:36.367735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260099d-e5a5-4a92-b0da-11f50cba137e service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:36.381065 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260099d-e5a5-4a92-b0da-11f50cba137e service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:36.386038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db404e-04d4-40af-b70d-7487cffb49df tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d863c3ee4a44dfea9ebc6176c24b049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd1e72118e24b6d800e21705df04076', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:36.386861 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db404e-04d4-40af-b70d-7487cffb49df tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:36.387791 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db404e-04d4-40af-b70d-7487cffb49df tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:36.388161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db404e-04d4-40af-b70d-7487cffb49df tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:36.389153 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db404e-04d4-40af-b70d-7487cffb49df tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:36.391564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db404e-04d4-40af-b70d-7487cffb49df tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:36.393537 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa9693-0499-4a43-983d-ed3376adf1b0 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:36.395848 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f7fa9693-0499-4a43-983d-ed3376adf1b0 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:36.410322 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa9693-0499-4a43-983d-ed3376adf1b0 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:36.415990 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ae3dd-bdeb-46ec-9e3c-bab2b7a55687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:36.416965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ae3dd-bdeb-46ec-9e3c-bab2b7a55687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:36.417314 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ae3dd-bdeb-46ec-9e3c-bab2b7a55687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:36.417594 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ae3dd-bdeb-46ec-9e3c-bab2b7a55687 admin admin] PATH_INFO: `/v3/projects/b41de0c6d1d444258e4dd80d491bd2fb` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:36.418859 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ae3dd-bdeb-46ec-9e3c-bab2b7a55687 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b41de0c6d1d444258e4dd80d491bd2fb)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:36.421029 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ae3dd-bdeb-46ec-9e3c-bab2b7a55687 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:36.501907 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 987/1973] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:22:36 2022] POST /identity/v3/projects => generated 353 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:36.506048 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db404e-04d4-40af-b70d-7487cffb49df tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:36.510825 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-41db404e-04d4-40af-b70d-7487cffb49df tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:36.541882 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8b3ae3dd-bdeb-46ec-9e3c-bab2b7a55687 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b41de0c6d1d444258e4dd80d491bd2fb', 'request_id': 'req-8b3ae3dd-bdeb-46ec-9e3c-bab2b7a55687'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:36.570926 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db404e-04d4-40af-b70d-7487cffb49df tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:36.625019 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381791b4-5539-4bf9-9fe8-f0e1b67ed7fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:36.625672 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381791b4-5539-4bf9-9fe8-f0e1b67ed7fd service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:36.625954 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381791b4-5539-4bf9-9fe8-f0e1b67ed7fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:36.626268 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381791b4-5539-4bf9-9fe8-f0e1b67ed7fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:36.628075 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-381791b4-5539-4bf9-9fe8-f0e1b67ed7fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:36.630357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8b3ae3dd-bdeb-46ec-9e3c-bab2b7a55687 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b41de0c6d1d444258e4dd80d491bd2fb', 'request_id': 'req-8b3ae3dd-bdeb-46ec-9e3c-bab2b7a55687'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:36.638629 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8b3ae3dd-bdeb-46ec-9e3c-bab2b7a55687 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b41de0c6d1d444258e4dd80d491bd2fb', 'request_id': 'req-8b3ae3dd-bdeb-46ec-9e3c-bab2b7a55687'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:36.651173 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8b3ae3dd-bdeb-46ec-9e3c-bab2b7a55687 admin admin] The token cache is being invalidate because project b41de0c6d1d444258e4dd80d491bd2fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:36.651459 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8b3ae3dd-bdeb-46ec-9e3c-bab2b7a55687 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:36.652253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8b3ae3dd-bdeb-46ec-9e3c-bab2b7a55687 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:36.656817 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 987/1974] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:22:36 2022] DELETE /identity/v3/projects/b41de0c6d1d444258e4dd80d491bd2fb => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:36.656817 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ae3dd-bdeb-46ec-9e3c-bab2b7a55687 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:36.657061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8b3ae3dd-bdeb-46ec-9e3c-bab2b7a55687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:36.690034 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381791b4-5539-4bf9-9fe8-f0e1b67ed7fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:36.691629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381791b4-5539-4bf9-9fe8-f0e1b67ed7fd service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:36.701402 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 988/1975] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:36.707222 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381791b4-5539-4bf9-9fe8-f0e1b67ed7fd service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:36.726552 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ae3dd-bdeb-46ec-9e3c-bab2b7a55687 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:36.731482 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d744d2-b0a1-4d37-9d8d-90973adf72a6 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d863c3ee4a44dfea9ebc6176c24b049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd1e72118e24b6d800e21705df04076', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:36.732128 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d744d2-b0a1-4d37-9d8d-90973adf72a6 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:36.732414 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d744d2-b0a1-4d37-9d8d-90973adf72a6 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:36.732697 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d744d2-b0a1-4d37-9d8d-90973adf72a6 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:36.733477 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d744d2-b0a1-4d37-9d8d-90973adf72a6 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:22:36.733789 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d744d2-b0a1-4d37-9d8d-90973adf72a6 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:36.735462 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d744d2-b0a1-4d37-9d8d-90973adf72a6 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:36.754656 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 988/1976] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:22:36.799289 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d744d2-b0a1-4d37-9d8d-90973adf72a6 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:36.808195 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381791b4-5539-4bf9-9fe8-f0e1b67ed7fd service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:36.810998 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d744d2-b0a1-4d37-9d8d-90973adf72a6 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:36.813932 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a8c26-95b1-4f58-835a-ca5531823912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:36.816390 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a8c26-95b1-4f58-835a-ca5531823912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:36.816740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a8c26-95b1-4f58-835a-ca5531823912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:36.817081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a8c26-95b1-4f58-835a-ca5531823912 admin admin] PATH_INFO: `/v3/users/d32a92f4b84d403094497a1c954e32bc` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:36.817599 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7041e30-484b-438c-af9c-0760ea576753 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d863c3ee4a44dfea9ebc6176c24b049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd1e72118e24b6d800e21705df04076', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:36.818478 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a8c26-95b1-4f58-835a-ca5531823912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d32a92f4b84d403094497a1c954e32bc)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:36.818703 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7041e30-484b-438c-af9c-0760ea576753 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:36.819059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7041e30-484b-438c-af9c-0760ea576753 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:36.819411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7041e30-484b-438c-af9c-0760ea576753 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] PATH_INFO: `/v3/projects/23e387ec7f614ee1bbd523eb3bcbbbbc` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:36.820665 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7041e30-484b-438c-af9c-0760ea576753 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] RBAC: Authorizing `identity:delete_project(project_id=23e387ec7f614ee1bbd523eb3bcbbbbc)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:36.821333 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a8c26-95b1-4f58-835a-ca5531823912 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:36.823013 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7041e30-484b-438c-af9c-0760ea576753 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:37.052147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-3b3a8c26-95b1-4f58-835a-ca5531823912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd32a92f4b84d403094497a1c954e32bc'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:37.052553 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d7041e30-484b-438c-af9c-0760ea576753 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23e387ec7f614ee1bbd523eb3bcbbbbc', 'request_id': 'req-d7041e30-484b-438c-af9c-0760ea576753'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:37.063815 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-3b3a8c26-95b1-4f58-835a-ca5531823912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd32a92f4b84d403094497a1c954e32bc'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:37.065442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-3b3a8c26-95b1-4f58-835a-ca5531823912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd32a92f4b84d403094497a1c954e32bc'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:37.066248 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-3b3a8c26-95b1-4f58-835a-ca5531823912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd32a92f4b84d403094497a1c954e32bc'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:37.076379 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-3b3a8c26-95b1-4f58-835a-ca5531823912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd32a92f4b84d403094497a1c954e32bc'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:37.150093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d7041e30-484b-438c-af9c-0760ea576753 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23e387ec7f614ee1bbd523eb3bcbbbbc', 'request_id': 'req-d7041e30-484b-438c-af9c-0760ea576753'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:37.158535 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d7041e30-484b-438c-af9c-0760ea576753 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23e387ec7f614ee1bbd523eb3bcbbbbc', 'request_id': 'req-d7041e30-484b-438c-af9c-0760ea576753'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:37.168809 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d7041e30-484b-438c-af9c-0760ea576753 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] The token cache is being invalidate because project 23e387ec7f614ee1bbd523eb3bcbbbbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:37.169096 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d7041e30-484b-438c-af9c-0760ea576753 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:37.169743 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d7041e30-484b-438c-af9c-0760ea576753 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:37.171331 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 989/1977] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:22:36 2022] DELETE /identity/v3/projects/23e387ec7f614ee1bbd523eb3bcbbbbc => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:37.172101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7041e30-484b-438c-af9c-0760ea576753 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:37.173686 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d7041e30-484b-438c-af9c-0760ea576753 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:37.225269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 989/1978] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:22:36 2022] DELETE /identity/v3/users/d32a92f4b84d403094497a1c954e32bc => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:37.237753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7041e30-484b-438c-af9c-0760ea576753 tempest-VolumeQuotaClassesTest-860142605 tempest-VolumeQuotaClassesTest-860142605-project-admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:37.304302 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430596e-0c55-4bd7-bbcb-e6689fcc12f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:37.305855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430596e-0c55-4bd7-bbcb-e6689fcc12f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:37.306148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430596e-0c55-4bd7-bbcb-e6689fcc12f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:37.306451 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430596e-0c55-4bd7-bbcb-e6689fcc12f4 admin admin] PATH_INFO: `/v3/users/6da6d35c6c78443ba0319643a5e219d9` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:37.307675 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430596e-0c55-4bd7-bbcb-e6689fcc12f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6da6d35c6c78443ba0319643a5e219d9)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:37.310283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430596e-0c55-4bd7-bbcb-e6689fcc12f4 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:37.568842 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b430596e-0c55-4bd7-bbcb-e6689fcc12f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6da6d35c6c78443ba0319643a5e219d9'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:37.647999 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b430596e-0c55-4bd7-bbcb-e6689fcc12f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6da6d35c6c78443ba0319643a5e219d9'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:37.649093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b430596e-0c55-4bd7-bbcb-e6689fcc12f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6da6d35c6c78443ba0319643a5e219d9'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:37.662308 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b430596e-0c55-4bd7-bbcb-e6689fcc12f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6da6d35c6c78443ba0319643a5e219d9'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:37.663016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b430596e-0c55-4bd7-bbcb-e6689fcc12f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6da6d35c6c78443ba0319643a5e219d9'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:37.675399 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 990/1979] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:22:37 2022] DELETE /identity/v3/users/6da6d35c6c78443ba0319643a5e219d9 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:37.721816 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a8c26-95b1-4f58-835a-ca5531823912 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:37.723358 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3b3a8c26-95b1-4f58-835a-ca5531823912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:37.738291 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a8c26-95b1-4f58-835a-ca5531823912 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:37.808206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de572f9-032f-4ab1-bbbf-f1512d59c39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:37.809657 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de572f9-032f-4ab1-bbbf-f1512d59c39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:37.809941 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de572f9-032f-4ab1-bbbf-f1512d59c39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:37.810237 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de572f9-032f-4ab1-bbbf-f1512d59c39f admin admin] PATH_INFO: `/v3/projects/a934cf3cf8af4094aa47ca7b887d9e9d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:37.811577 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de572f9-032f-4ab1-bbbf-f1512d59c39f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a934cf3cf8af4094aa47ca7b887d9e9d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:37.813502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de572f9-032f-4ab1-bbbf-f1512d59c39f admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:37.916558 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9de572f9-032f-4ab1-bbbf-f1512d59c39f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a934cf3cf8af4094aa47ca7b887d9e9d', 'request_id': 'req-9de572f9-032f-4ab1-bbbf-f1512d59c39f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:37.923435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9de572f9-032f-4ab1-bbbf-f1512d59c39f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a934cf3cf8af4094aa47ca7b887d9e9d', 'request_id': 'req-9de572f9-032f-4ab1-bbbf-f1512d59c39f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:37.952087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430596e-0c55-4bd7-bbcb-e6689fcc12f4 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:37.953531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b430596e-0c55-4bd7-bbcb-e6689fcc12f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:37.971851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430596e-0c55-4bd7-bbcb-e6689fcc12f4 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:38.033947 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a9bff-9ccb-408f-95b7-86e636d23d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:38.034837 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a9bff-9ccb-408f-95b7-86e636d23d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:38.035127 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a9bff-9ccb-408f-95b7-86e636d23d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:38.035401 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a9bff-9ccb-408f-95b7-86e636d23d6a admin admin] PATH_INFO: `/v3/projects/3733b202412047fa87928b2a71871f5e` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:38.036596 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a9bff-9ccb-408f-95b7-86e636d23d6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3733b202412047fa87928b2a71871f5e)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:38.038555 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a9bff-9ccb-408f-95b7-86e636d23d6a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:38.058966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9de572f9-032f-4ab1-bbbf-f1512d59c39f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a934cf3cf8af4094aa47ca7b887d9e9d', 'request_id': 'req-9de572f9-032f-4ab1-bbbf-f1512d59c39f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:38.070165 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9de572f9-032f-4ab1-bbbf-f1512d59c39f admin admin] The token cache is being invalidate because project a934cf3cf8af4094aa47ca7b887d9e9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:38.092405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9de572f9-032f-4ab1-bbbf-f1512d59c39f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:38.092405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9de572f9-032f-4ab1-bbbf-f1512d59c39f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:38.092405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 990/1980] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:22:37 2022] DELETE /identity/v3/projects/a934cf3cf8af4094aa47ca7b887d9e9d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:38.092405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de572f9-032f-4ab1-bbbf-f1512d59c39f admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:38.092405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9de572f9-032f-4ab1-bbbf-f1512d59c39f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:38.101141 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de572f9-032f-4ab1-bbbf-f1512d59c39f admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:38.106424 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d9c79-d188-4594-a7b1-1f007030a06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:38.107271 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d9c79-d188-4594-a7b1-1f007030a06b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:38.107599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d9c79-d188-4594-a7b1-1f007030a06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:38.107873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d9c79-d188-4594-a7b1-1f007030a06b admin admin] PATH_INFO: `/v3/users/e2f29ae37004445096f0fabe2b59b360` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:38.109052 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d9c79-d188-4594-a7b1-1f007030a06b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2f29ae37004445096f0fabe2b59b360)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:38.111419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d9c79-d188-4594-a7b1-1f007030a06b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:38.338470 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-429a9bff-9ccb-408f-95b7-86e636d23d6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3733b202412047fa87928b2a71871f5e', 'request_id': 'req-429a9bff-9ccb-408f-95b7-86e636d23d6a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:38.418577 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-429a9bff-9ccb-408f-95b7-86e636d23d6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3733b202412047fa87928b2a71871f5e', 'request_id': 'req-429a9bff-9ccb-408f-95b7-86e636d23d6a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:38.425395 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-429a9bff-9ccb-408f-95b7-86e636d23d6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3733b202412047fa87928b2a71871f5e', 'request_id': 'req-429a9bff-9ccb-408f-95b7-86e636d23d6a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:38.435543 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-429a9bff-9ccb-408f-95b7-86e636d23d6a admin admin] The token cache is being invalidate because project 3733b202412047fa87928b2a71871f5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:38.435834 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-429a9bff-9ccb-408f-95b7-86e636d23d6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:38.436463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-429a9bff-9ccb-408f-95b7-86e636d23d6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:38.438012 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 991/1981] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:22:37 2022] DELETE /identity/v3/projects/3733b202412047fa87928b2a71871f5e => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:38.439496 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a9bff-9ccb-408f-95b7-86e636d23d6a admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:38.441023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-429a9bff-9ccb-408f-95b7-86e636d23d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:38.484226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f23d9c79-d188-4594-a7b1-1f007030a06b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2f29ae37004445096f0fabe2b59b360'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:38.500120 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f23d9c79-d188-4594-a7b1-1f007030a06b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2f29ae37004445096f0fabe2b59b360'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:38.500812 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f23d9c79-d188-4594-a7b1-1f007030a06b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2f29ae37004445096f0fabe2b59b360'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:38.501419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f23d9c79-d188-4594-a7b1-1f007030a06b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2f29ae37004445096f0fabe2b59b360'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:38.507085 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a9bff-9ccb-408f-95b7-86e636d23d6a admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:38.508463 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f23d9c79-d188-4594-a7b1-1f007030a06b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2f29ae37004445096f0fabe2b59b360'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:38.512477 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552a211-c08d-4e36-95a9-37bbe96b8b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:38.513361 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552a211-c08d-4e36-95a9-37bbe96b8b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:38.513697 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552a211-c08d-4e36-95a9-37bbe96b8b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:38.513947 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552a211-c08d-4e36-95a9-37bbe96b8b86 admin admin] PATH_INFO: `/v3/users/1f9ae86ea3364f39ba295eac1359eea7` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:38.515229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552a211-c08d-4e36-95a9-37bbe96b8b86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f9ae86ea3364f39ba295eac1359eea7)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:38.517155 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552a211-c08d-4e36-95a9-37bbe96b8b86 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:38.590525 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 991/1982] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:22:38 2022] DELETE /identity/v3/users/e2f29ae37004445096f0fabe2b59b360 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:38.590525 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9891b23-61ce-489c-8eb5-81be13949a21 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:38.590525 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9891b23-61ce-489c-8eb5-81be13949a21 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:38.590525 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9891b23-61ce-489c-8eb5-81be13949a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:38.609532 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-d9891b23-61ce-489c-8eb5-81be13949a21 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:38.610564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d9891b23-61ce-489c-8eb5-81be13949a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:38.693545 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 992/1983] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:38.694764 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9891b23-61ce-489c-8eb5-81be13949a21 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:38.696517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d9891b23-61ce-489c-8eb5-81be13949a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:38.746865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0552a211-c08d-4e36-95a9-37bbe96b8b86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f9ae86ea3364f39ba295eac1359eea7'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:38.753626 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9891b23-61ce-489c-8eb5-81be13949a21 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:38.757383 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a932aa-ec04-4f5d-b92e-97e4faa4a18d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:38.758033 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a932aa-ec04-4f5d-b92e-97e4faa4a18d service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:38.758359 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a932aa-ec04-4f5d-b92e-97e4faa4a18d service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:38.758639 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a932aa-ec04-4f5d-b92e-97e4faa4a18d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:38.760475 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-39a932aa-ec04-4f5d-b92e-97e4faa4a18d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:38.826487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a932aa-ec04-4f5d-b92e-97e4faa4a18d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:38.828048 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a932aa-ec04-4f5d-b92e-97e4faa4a18d service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:38.835983 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0552a211-c08d-4e36-95a9-37bbe96b8b86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f9ae86ea3364f39ba295eac1359eea7'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:38.836587 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0552a211-c08d-4e36-95a9-37bbe96b8b86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f9ae86ea3364f39ba295eac1359eea7'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:38.838357 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 993/1984] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:38.839669 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478c40f-c662-4298-9872-229ba0fd2f12 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:38.840495 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478c40f-c662-4298-9872-229ba0fd2f12 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:38.840757 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478c40f-c662-4298-9872-229ba0fd2f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:38.859032 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-5478c40f-c662-4298-9872-229ba0fd2f12 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:38.859984 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5478c40f-c662-4298-9872-229ba0fd2f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:38.864125 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0552a211-c08d-4e36-95a9-37bbe96b8b86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f9ae86ea3364f39ba295eac1359eea7'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:38.865004 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0552a211-c08d-4e36-95a9-37bbe96b8b86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f9ae86ea3364f39ba295eac1359eea7'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:38.872026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 994/1985] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:38.873190 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478c40f-c662-4298-9872-229ba0fd2f12 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:38.882826 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478c40f-c662-4298-9872-229ba0fd2f12 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:38.885655 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 992/1986] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:22:38 2022] DELETE /identity/v3/users/1f9ae86ea3364f39ba295eac1359eea7 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:38.891464 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a035e45-1935-4ef3-ba71-c5373c9c846d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:38.891643 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78d246-8554-4221-9d70-3da45513bc17 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:38.891643 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78d246-8554-4221-9d70-3da45513bc17 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:38.891798 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a035e45-1935-4ef3-ba71-c5373c9c846d admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:38.891882 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78d246-8554-4221-9d70-3da45513bc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:38.892147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a035e45-1935-4ef3-ba71-c5373c9c846d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:38.892319 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a035e45-1935-4ef3-ba71-c5373c9c846d admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:38.893206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a035e45-1935-4ef3-ba71-c5373c9c846d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:22:38.893502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a035e45-1935-4ef3-ba71-c5373c9c846d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:38.895147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a035e45-1935-4ef3-ba71-c5373c9c846d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:38.909461 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 995/1987] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:22:38.912277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-dc78d246-8554-4221-9d70-3da45513bc17 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:38.913603 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a035e45-1935-4ef3-ba71-c5373c9c846d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:38.913801 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-dc78d246-8554-4221-9d70-3da45513bc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:38.924057 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a035e45-1935-4ef3-ba71-c5373c9c846d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:38.975010 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 993/1988] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:38.985777 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78d246-8554-4221-9d70-3da45513bc17 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:38.987256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-dc78d246-8554-4221-9d70-3da45513bc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:38.990373 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8ebde-7e7e-436c-85d1-9c4048f433d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:38.991838 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8ebde-7e7e-436c-85d1-9c4048f433d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:38.992118 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8ebde-7e7e-436c-85d1-9c4048f433d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:38.992410 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8ebde-7e7e-436c-85d1-9c4048f433d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:38.993097 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8ebde-7e7e-436c-85d1-9c4048f433d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:38.995271 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8ebde-7e7e-436c-85d1-9c4048f433d2 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:39.056569 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78d246-8554-4221-9d70-3da45513bc17 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:39.060757 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039fca54-14e2-4f9a-b5fa-830ae0c4419f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:39.061428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fca54-14e2-4f9a-b5fa-830ae0c4419f service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:39.061712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fca54-14e2-4f9a-b5fa-830ae0c4419f service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:39.061990 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fca54-14e2-4f9a-b5fa-830ae0c4419f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:39.072188 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039fca54-14e2-4f9a-b5fa-830ae0c4419f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:39.074956 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039fca54-14e2-4f9a-b5fa-830ae0c4419f service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:39.084183 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 994/1989] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:22:39.085013 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039fca54-14e2-4f9a-b5fa-830ae0c4419f service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:39.086542 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-039fca54-14e2-4f9a-b5fa-830ae0c4419f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:39.099630 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039fca54-14e2-4f9a-b5fa-830ae0c4419f service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:39.104361 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20cab0-f5d6-4c6b-abf9-78b5dca175b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:39.105250 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20cab0-f5d6-4c6b-abf9-78b5dca175b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:39.105514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20cab0-f5d6-4c6b-abf9-78b5dca175b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:39.105794 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20cab0-f5d6-4c6b-abf9-78b5dca175b2 admin admin] PATH_INFO: `/v3/projects/4aa7f13f17f24f838bdf6599a4e8e473` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:39.107050 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20cab0-f5d6-4c6b-abf9-78b5dca175b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aa7f13f17f24f838bdf6599a4e8e473)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:39.111048 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20cab0-f5d6-4c6b-abf9-78b5dca175b2 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:39.180975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 996/1990] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:22:38 2022] POST /identity/v3/projects => generated 355 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:39.184945 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8ebde-7e7e-436c-85d1-9c4048f433d2 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:39.220644 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ca20cab0-f5d6-4c6b-abf9-78b5dca175b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aa7f13f17f24f838bdf6599a4e8e473', 'request_id': 'req-ca20cab0-f5d6-4c6b-abf9-78b5dca175b2'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:39.261628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8ebde-7e7e-436c-85d1-9c4048f433d2 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:39.293709 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ca20cab0-f5d6-4c6b-abf9-78b5dca175b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aa7f13f17f24f838bdf6599a4e8e473', 'request_id': 'req-ca20cab0-f5d6-4c6b-abf9-78b5dca175b2'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:39.300978 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ca20cab0-f5d6-4c6b-abf9-78b5dca175b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aa7f13f17f24f838bdf6599a4e8e473', 'request_id': 'req-ca20cab0-f5d6-4c6b-abf9-78b5dca175b2'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:39.313285 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ca20cab0-f5d6-4c6b-abf9-78b5dca175b2 admin admin] The token cache is being invalidate because project 4aa7f13f17f24f838bdf6599a4e8e473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:39.313585 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ca20cab0-f5d6-4c6b-abf9-78b5dca175b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:39.314297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ca20cab0-f5d6-4c6b-abf9-78b5dca175b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:39.316362 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 995/1991] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:22:39 2022] DELETE /identity/v3/projects/4aa7f13f17f24f838bdf6599a4e8e473 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:39.322704 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49defa01-39f9-4aa1-9b77-edc174092e93 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:39.323276 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49defa01-39f9-4aa1-9b77-edc174092e93 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:39.323739 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49defa01-39f9-4aa1-9b77-edc174092e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:39.331834 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c034751-053f-4b85-b59c-371b20836c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:39.332531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c034751-053f-4b85-b59c-371b20836c67 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:39.332813 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c034751-053f-4b85-b59c-371b20836c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:39.333091 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c034751-053f-4b85-b59c-371b20836c67 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:39.334401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c034751-053f-4b85-b59c-371b20836c67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:39.336317 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c034751-053f-4b85-b59c-371b20836c67 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:39.353211 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-49defa01-39f9-4aa1-9b77-edc174092e93 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:39.353211 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-49defa01-39f9-4aa1-9b77-edc174092e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:39.361287 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 996/1992] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:39.369967 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b800eae-fe02-47cf-9049-e58ccacd4a81 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:39.370429 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b800eae-fe02-47cf-9049-e58ccacd4a81 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:39.370681 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b800eae-fe02-47cf-9049-e58ccacd4a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:39.396200 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-2b800eae-fe02-47cf-9049-e58ccacd4a81 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:39.397696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2b800eae-fe02-47cf-9049-e58ccacd4a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:39.408842 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 997/1993] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:39.413449 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b800eae-fe02-47cf-9049-e58ccacd4a81 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:39.428168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b800eae-fe02-47cf-9049-e58ccacd4a81 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:39.437469 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb301bc-ada5-49ad-9acb-c3c8d9a7447d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:39.444623 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb301bc-ada5-49ad-9acb-c3c8d9a7447d admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:39.444623 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb301bc-ada5-49ad-9acb-c3c8d9a7447d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:39.444623 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb301bc-ada5-49ad-9acb-c3c8d9a7447d admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:39.444623 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb301bc-ada5-49ad-9acb-c3c8d9a7447d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:22:39.444623 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb301bc-ada5-49ad-9acb-c3c8d9a7447d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:39.444623 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb301bc-ada5-49ad-9acb-c3c8d9a7447d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:39.457093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 998/1994] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:22:39.461187 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb301bc-ada5-49ad-9acb-c3c8d9a7447d admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:39.472216 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb301bc-ada5-49ad-9acb-c3c8d9a7447d admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:39.477496 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498f8c2-a8ca-4f88-9541-e054f7574804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:39.484895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498f8c2-a8ca-4f88-9541-e054f7574804 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:39.484895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498f8c2-a8ca-4f88-9541-e054f7574804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:39.484895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498f8c2-a8ca-4f88-9541-e054f7574804 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:39.484895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498f8c2-a8ca-4f88-9541-e054f7574804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:39.484895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498f8c2-a8ca-4f88-9541-e054f7574804 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:39.487087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 997/1995] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:22:39 2022] POST /identity/v3/users => generated 278 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:39.491822 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c034751-053f-4b85-b59c-371b20836c67 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:39.494441 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5c034751-053f-4b85-b59c-371b20836c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:39.507658 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c034751-053f-4b85-b59c-371b20836c67 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:39.513096 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1cbc7-73a2-40bf-adcd-333925b9020d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:39.513758 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1cbc7-73a2-40bf-adcd-333925b9020d admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:39.514042 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1cbc7-73a2-40bf-adcd-333925b9020d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:39.514487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1cbc7-73a2-40bf-adcd-333925b9020d admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:39.519128 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1cbc7-73a2-40bf-adcd-333925b9020d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:39.519128 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1cbc7-73a2-40bf-adcd-333925b9020d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:39.527335 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 998/1996] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:22:39.531143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1cbc7-73a2-40bf-adcd-333925b9020d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:39.541243 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1cbc7-73a2-40bf-adcd-333925b9020d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:39.545963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c9e5f-05a7-46b9-91ac-fd06e63b371c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:39.546578 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c9e5f-05a7-46b9-91ac-fd06e63b371c admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:39.546858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c9e5f-05a7-46b9-91ac-fd06e63b371c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:39.547132 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c9e5f-05a7-46b9-91ac-fd06e63b371c admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:39.547874 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c9e5f-05a7-46b9-91ac-fd06e63b371c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:39.549574 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c9e5f-05a7-46b9-91ac-fd06e63b371c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:39.560575 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 999/1997] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:22:39.564745 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c9e5f-05a7-46b9-91ac-fd06e63b371c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:39.574092 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c9e5f-05a7-46b9-91ac-fd06e63b371c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:39.579393 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127eff0a-f099-4b27-b78a-255db4e34e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:39.580241 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eff0a-f099-4b27-b78a-255db4e34e9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:39.580521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eff0a-f099-4b27-b78a-255db4e34e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:39.580794 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eff0a-f099-4b27-b78a-255db4e34e9b admin admin] PATH_INFO: `/v3/projects/d972fb70dbc542bb902d0cad941b83ee/users/fc3c04b512cc4130a7931206cc486a60/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:39.595885 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127eff0a-f099-4b27-b78a-255db4e34e9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d972fb70dbc542bb902d0cad941b83ee, user_id=fc3c04b512cc4130a7931206cc486a60, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:39.599854 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127eff0a-f099-4b27-b78a-255db4e34e9b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:39.655202 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 999/1998] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:22:39 2022] POST /identity/v3/projects => generated 367 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:39.656108 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498f8c2-a8ca-4f88-9541-e054f7574804 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:39.657790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5498f8c2-a8ca-4f88-9541-e054f7574804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:39.718984 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498f8c2-a8ca-4f88-9541-e054f7574804 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:39.723678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6232850-88c9-4475-bc5b-c1290e7aceb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:39.724528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6232850-88c9-4475-bc5b-c1290e7aceb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:39.724812 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6232850-88c9-4475-bc5b-c1290e7aceb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:39.725087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6232850-88c9-4475-bc5b-c1290e7aceb2 admin admin] PATH_INFO: `/v3/projects/52286e44907f43668536148181d75201` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:39.726346 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6232850-88c9-4475-bc5b-c1290e7aceb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52286e44907f43668536148181d75201)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:39.728252 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6232850-88c9-4475-bc5b-c1290e7aceb2 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:39.755757 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1000/1999] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:39 2022] PUT /identity/v3/projects/d972fb70dbc542bb902d0cad941b83ee/users/fc3c04b512cc4130a7931206cc486a60/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:39.756582 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127eff0a-f099-4b27-b78a-255db4e34e9b admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:39.815707 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127eff0a-f099-4b27-b78a-255db4e34e9b admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:39.820354 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a709f73-43e3-4016-8f29-07460b57b5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:39.821015 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a709f73-43e3-4016-8f29-07460b57b5e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:39.821302 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a709f73-43e3-4016-8f29-07460b57b5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:39.821578 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a709f73-43e3-4016-8f29-07460b57b5e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:39.822292 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a709f73-43e3-4016-8f29-07460b57b5e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:39.824804 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a709f73-43e3-4016-8f29-07460b57b5e2 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:39.858290 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d6232850-88c9-4475-bc5b-c1290e7aceb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52286e44907f43668536148181d75201', 'request_id': 'req-d6232850-88c9-4475-bc5b-c1290e7aceb2'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:39.956213 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1001/2000] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:22:39 2022] POST /identity/v3/users => generated 284 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:39.957731 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca4bc6-c93f-4545-bc82-d9c5f6818749 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:39.958028 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca4bc6-c93f-4545-bc82-d9c5f6818749 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:39.958381 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca4bc6-c93f-4545-bc82-d9c5f6818749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:39.983939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c6ca4bc6-c93f-4545-bc82-d9c5f6818749 None None] MFA Rules not processed for user `fc3c04b512cc4130a7931206cc486a60`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:39.989678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d6232850-88c9-4475-bc5b-c1290e7aceb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52286e44907f43668536148181d75201', 'request_id': 'req-d6232850-88c9-4475-bc5b-c1290e7aceb2'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:39.989814 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c6ca4bc6-c93f-4545-bc82-d9c5f6818749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:39.991730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d6232850-88c9-4475-bc5b-c1290e7aceb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52286e44907f43668536148181d75201', 'request_id': 'req-d6232850-88c9-4475-bc5b-c1290e7aceb2'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:40.002654 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d6232850-88c9-4475-bc5b-c1290e7aceb2 admin admin] The token cache is being invalidate because project 52286e44907f43668536148181d75201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:40.002942 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d6232850-88c9-4475-bc5b-c1290e7aceb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:40.003607 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d6232850-88c9-4475-bc5b-c1290e7aceb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:40.005171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1000/2001] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:22:39 2022] DELETE /identity/v3/projects/52286e44907f43668536148181d75201 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:40.005935 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6232850-88c9-4475-bc5b-c1290e7aceb2 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:40.007257 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d6232850-88c9-4475-bc5b-c1290e7aceb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:40.049089 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1002/2002] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:39 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:40.050093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca4bc6-c93f-4545-bc82-d9c5f6818749 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:40.051397 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c6ca4bc6-c93f-4545-bc82-d9c5f6818749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:40.072973 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6232850-88c9-4475-bc5b-c1290e7aceb2 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:40.077976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8cc6c-f9ef-4c53-8293-8cf193cb09de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:40.078689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8cc6c-f9ef-4c53-8293-8cf193cb09de admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:40.078950 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8cc6c-f9ef-4c53-8293-8cf193cb09de admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:40.079228 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8cc6c-f9ef-4c53-8293-8cf193cb09de admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:40.080239 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8cc6c-f9ef-4c53-8293-8cf193cb09de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:40.081764 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8cc6c-f9ef-4c53-8293-8cf193cb09de admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:40.092494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1001/2003] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:40.093470 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8cc6c-f9ef-4c53-8293-8cf193cb09de admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:40.095172 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a5d8cc6c-f9ef-4c53-8293-8cf193cb09de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:40.107964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8cc6c-f9ef-4c53-8293-8cf193cb09de admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:40.112676 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95f1e7-d000-415e-9540-7b9f2d462800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:40.113413 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95f1e7-d000-415e-9540-7b9f2d462800 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:40.113697 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95f1e7-d000-415e-9540-7b9f2d462800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:40.113973 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95f1e7-d000-415e-9540-7b9f2d462800 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:40.114697 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95f1e7-d000-415e-9540-7b9f2d462800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:40.116635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95f1e7-d000-415e-9540-7b9f2d462800 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:40.117359 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca4bc6-c93f-4545-bc82-d9c5f6818749 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:40.122532 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d11ede-0cc0-4c69-a90b-5843dc936183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:40.123387 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d11ede-0cc0-4c69-a90b-5843dc936183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:40.123667 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d11ede-0cc0-4c69-a90b-5843dc936183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:40.123941 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d11ede-0cc0-4c69-a90b-5843dc936183 admin admin] PATH_INFO: `/v3/users/7d863c3ee4a44dfea9ebc6176c24b049` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:40.125205 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d11ede-0cc0-4c69-a90b-5843dc936183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d863c3ee4a44dfea9ebc6176c24b049)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:40.127163 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d11ede-0cc0-4c69-a90b-5843dc936183 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:40.218110 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1002/2004] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:22:40 2022] POST /identity/v3/projects => generated 355 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:40.218110 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95f1e7-d000-415e-9540-7b9f2d462800 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:40.294167 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95f1e7-d000-415e-9540-7b9f2d462800 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:40.298870 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffeb729-d63a-4dcd-94ab-36b42188bec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:40.299534 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffeb729-d63a-4dcd-94ab-36b42188bec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:40.299812 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffeb729-d63a-4dcd-94ab-36b42188bec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:40.300084 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffeb729-d63a-4dcd-94ab-36b42188bec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:40.300812 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffeb729-d63a-4dcd-94ab-36b42188bec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:40.302432 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffeb729-d63a-4dcd-94ab-36b42188bec4 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:40.312153 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1003/2005] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:40.313021 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffeb729-d63a-4dcd-94ab-36b42188bec4 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:40.322441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffeb729-d63a-4dcd-94ab-36b42188bec4 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:40.323633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-17d11ede-0cc0-4c69-a90b-5843dc936183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d863c3ee4a44dfea9ebc6176c24b049'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:40.327245 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d6ae3-ba99-4b31-86eb-8442e3c11d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:40.327889 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d6ae3-ba99-4b31-86eb-8442e3c11d3f admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:40.333552 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d6ae3-ba99-4b31-86eb-8442e3c11d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:40.333552 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d6ae3-ba99-4b31-86eb-8442e3c11d3f admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:40.333552 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d6ae3-ba99-4b31-86eb-8442e3c11d3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:40.333552 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d6ae3-ba99-4b31-86eb-8442e3c11d3f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:40.335306 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-17d11ede-0cc0-4c69-a90b-5843dc936183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d863c3ee4a44dfea9ebc6176c24b049'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:40.336045 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-17d11ede-0cc0-4c69-a90b-5843dc936183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d863c3ee4a44dfea9ebc6176c24b049'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:40.336692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-17d11ede-0cc0-4c69-a90b-5843dc936183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d863c3ee4a44dfea9ebc6176c24b049'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:40.344028 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-17d11ede-0cc0-4c69-a90b-5843dc936183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d863c3ee4a44dfea9ebc6176c24b049'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:40.464909 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1004/2006] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:22:40 2022] POST /identity/v3/users => generated 284 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:40.466422 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d6ae3-ba99-4b31-86eb-8442e3c11d3f admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:40.468028 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-332d6ae3-ba99-4b31-86eb-8442e3c11d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:40.479809 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d6ae3-ba99-4b31-86eb-8442e3c11d3f admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:40.481089 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1003/2007] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:22:40 2022] DELETE /identity/v3/users/7d863c3ee4a44dfea9ebc6176c24b049 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:40.484761 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d11ede-0cc0-4c69-a90b-5843dc936183 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:40.486036 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-17d11ede-0cc0-4c69-a90b-5843dc936183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:40.543200 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed1d5b-6922-46aa-b7c0-7677afb609a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:40.544230 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed1d5b-6922-46aa-b7c0-7677afb609a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:40.544532 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed1d5b-6922-46aa-b7c0-7677afb609a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:40.544793 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed1d5b-6922-46aa-b7c0-7677afb609a5 admin admin] PATH_INFO: `/v3/projects/f8d12e1242594098b5b5ad9b8b00f938/users/9f0ba2c0c93d4759ad70719b0d32f7e8/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:40.554750 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d11ede-0cc0-4c69-a90b-5843dc936183 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:40.568315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153a5ec-0033-478d-87cd-b81c5b4012bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:40.568477 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed1d5b-6922-46aa-b7c0-7677afb609a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d12e1242594098b5b5ad9b8b00f938, user_id=9f0ba2c0c93d4759ad70719b0d32f7e8, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:40.568610 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153a5ec-0033-478d-87cd-b81c5b4012bd admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:40.568610 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153a5ec-0033-478d-87cd-b81c5b4012bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:40.568610 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153a5ec-0033-478d-87cd-b81c5b4012bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:40.568610 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153a5ec-0033-478d-87cd-b81c5b4012bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:40.568926 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed1d5b-6922-46aa-b7c0-7677afb609a5 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:40.569016 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153a5ec-0033-478d-87cd-b81c5b4012bd admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:40.579342 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1004/2008] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:40.583499 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153a5ec-0033-478d-87cd-b81c5b4012bd admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:40.594752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153a5ec-0033-478d-87cd-b81c5b4012bd admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:40.599497 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af31af9-9aa3-465c-b40b-7f87f4fa273b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:40.600376 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af31af9-9aa3-465c-b40b-7f87f4fa273b admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:40.600676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af31af9-9aa3-465c-b40b-7f87f4fa273b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:40.600953 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af31af9-9aa3-465c-b40b-7f87f4fa273b admin admin] PATH_INFO: `/v3/projects/6c0be83db166477d8cf2f252bfd053df/users/164724135b344273bb9cdd7e7d8a6250/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:40.616404 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af31af9-9aa3-465c-b40b-7f87f4fa273b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c0be83db166477d8cf2f252bfd053df, user_id=164724135b344273bb9cdd7e7d8a6250, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:40.619254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af31af9-9aa3-465c-b40b-7f87f4fa273b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:40.653051 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1005/2009] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:40 2022] PUT /identity/v3/projects/f8d12e1242594098b5b5ad9b8b00f938/users/9f0ba2c0c93d4759ad70719b0d32f7e8/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:40.664393 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6363ce-b123-45e3-8f73-5775b316c2a1 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:40.664674 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6363ce-b123-45e3-8f73-5775b316c2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:40.664948 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6363ce-b123-45e3-8f73-5775b316c2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:40.692893 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0e6363ce-b123-45e3-8f73-5775b316c2a1 None None] MFA Rules not processed for user `9f0ba2c0c93d4759ad70719b0d32f7e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:40.698611 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0e6363ce-b123-45e3-8f73-5775b316c2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:40.737448 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1005/2010] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:40 2022] PUT /identity/v3/projects/6c0be83db166477d8cf2f252bfd053df/users/164724135b344273bb9cdd7e7d8a6250/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:40.741135 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af31af9-9aa3-465c-b40b-7f87f4fa273b admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:40.769280 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1006/2011] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:40.783507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6363ce-b123-45e3-8f73-5775b316c2a1 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:40.785177 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0e6363ce-b123-45e3-8f73-5775b316c2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:40.814315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af31af9-9aa3-465c-b40b-7f87f4fa273b admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:40.819316 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f1fba-2cf9-451c-903b-33ee56ed29a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:40.830552 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f1fba-2cf9-451c-903b-33ee56ed29a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:40.830552 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f1fba-2cf9-451c-903b-33ee56ed29a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:40.830552 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f1fba-2cf9-451c-903b-33ee56ed29a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:40.830552 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f1fba-2cf9-451c-903b-33ee56ed29a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:40.830552 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f1fba-2cf9-451c-903b-33ee56ed29a6 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:40.836039 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1006/2012] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:40.840868 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f1fba-2cf9-451c-903b-33ee56ed29a6 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:40.851774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f1fba-2cf9-451c-903b-33ee56ed29a6 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:40.857158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6b965-a304-483f-bcdd-98cff3496fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:40.858008 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6363ce-b123-45e3-8f73-5775b316c2a1 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:40.858165 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6b965-a304-483f-bcdd-98cff3496fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:40.858342 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6b965-a304-483f-bcdd-98cff3496fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:40.858616 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6b965-a304-483f-bcdd-98cff3496fb5 admin admin] PATH_INFO: `/v3/projects/6c0be83db166477d8cf2f252bfd053df/users/164724135b344273bb9cdd7e7d8a6250/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:40.860692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6b965-a304-483f-bcdd-98cff3496fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c0be83db166477d8cf2f252bfd053df, user_id=164724135b344273bb9cdd7e7d8a6250, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:40.863818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6b965-a304-483f-bcdd-98cff3496fb5 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:40.886834 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1007/2013] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:40 2022] PUT /identity/v3/projects/6c0be83db166477d8cf2f252bfd053df/users/164724135b344273bb9cdd7e7d8a6250/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:40.895527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ffb0f-9da8-45aa-8e89-2f310631e0c0 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:40.895817 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ffb0f-9da8-45aa-8e89-2f310631e0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:40.896142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ffb0f-9da8-45aa-8e89-2f310631e0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:40.907694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ece642-660c-466b-b95d-fcc17ed44391 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1e67aa4370453fafb5b6525ba13cd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:40.908494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ece642-660c-466b-b95d-fcc17ed44391 service glance] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:40.908828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ece642-660c-466b-b95d-fcc17ed44391 service glance] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:40.909164 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ece642-660c-466b-b95d-fcc17ed44391 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:40.923508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-bc2ffb0f-9da8-45aa-8e89-2f310631e0c0 None None] MFA Rules not processed for user `164724135b344273bb9cdd7e7d8a6250`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:40.924844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bc2ffb0f-9da8-45aa-8e89-2f310631e0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:40.965726 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ece642-660c-466b-b95d-fcc17ed44391 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:40.972263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ece642-660c-466b-b95d-fcc17ed44391 service glance] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:40.976249 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1007/2014] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:22:40.992320 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1008/2015] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:40 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:41.004290 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ece642-660c-466b-b95d-fcc17ed44391 service glance] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:41.005769 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-31ece642-660c-466b-b95d-fcc17ed44391 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:41.027180 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ffb0f-9da8-45aa-8e89-2f310631e0c0 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:41.029671 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bc2ffb0f-9da8-45aa-8e89-2f310631e0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:41.073291 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ece642-660c-466b-b95d-fcc17ed44391 service glance] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:41.108850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ffb0f-9da8-45aa-8e89-2f310631e0c0 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:41.115028 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8537c7-9cef-41eb-b940-db6b07da20cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:41.126822 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8537c7-9cef-41eb-b940-db6b07da20cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:41.126822 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8537c7-9cef-41eb-b940-db6b07da20cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:41.126822 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8537c7-9cef-41eb-b940-db6b07da20cd admin admin] PATH_INFO: `/v3/projects/edd1e72118e24b6d800e21705df04076` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:41.126822 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8537c7-9cef-41eb-b940-db6b07da20cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=edd1e72118e24b6d800e21705df04076)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:41.126822 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8537c7-9cef-41eb-b940-db6b07da20cd admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:41.130287 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454b785-3adb-482f-8820-43b46283307d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:41.131338 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454b785-3adb-482f-8820-43b46283307d service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:41.131640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454b785-3adb-482f-8820-43b46283307d service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:41.131922 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454b785-3adb-482f-8820-43b46283307d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:41.145146 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454b785-3adb-482f-8820-43b46283307d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:41.147381 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454b785-3adb-482f-8820-43b46283307d service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:41.159690 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1008/2016] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:41 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:41.273391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4a8537c7-9cef-41eb-b940-db6b07da20cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edd1e72118e24b6d800e21705df04076', 'request_id': 'req-4a8537c7-9cef-41eb-b940-db6b07da20cd'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:41.280579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4a8537c7-9cef-41eb-b940-db6b07da20cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edd1e72118e24b6d800e21705df04076', 'request_id': 'req-4a8537c7-9cef-41eb-b940-db6b07da20cd'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:41.469991 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4a8537c7-9cef-41eb-b940-db6b07da20cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edd1e72118e24b6d800e21705df04076', 'request_id': 'req-4a8537c7-9cef-41eb-b940-db6b07da20cd'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:41.489092 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4a8537c7-9cef-41eb-b940-db6b07da20cd admin admin] The token cache is being invalidate because project edd1e72118e24b6d800e21705df04076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:41.489478 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4a8537c7-9cef-41eb-b940-db6b07da20cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:41.490383 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4a8537c7-9cef-41eb-b940-db6b07da20cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:41.492697 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1009/2017] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:22:41 2022] DELETE /identity/v3/projects/edd1e72118e24b6d800e21705df04076 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:41.501677 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d3faa-270c-4ba7-ab79-1eec6dff448c None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:41.502218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d3faa-270c-4ba7-ab79-1eec6dff448c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:41.502322 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d3faa-270c-4ba7-ab79-1eec6dff448c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:41.522776 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8537c7-9cef-41eb-b940-db6b07da20cd admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:41.524171 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4a8537c7-9cef-41eb-b940-db6b07da20cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:41.524296 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-918d3faa-270c-4ba7-ab79-1eec6dff448c None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:41.525376 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-918d3faa-270c-4ba7-ab79-1eec6dff448c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:41.581466 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8537c7-9cef-41eb-b940-db6b07da20cd admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:41.585173 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31d20a-f588-4332-ae8f-3926e292d693 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:41.585817 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31d20a-f588-4332-ae8f-3926e292d693 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:41.586097 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31d20a-f588-4332-ae8f-3926e292d693 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:41.586400 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31d20a-f588-4332-ae8f-3926e292d693 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:41.590656 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8b31d20a-f588-4332-ae8f-3926e292d693 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:41.591183 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1009/2018] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:41.599146 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee2756-3d10-49f9-b4e8-bd2937d91c2c None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:41.599514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee2756-3d10-49f9-b4e8-bd2937d91c2c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:41.599798 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee2756-3d10-49f9-b4e8-bd2937d91c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:41.618275 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5cee2756-3d10-49f9-b4e8-bd2937d91c2c None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:41.619539 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5cee2756-3d10-49f9-b4e8-bd2937d91c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:41.628478 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1010/2019] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:41.632435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee2756-3d10-49f9-b4e8-bd2937d91c2c None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:41.641475 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee2756-3d10-49f9-b4e8-bd2937d91c2c None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:41.646544 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5509ec-ba7b-4466-9ef6-bc296951a180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:41.647201 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5509ec-ba7b-4466-9ef6-bc296951a180 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:41.647482 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5509ec-ba7b-4466-9ef6-bc296951a180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:41.647859 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5509ec-ba7b-4466-9ef6-bc296951a180 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:41.648695 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5509ec-ba7b-4466-9ef6-bc296951a180 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:22:41.649004 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5509ec-ba7b-4466-9ef6-bc296951a180 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:41.650692 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5509ec-ba7b-4466-9ef6-bc296951a180 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:41.657341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31d20a-f588-4332-ae8f-3926e292d693 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:41.658845 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31d20a-f588-4332-ae8f-3926e292d693 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:41.666201 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1011/2020] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:22:41.668711 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1010/2021] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:41 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:41.669232 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5509ec-ba7b-4466-9ef6-bc296951a180 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:41.679282 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5509ec-ba7b-4466-9ef6-bc296951a180 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:41.684412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556d9cb-5436-4a3e-95b1-d44cc7eaf2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:41.684548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556d9cb-5436-4a3e-95b1-d44cc7eaf2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:41.684820 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556d9cb-5436-4a3e-95b1-d44cc7eaf2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:41.685095 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556d9cb-5436-4a3e-95b1-d44cc7eaf2a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:41.685856 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556d9cb-5436-4a3e-95b1-d44cc7eaf2a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:41.687846 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556d9cb-5436-4a3e-95b1-d44cc7eaf2a6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:41.773933 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1012/2022] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:22:41 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:41.778709 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31d20a-f588-4332-ae8f-3926e292d693 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:41.789187 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31d20a-f588-4332-ae8f-3926e292d693 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:41.844370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33714d19-7895-4816-a9c5-b13816512316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:41.845188 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33714d19-7895-4816-a9c5-b13816512316 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:41.845465 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33714d19-7895-4816-a9c5-b13816512316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:41.845760 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33714d19-7895-4816-a9c5-b13816512316 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:41.846487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33714d19-7895-4816-a9c5-b13816512316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:41.848414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33714d19-7895-4816-a9c5-b13816512316 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:41.971250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1011/2023] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:22:41 2022] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:41.972396 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556d9cb-5436-4a3e-95b1-d44cc7eaf2a6 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:41.983305 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556d9cb-5436-4a3e-95b1-d44cc7eaf2a6 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:41.987848 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2389d1-e430-4819-881e-288c538b580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:41.988516 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2389d1-e430-4819-881e-288c538b580d admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:41.988801 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2389d1-e430-4819-881e-288c538b580d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:41.989132 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2389d1-e430-4819-881e-288c538b580d admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:41.989900 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2389d1-e430-4819-881e-288c538b580d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:41.991473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2389d1-e430-4819-881e-288c538b580d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:42.003575 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1013/2024] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:42.007716 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33714d19-7895-4816-a9c5-b13816512316 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:42.018418 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33714d19-7895-4816-a9c5-b13816512316 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:42.025116 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7074c5d-893f-4f0e-a8cc-cbc70639d45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:42.025788 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7074c5d-893f-4f0e-a8cc-cbc70639d45e admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:42.026071 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7074c5d-893f-4f0e-a8cc-cbc70639d45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:42.026463 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7074c5d-893f-4f0e-a8cc-cbc70639d45e admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:42.027458 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7074c5d-893f-4f0e-a8cc-cbc70639d45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:42.028750 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7074c5d-893f-4f0e-a8cc-cbc70639d45e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:42.039214 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1012/2025] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:42.043948 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2389d1-e430-4819-881e-288c538b580d admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:42.055071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2389d1-e430-4819-881e-288c538b580d admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:42.060376 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07343937-10ea-4e23-bbd9-2ac4e95306bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:42.061262 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07343937-10ea-4e23-bbd9-2ac4e95306bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:42.061547 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07343937-10ea-4e23-bbd9-2ac4e95306bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:42.061826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07343937-10ea-4e23-bbd9-2ac4e95306bd admin admin] PATH_INFO: `/v3/projects/48c147038a344660a63b8ca8607d06e9/users/b6b76362e2954e2db0eb44a577608e6a/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:42.076849 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07343937-10ea-4e23-bbd9-2ac4e95306bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c147038a344660a63b8ca8607d06e9, user_id=b6b76362e2954e2db0eb44a577608e6a, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:42.079713 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07343937-10ea-4e23-bbd9-2ac4e95306bd admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:42.201923 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1014/2026] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:42 2022] PUT /identity/v3/projects/48c147038a344660a63b8ca8607d06e9/users/b6b76362e2954e2db0eb44a577608e6a/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:42.215087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4603173-a9c5-4131-af13-87f03ab5451c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:42.215377 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4603173-a9c5-4131-af13-87f03ab5451c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:42.215654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4603173-a9c5-4131-af13-87f03ab5451c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:42.243854 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b4603173-a9c5-4131-af13-87f03ab5451c None None] MFA Rules not processed for user `b6b76362e2954e2db0eb44a577608e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:42.245028 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b4603173-a9c5-4131-af13-87f03ab5451c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:42.316654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1013/2027] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:42.322058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07343937-10ea-4e23-bbd9-2ac4e95306bd admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:42.381710 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07343937-10ea-4e23-bbd9-2ac4e95306bd admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:42.386549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f87c3-b134-4046-a2aa-4dea563a3342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:42.387831 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f87c3-b134-4046-a2aa-4dea563a3342 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:42.388120 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f87c3-b134-4046-a2aa-4dea563a3342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:42.388419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f87c3-b134-4046-a2aa-4dea563a3342 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:42.389106 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f87c3-b134-4046-a2aa-4dea563a3342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:42.391095 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f87c3-b134-4046-a2aa-4dea563a3342 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:42.573198 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1015/2028] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:22:42 2022] POST /identity/v3/projects => generated 381 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:42.577160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4603173-a9c5-4131-af13-87f03ab5451c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:42.613391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4603173-a9c5-4131-af13-87f03ab5451c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:42.680605 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f4c9a-4726-4494-9d41-b7242e2837c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:42.681126 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f4c9a-4726-4494-9d41-b7242e2837c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:42.681402 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f4c9a-4726-4494-9d41-b7242e2837c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:42.681677 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f4c9a-4726-4494-9d41-b7242e2837c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:42.682545 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f4c9a-4726-4494-9d41-b7242e2837c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:42.684489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f4c9a-4726-4494-9d41-b7242e2837c8 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:42.800348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1014/2029] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:22:42 2022] POST /identity/v3/users => generated 297 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:42.801573 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f87c3-b134-4046-a2aa-4dea563a3342 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:42.812742 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f87c3-b134-4046-a2aa-4dea563a3342 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:42.818198 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ffca5-8f49-4343-84ce-5cfe342c7a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:42.818932 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ffca5-8f49-4343-84ce-5cfe342c7a12 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:42.819232 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ffca5-8f49-4343-84ce-5cfe342c7a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:42.819502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ffca5-8f49-4343-84ce-5cfe342c7a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:42.820273 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ffca5-8f49-4343-84ce-5cfe342c7a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:42.825695 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ffca5-8f49-4343-84ce-5cfe342c7a12 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:42.834845 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1016/2030] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:42.842399 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f4c9a-4726-4494-9d41-b7242e2837c8 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:42.852603 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f4c9a-4726-4494-9d41-b7242e2837c8 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:42.857706 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62190b-b094-481c-a089-9b9ca40e074b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:42.858643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62190b-b094-481c-a089-9b9ca40e074b admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:42.858922 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62190b-b094-481c-a089-9b9ca40e074b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:42.861024 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62190b-b094-481c-a089-9b9ca40e074b admin admin] PATH_INFO: `/v3/projects/3adbb097ade248a097e8c63aa410e439/users/281f7f96a7c5422e9b6c99b37578eb24/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:42.878158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62190b-b094-481c-a089-9b9ca40e074b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3adbb097ade248a097e8c63aa410e439, user_id=281f7f96a7c5422e9b6c99b37578eb24, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:42.880940 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62190b-b094-481c-a089-9b9ca40e074b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:43.024535 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1015/2031] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:42 2022] PUT /identity/v3/projects/3adbb097ade248a097e8c63aa410e439/users/281f7f96a7c5422e9b6c99b37578eb24/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:43.028467 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ffca5-8f49-4343-84ce-5cfe342c7a12 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:43.038882 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ffca5-8f49-4343-84ce-5cfe342c7a12 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:43.102718 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e888e8-eaad-4278-8491-ecdf28cba6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:43.103393 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e888e8-eaad-4278-8491-ecdf28cba6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:43.103677 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e888e8-eaad-4278-8491-ecdf28cba6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:43.103954 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e888e8-eaad-4278-8491-ecdf28cba6d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:43.104713 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e888e8-eaad-4278-8491-ecdf28cba6d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:43.106924 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e888e8-eaad-4278-8491-ecdf28cba6d3 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:43.116917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1017/2032] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:43.121087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62190b-b094-481c-a089-9b9ca40e074b admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:43.131900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62190b-b094-481c-a089-9b9ca40e074b admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:43.136561 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7a035-7bd1-490f-ba39-7576defd2a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:43.137490 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7a035-7bd1-490f-ba39-7576defd2a70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:43.137760 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7a035-7bd1-490f-ba39-7576defd2a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:43.138036 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7a035-7bd1-490f-ba39-7576defd2a70 admin admin] PATH_INFO: `/v3/projects/3adbb097ade248a097e8c63aa410e439/users/281f7f96a7c5422e9b6c99b37578eb24/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:43.140024 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca7a035-7bd1-490f-ba39-7576defd2a70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3adbb097ade248a097e8c63aa410e439, user_id=281f7f96a7c5422e9b6c99b37578eb24, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:43.142741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca7a035-7bd1-490f-ba39-7576defd2a70 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:43.153477 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1016/2033] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:43 2022] PUT /identity/v3/projects/3adbb097ade248a097e8c63aa410e439/users/281f7f96a7c5422e9b6c99b37578eb24/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:43.163703 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015932ba-89d0-4bee-add9-78007f5f8188 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:43.164098 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015932ba-89d0-4bee-add9-78007f5f8188 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:43.164414 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015932ba-89d0-4bee-add9-78007f5f8188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:43.190613 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-015932ba-89d0-4bee-add9-78007f5f8188 None None] MFA Rules not processed for user `281f7f96a7c5422e9b6c99b37578eb24`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:43.191803 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-015932ba-89d0-4bee-add9-78007f5f8188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:43.265872 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1018/2034] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:43.277826 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7a035-7bd1-490f-ba39-7576defd2a70 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:43.279526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cca7a035-7bd1-490f-ba39-7576defd2a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:43.336366 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7a035-7bd1-490f-ba39-7576defd2a70 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:43.340695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dc77d-1588-41ad-9f76-22ed10c497d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:43.341352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dc77d-1588-41ad-9f76-22ed10c497d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:43.341631 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dc77d-1588-41ad-9f76-22ed10c497d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:43.341922 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dc77d-1588-41ad-9f76-22ed10c497d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:43.351297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2dc77d-1588-41ad-9f76-22ed10c497d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:43.352818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2dc77d-1588-41ad-9f76-22ed10c497d5 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:43.363120 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1017/2035] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:44.410626 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015932ba-89d0-4bee-add9-78007f5f8188 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:44.476641 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015932ba-89d0-4bee-add9-78007f5f8188 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:44.482167 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c103a-f242-45a0-860c-fe0ebaf52b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:44.483156 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c103a-f242-45a0-860c-fe0ebaf52b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:44.483465 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c103a-f242-45a0-860c-fe0ebaf52b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:44.483941 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c103a-f242-45a0-860c-fe0ebaf52b49 admin admin] PATH_INFO: `/v3/users/b6b76362e2954e2db0eb44a577608e6a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:44.485421 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c103a-f242-45a0-860c-fe0ebaf52b49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6b76362e2954e2db0eb44a577608e6a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:44.487649 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c103a-f242-45a0-860c-fe0ebaf52b49 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:44.729814 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-005c103a-f242-45a0-860c-fe0ebaf52b49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6b76362e2954e2db0eb44a577608e6a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:44.829915 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-005c103a-f242-45a0-860c-fe0ebaf52b49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6b76362e2954e2db0eb44a577608e6a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:44.830560 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-005c103a-f242-45a0-860c-fe0ebaf52b49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6b76362e2954e2db0eb44a577608e6a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:44.850327 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-005c103a-f242-45a0-860c-fe0ebaf52b49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6b76362e2954e2db0eb44a577608e6a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:44.850327 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-005c103a-f242-45a0-860c-fe0ebaf52b49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6b76362e2954e2db0eb44a577608e6a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:44.863464 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1019/2036] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:22:44 2022] DELETE /identity/v3/users/b6b76362e2954e2db0eb44a577608e6a => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:44.868312 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedac1c-2f2b-4324-b770-93cf8ce524d4 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:44.868819 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedac1c-2f2b-4324-b770-93cf8ce524d4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:44.868908 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedac1c-2f2b-4324-b770-93cf8ce524d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:44.890560 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9bedac1c-2f2b-4324-b770-93cf8ce524d4 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:44.892004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9bedac1c-2f2b-4324-b770-93cf8ce524d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:44.958375 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1018/2037] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:44.982941 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c103a-f242-45a0-860c-fe0ebaf52b49 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:44.982941 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-005c103a-f242-45a0-860c-fe0ebaf52b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:45.044614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c103a-f242-45a0-860c-fe0ebaf52b49 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:45.048458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226e151-2825-4b6b-ad98-55ade45c08e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:45.049106 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226e151-2825-4b6b-ad98-55ade45c08e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:45.049395 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226e151-2825-4b6b-ad98-55ade45c08e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:45.049667 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226e151-2825-4b6b-ad98-55ade45c08e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:45.058830 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226e151-2825-4b6b-ad98-55ade45c08e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:45.060272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226e151-2825-4b6b-ad98-55ade45c08e8 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:45.069620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1020/2038] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:22:45.454828 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bedac1c-2f2b-4324-b770-93cf8ce524d4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:45.456481 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9bedac1c-2f2b-4324-b770-93cf8ce524d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:45.474508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bedac1c-2f2b-4324-b770-93cf8ce524d4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:45.479345 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee820a47-146e-48ba-a35e-b03cfd9156c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:45.481150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee820a47-146e-48ba-a35e-b03cfd9156c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:45.481604 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee820a47-146e-48ba-a35e-b03cfd9156c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:45.481804 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee820a47-146e-48ba-a35e-b03cfd9156c2 admin admin] PATH_INFO: `/v3/projects/48c147038a344660a63b8ca8607d06e9` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:45.483470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee820a47-146e-48ba-a35e-b03cfd9156c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48c147038a344660a63b8ca8607d06e9)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:45.485809 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee820a47-146e-48ba-a35e-b03cfd9156c2 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:45.658529 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ee820a47-146e-48ba-a35e-b03cfd9156c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48c147038a344660a63b8ca8607d06e9', 'request_id': 'req-ee820a47-146e-48ba-a35e-b03cfd9156c2'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:45.664572 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ee820a47-146e-48ba-a35e-b03cfd9156c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48c147038a344660a63b8ca8607d06e9', 'request_id': 'req-ee820a47-146e-48ba-a35e-b03cfd9156c2'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:45.762198 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ee820a47-146e-48ba-a35e-b03cfd9156c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48c147038a344660a63b8ca8607d06e9', 'request_id': 'req-ee820a47-146e-48ba-a35e-b03cfd9156c2'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:45.774602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ee820a47-146e-48ba-a35e-b03cfd9156c2 admin admin] The token cache is being invalidate because project 48c147038a344660a63b8ca8607d06e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:45.779304 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ee820a47-146e-48ba-a35e-b03cfd9156c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:45.779304 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ee820a47-146e-48ba-a35e-b03cfd9156c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:45.779304 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1019/2039] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:22:45 2022] DELETE /identity/v3/projects/48c147038a344660a63b8ca8607d06e9 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:45.781867 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226e151-2825-4b6b-ad98-55ade45c08e8 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:45.791486 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226e151-2825-4b6b-ad98-55ade45c08e8 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:45.858556 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9abec2-3eaa-48a8-8c01-611997ddb37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:45.858556 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9abec2-3eaa-48a8-8c01-611997ddb37e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:45.862815 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9abec2-3eaa-48a8-8c01-611997ddb37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:45.862815 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9abec2-3eaa-48a8-8c01-611997ddb37e admin admin] PATH_INFO: `/v3/users/281f7f96a7c5422e9b6c99b37578eb24` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:45.862815 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9abec2-3eaa-48a8-8c01-611997ddb37e admin admin] RBAC: Authorizing `identity:delete_user(user_id=281f7f96a7c5422e9b6c99b37578eb24)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:45.862815 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9abec2-3eaa-48a8-8c01-611997ddb37e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:45.888858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee820a47-146e-48ba-a35e-b03cfd9156c2 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:45.890370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ee820a47-146e-48ba-a35e-b03cfd9156c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:45.903622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee820a47-146e-48ba-a35e-b03cfd9156c2 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:45.908450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970c1ad-6512-44f6-865c-250c6d6d0c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:45.909214 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970c1ad-6512-44f6-865c-250c6d6d0c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:45.909494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970c1ad-6512-44f6-865c-250c6d6d0c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:45.909765 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970c1ad-6512-44f6-865c-250c6d6d0c26 admin admin] PATH_INFO: `/v3/users/f58d23280fbb4e569875c576f6c0286f` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:45.910985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970c1ad-6512-44f6-865c-250c6d6d0c26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f58d23280fbb4e569875c576f6c0286f)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:45.912887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970c1ad-6512-44f6-865c-250c6d6d0c26 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:46.180754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6b9abec2-3eaa-48a8-8c01-611997ddb37e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '281f7f96a7c5422e9b6c99b37578eb24'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:46.198507 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4970c1ad-6512-44f6-865c-250c6d6d0c26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f58d23280fbb4e569875c576f6c0286f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:46.212614 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4970c1ad-6512-44f6-865c-250c6d6d0c26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f58d23280fbb4e569875c576f6c0286f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:46.213290 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4970c1ad-6512-44f6-865c-250c6d6d0c26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f58d23280fbb4e569875c576f6c0286f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:46.213893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4970c1ad-6512-44f6-865c-250c6d6d0c26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f58d23280fbb4e569875c576f6c0286f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:46.220675 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4970c1ad-6512-44f6-865c-250c6d6d0c26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f58d23280fbb4e569875c576f6c0286f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:46.298158 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6b9abec2-3eaa-48a8-8c01-611997ddb37e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '281f7f96a7c5422e9b6c99b37578eb24'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:46.298712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6b9abec2-3eaa-48a8-8c01-611997ddb37e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '281f7f96a7c5422e9b6c99b37578eb24'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:46.311223 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6b9abec2-3eaa-48a8-8c01-611997ddb37e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '281f7f96a7c5422e9b6c99b37578eb24'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:46.311852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6b9abec2-3eaa-48a8-8c01-611997ddb37e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '281f7f96a7c5422e9b6c99b37578eb24'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:46.323533 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1021/2040] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:22:45 2022] DELETE /identity/v3/users/281f7f96a7c5422e9b6c99b37578eb24 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:46.395928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1020/2041] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:22:45 2022] DELETE /identity/v3/users/f58d23280fbb4e569875c576f6c0286f => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:46.401093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180ed88-e25e-4268-9fb2-1b5025a44a92 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:46.401383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180ed88-e25e-4268-9fb2-1b5025a44a92 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:46.401680 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180ed88-e25e-4268-9fb2-1b5025a44a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:46.422015 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d180ed88-e25e-4268-9fb2-1b5025a44a92 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:46.423267 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d180ed88-e25e-4268-9fb2-1b5025a44a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:46.482846 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1022/2042] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:46.492272 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970c1ad-6512-44f6-865c-250c6d6d0c26 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:46.493661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4970c1ad-6512-44f6-865c-250c6d6d0c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:46.558312 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970c1ad-6512-44f6-865c-250c6d6d0c26 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:46.578753 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef21839-bcdd-4901-a33e-9ec607a7ecba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:46.579408 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef21839-bcdd-4901-a33e-9ec607a7ecba service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:46.579699 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef21839-bcdd-4901-a33e-9ec607a7ecba service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:46.579975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef21839-bcdd-4901-a33e-9ec607a7ecba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:46.591548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef21839-bcdd-4901-a33e-9ec607a7ecba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:46.593131 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef21839-bcdd-4901-a33e-9ec607a7ecba service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:46.603445 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1021/2043] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:46.844557 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180ed88-e25e-4268-9fb2-1b5025a44a92 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:46.846191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d180ed88-e25e-4268-9fb2-1b5025a44a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:46.866241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180ed88-e25e-4268-9fb2-1b5025a44a92 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:46.884769 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a75e6-f358-4c35-b623-b09bacec480a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:46.885723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a75e6-f358-4c35-b623-b09bacec480a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:46.886615 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a75e6-f358-4c35-b623-b09bacec480a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:46.886615 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a75e6-f358-4c35-b623-b09bacec480a admin admin] PATH_INFO: `/v3/projects/3adbb097ade248a097e8c63aa410e439` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:46.890963 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a75e6-f358-4c35-b623-b09bacec480a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3adbb097ade248a097e8c63aa410e439)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:46.893835 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a75e6-f358-4c35-b623-b09bacec480a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:47.029303 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ba6a75e6-f358-4c35-b623-b09bacec480a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3adbb097ade248a097e8c63aa410e439', 'request_id': 'req-ba6a75e6-f358-4c35-b623-b09bacec480a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:47.109536 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ba6a75e6-f358-4c35-b623-b09bacec480a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3adbb097ade248a097e8c63aa410e439', 'request_id': 'req-ba6a75e6-f358-4c35-b623-b09bacec480a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:47.116429 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ba6a75e6-f358-4c35-b623-b09bacec480a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3adbb097ade248a097e8c63aa410e439', 'request_id': 'req-ba6a75e6-f358-4c35-b623-b09bacec480a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:47.127302 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ba6a75e6-f358-4c35-b623-b09bacec480a admin admin] The token cache is being invalidate because project 3adbb097ade248a097e8c63aa410e439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:47.127588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ba6a75e6-f358-4c35-b623-b09bacec480a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:47.133295 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ba6a75e6-f358-4c35-b623-b09bacec480a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:47.135175 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1023/2044] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:22:46 2022] DELETE /identity/v3/projects/3adbb097ade248a097e8c63aa410e439 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:47.140348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b73822-1481-40e1-b568-9ed06c4c5c3b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:47.140806 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b73822-1481-40e1-b568-9ed06c4c5c3b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:47.140894 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b73822-1481-40e1-b568-9ed06c4c5c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:47.165187 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a75e6-f358-4c35-b623-b09bacec480a admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:47.166319 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ba6a75e6-f358-4c35-b623-b09bacec480a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:47.172202 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a8b73822-1481-40e1-b568-9ed06c4c5c3b None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:47.173416 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a8b73822-1481-40e1-b568-9ed06c4c5c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:47.257900 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a75e6-f358-4c35-b623-b09bacec480a admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:47.264166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ee71e-8f3e-4306-a2db-bf9217e23b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:47.265320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ee71e-8f3e-4306-a2db-bf9217e23b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:47.265605 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ee71e-8f3e-4306-a2db-bf9217e23b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:47.265883 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ee71e-8f3e-4306-a2db-bf9217e23b96 admin admin] PATH_INFO: `/v3/projects/8af328b8403e46cdbb110f019219db2b` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:47.267150 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ee71e-8f3e-4306-a2db-bf9217e23b96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8af328b8403e46cdbb110f019219db2b)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:47.269204 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1022/2045] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:47.270313 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ee71e-8f3e-4306-a2db-bf9217e23b96 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:47.279154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23d2b5-862b-45a7-b78d-8d346e4928b7 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:47.279451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23d2b5-862b-45a7-b78d-8d346e4928b7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:47.279740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23d2b5-862b-45a7-b78d-8d346e4928b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:47.297892 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-2c23d2b5-862b-45a7-b78d-8d346e4928b7 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:47.299223 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2c23d2b5-862b-45a7-b78d-8d346e4928b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:47.308110 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1023/2046] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:47.313799 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23d2b5-862b-45a7-b78d-8d346e4928b7 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:47.322054 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23d2b5-862b-45a7-b78d-8d346e4928b7 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:47.327809 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30685925-c88e-40f5-850c-c847edfe7b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:47.328509 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30685925-c88e-40f5-850c-c847edfe7b40 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:47.328795 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30685925-c88e-40f5-850c-c847edfe7b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:47.329074 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30685925-c88e-40f5-850c-c847edfe7b40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:47.329874 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30685925-c88e-40f5-850c-c847edfe7b40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:22:47.330215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30685925-c88e-40f5-850c-c847edfe7b40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:47.331869 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30685925-c88e-40f5-850c-c847edfe7b40 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:47.345603 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1024/2047] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:22:47.349352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30685925-c88e-40f5-850c-c847edfe7b40 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:47.364256 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30685925-c88e-40f5-850c-c847edfe7b40 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:47.370295 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca5356-4030-45b2-982e-f9739c43f2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:47.372073 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca5356-4030-45b2-982e-f9739c43f2a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:47.372436 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca5356-4030-45b2-982e-f9739c43f2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:47.372784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca5356-4030-45b2-982e-f9739c43f2a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:47.373555 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca5356-4030-45b2-982e-f9739c43f2a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:47.375797 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca5356-4030-45b2-982e-f9739c43f2a1 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:47.414311 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f27ee71e-8f3e-4306-a2db-bf9217e23b96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8af328b8403e46cdbb110f019219db2b', 'request_id': 'req-f27ee71e-8f3e-4306-a2db-bf9217e23b96'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:47.482583 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1025/2048] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:22:47 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:47.483578 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca5356-4030-45b2-982e-f9739c43f2a1 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:47.485207 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-65ca5356-4030-45b2-982e-f9739c43f2a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:47.510221 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f27ee71e-8f3e-4306-a2db-bf9217e23b96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8af328b8403e46cdbb110f019219db2b', 'request_id': 'req-f27ee71e-8f3e-4306-a2db-bf9217e23b96'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:47.518527 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f27ee71e-8f3e-4306-a2db-bf9217e23b96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8af328b8403e46cdbb110f019219db2b', 'request_id': 'req-f27ee71e-8f3e-4306-a2db-bf9217e23b96'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:47.534207 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f27ee71e-8f3e-4306-a2db-bf9217e23b96 admin admin] The token cache is being invalidate because project 8af328b8403e46cdbb110f019219db2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:47.534508 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f27ee71e-8f3e-4306-a2db-bf9217e23b96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:47.535185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f27ee71e-8f3e-4306-a2db-bf9217e23b96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:47.537022 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1024/2049] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:22:47 2022] DELETE /identity/v3/projects/8af328b8403e46cdbb110f019219db2b => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:47.537763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ee71e-8f3e-4306-a2db-bf9217e23b96 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:47.539066 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f27ee71e-8f3e-4306-a2db-bf9217e23b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:47.553788 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca5356-4030-45b2-982e-f9739c43f2a1 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:47.559771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d5ae0-aeab-4be7-b519-31c5f9df0a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:47.560843 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d5ae0-aeab-4be7-b519-31c5f9df0a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:47.561259 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d5ae0-aeab-4be7-b519-31c5f9df0a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:47.561536 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d5ae0-aeab-4be7-b519-31c5f9df0a58 admin admin] PATH_INFO: `/v3/users/ad6d4ac939d640fc9c2acb8beb119525` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:47.562818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d5ae0-aeab-4be7-b519-31c5f9df0a58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad6d4ac939d640fc9c2acb8beb119525)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:47.564895 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d5ae0-aeab-4be7-b519-31c5f9df0a58 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:47.610867 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ee71e-8f3e-4306-a2db-bf9217e23b96 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:47.615653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ae9ce-b2ac-459f-859b-a32f6f693cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:47.616319 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ae9ce-b2ac-459f-859b-a32f6f693cca admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:47.616616 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ae9ce-b2ac-459f-859b-a32f6f693cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:47.617154 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ae9ce-b2ac-459f-859b-a32f6f693cca admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:47.617840 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ae9ce-b2ac-459f-859b-a32f6f693cca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:47.619789 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ae9ce-b2ac-459f-859b-a32f6f693cca admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:47.768412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1025/2050] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:22:47 2022] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:47.769507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ae9ce-b2ac-459f-859b-a32f6f693cca admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:47.771149 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b63ae9ce-b2ac-459f-859b-a32f6f693cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:47.783046 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ae9ce-b2ac-459f-859b-a32f6f693cca admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:47.788385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e521c75-15c2-44d8-9ba7-bcf04f018b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:47.794071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e521c75-15c2-44d8-9ba7-bcf04f018b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:47.794071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e521c75-15c2-44d8-9ba7-bcf04f018b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:47.794071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e521c75-15c2-44d8-9ba7-bcf04f018b01 admin admin] PATH_INFO: `/v3/users/1b41c91feda140dbafbad3cd0e5f5c5d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:47.794071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e521c75-15c2-44d8-9ba7-bcf04f018b01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b41c91feda140dbafbad3cd0e5f5c5d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:47.794071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e521c75-15c2-44d8-9ba7-bcf04f018b01 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:47.805738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c67d5ae0-aeab-4be7-b519-31c5f9df0a58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad6d4ac939d640fc9c2acb8beb119525'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:47.822634 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c67d5ae0-aeab-4be7-b519-31c5f9df0a58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad6d4ac939d640fc9c2acb8beb119525'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:47.822634 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c67d5ae0-aeab-4be7-b519-31c5f9df0a58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad6d4ac939d640fc9c2acb8beb119525'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:47.822634 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c67d5ae0-aeab-4be7-b519-31c5f9df0a58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad6d4ac939d640fc9c2acb8beb119525'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:47.826450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c67d5ae0-aeab-4be7-b519-31c5f9df0a58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad6d4ac939d640fc9c2acb8beb119525'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:47.956253 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1026/2051] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:22:47 2022] DELETE /identity/v3/users/ad6d4ac939d640fc9c2acb8beb119525 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:47.957205 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d5ae0-aeab-4be7-b519-31c5f9df0a58 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:47.958593 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c67d5ae0-aeab-4be7-b519-31c5f9df0a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:47.986511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1e521c75-15c2-44d8-9ba7-bcf04f018b01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b41c91feda140dbafbad3cd0e5f5c5d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:48.023806 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d5ae0-aeab-4be7-b519-31c5f9df0a58 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:48.029361 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f791c-1493-4bac-bd19-3da2d19e3b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:48.030040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f791c-1493-4bac-bd19-3da2d19e3b3c admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:48.030356 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f791c-1493-4bac-bd19-3da2d19e3b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:48.030634 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f791c-1493-4bac-bd19-3da2d19e3b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:48.031401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f791c-1493-4bac-bd19-3da2d19e3b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:48.032995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f791c-1493-4bac-bd19-3da2d19e3b3c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:48.043670 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1027/2052] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:48.044855 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2203c49-2a68-4d9f-8d19-96edfe345a9f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:48.045144 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2203c49-2a68-4d9f-8d19-96edfe345a9f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:48.045424 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2203c49-2a68-4d9f-8d19-96edfe345a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:48.064629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a2203c49-2a68-4d9f-8d19-96edfe345a9f None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:48.065865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a2203c49-2a68-4d9f-8d19-96edfe345a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:48.074158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1028/2053] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:48.074900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2203c49-2a68-4d9f-8d19-96edfe345a9f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:48.075535 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1e521c75-15c2-44d8-9ba7-bcf04f018b01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b41c91feda140dbafbad3cd0e5f5c5d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:48.076525 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1e521c75-15c2-44d8-9ba7-bcf04f018b01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b41c91feda140dbafbad3cd0e5f5c5d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:48.084823 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2203c49-2a68-4d9f-8d19-96edfe345a9f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:48.089613 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33647075-059d-4324-80d5-5be99f5ac8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:48.090309 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33647075-059d-4324-80d5-5be99f5ac8ce admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:48.090413 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1e521c75-15c2-44d8-9ba7-bcf04f018b01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b41c91feda140dbafbad3cd0e5f5c5d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:48.090591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33647075-059d-4324-80d5-5be99f5ac8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:48.090861 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33647075-059d-4324-80d5-5be99f5ac8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:48.091300 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1e521c75-15c2-44d8-9ba7-bcf04f018b01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b41c91feda140dbafbad3cd0e5f5c5d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:48.091581 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33647075-059d-4324-80d5-5be99f5ac8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:48.093170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33647075-059d-4324-80d5-5be99f5ac8ce admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:48.104166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1029/2054] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:48.107798 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1026/2055] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:22:47 2022] DELETE /identity/v3/users/1b41c91feda140dbafbad3cd0e5f5c5d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:48.107929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33647075-059d-4324-80d5-5be99f5ac8ce admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:48.108936 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e521c75-15c2-44d8-9ba7-bcf04f018b01 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:48.109933 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-33647075-059d-4324-80d5-5be99f5ac8ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:48.110120 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1e521c75-15c2-44d8-9ba7-bcf04f018b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:48.177224 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33647075-059d-4324-80d5-5be99f5ac8ce admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:48.178647 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e521c75-15c2-44d8-9ba7-bcf04f018b01 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:48.184747 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3495a-4d39-4376-97cb-ec276c70560c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:48.185715 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3495a-4d39-4376-97cb-ec276c70560c admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:48.186001 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3495a-4d39-4376-97cb-ec276c70560c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:48.186317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3495a-4d39-4376-97cb-ec276c70560c admin admin] PATH_INFO: `/v3/projects/bf006e9d68304428b42387e1dbf2369a/users/53bfaa101108411dbe19fcbf4311d05f/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:48.203304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3495a-4d39-4376-97cb-ec276c70560c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf006e9d68304428b42387e1dbf2369a, user_id=53bfaa101108411dbe19fcbf4311d05f, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:48.206405 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3495a-4d39-4376-97cb-ec276c70560c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:48.229134 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468dee1-6e89-4edb-9c97-4ccfe8d423aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:48.229800 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468dee1-6e89-4edb-9c97-4ccfe8d423aa service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:48.230726 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468dee1-6e89-4edb-9c97-4ccfe8d423aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:48.231031 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468dee1-6e89-4edb-9c97-4ccfe8d423aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:48.232813 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4468dee1-6e89-4edb-9c97-4ccfe8d423aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:48.244212 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468dee1-6e89-4edb-9c97-4ccfe8d423aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:48.245816 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468dee1-6e89-4edb-9c97-4ccfe8d423aa service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:48.255772 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1030/2056] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:48.305513 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1027/2057] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:48 2022] PUT /identity/v3/projects/bf006e9d68304428b42387e1dbf2369a/users/53bfaa101108411dbe19fcbf4311d05f/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:48.311635 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373011d-ff75-4e87-84ff-bc0da61b9cef None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:48.311923 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373011d-ff75-4e87-84ff-bc0da61b9cef None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:48.312267 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373011d-ff75-4e87-84ff-bc0da61b9cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:48.332907 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-8373011d-ff75-4e87-84ff-bc0da61b9cef None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:48.332907 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8373011d-ff75-4e87-84ff-bc0da61b9cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:48.392344 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1031/2058] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:48.402494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3495a-4d39-4376-97cb-ec276c70560c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:48.475278 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3495a-4d39-4376-97cb-ec276c70560c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:48.479677 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b4a16-8c31-445a-b3d4-3ebd3ad089b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:48.484377 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b4a16-8c31-445a-b3d4-3ebd3ad089b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:48.484657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b4a16-8c31-445a-b3d4-3ebd3ad089b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:48.484933 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b4a16-8c31-445a-b3d4-3ebd3ad089b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:48.494726 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b4a16-8c31-445a-b3d4-3ebd3ad089b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:48.496247 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b4a16-8c31-445a-b3d4-3ebd3ad089b7 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:48.506983 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1028/2059] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:48.682720 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373011d-ff75-4e87-84ff-bc0da61b9cef None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:48.685234 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8373011d-ff75-4e87-84ff-bc0da61b9cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:48.698599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373011d-ff75-4e87-84ff-bc0da61b9cef None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:48.704219 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fc92a-14f1-4e4d-91cf-cb51058c114a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:48.705124 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fc92a-14f1-4e4d-91cf-cb51058c114a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:48.705409 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fc92a-14f1-4e4d-91cf-cb51058c114a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:48.705687 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fc92a-14f1-4e4d-91cf-cb51058c114a admin admin] PATH_INFO: `/v3/projects/4672c7dbc1884c819ab8bc3aaeb17829` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:48.706960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fc92a-14f1-4e4d-91cf-cb51058c114a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4672c7dbc1884c819ab8bc3aaeb17829)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:48.708957 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fc92a-14f1-4e4d-91cf-cb51058c114a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:48.830315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a76fc92a-14f1-4e4d-91cf-cb51058c114a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4672c7dbc1884c819ab8bc3aaeb17829', 'request_id': 'req-a76fc92a-14f1-4e4d-91cf-cb51058c114a'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:48.838283 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a76fc92a-14f1-4e4d-91cf-cb51058c114a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4672c7dbc1884c819ab8bc3aaeb17829', 'request_id': 'req-a76fc92a-14f1-4e4d-91cf-cb51058c114a'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:48.927254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a76fc92a-14f1-4e4d-91cf-cb51058c114a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4672c7dbc1884c819ab8bc3aaeb17829', 'request_id': 'req-a76fc92a-14f1-4e4d-91cf-cb51058c114a'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:48.938360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a76fc92a-14f1-4e4d-91cf-cb51058c114a admin admin] The token cache is being invalidate because project 4672c7dbc1884c819ab8bc3aaeb17829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:48.938646 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a76fc92a-14f1-4e4d-91cf-cb51058c114a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:48.939483 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a76fc92a-14f1-4e4d-91cf-cb51058c114a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:48.940846 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1032/2060] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:22:48 2022] DELETE /identity/v3/projects/4672c7dbc1884c819ab8bc3aaeb17829 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:48.944859 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b4a16-8c31-445a-b3d4-3ebd3ad089b7 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:48.955684 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b4a16-8c31-445a-b3d4-3ebd3ad089b7 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:49.015801 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fc92a-14f1-4e4d-91cf-cb51058c114a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:49.017489 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43350397-fef4-427b-8266-d2ad0f84d951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:49.018420 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43350397-fef4-427b-8266-d2ad0f84d951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:49.018708 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43350397-fef4-427b-8266-d2ad0f84d951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:49.018993 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43350397-fef4-427b-8266-d2ad0f84d951 admin admin] PATH_INFO: `/v3/users/60f6c32dfc474f0ea62f47960ca5e5bb` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:49.020227 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43350397-fef4-427b-8266-d2ad0f84d951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60f6c32dfc474f0ea62f47960ca5e5bb)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:49.020935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a76fc92a-14f1-4e4d-91cf-cb51058c114a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:49.022514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43350397-fef4-427b-8266-d2ad0f84d951 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:49.052321 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fc92a-14f1-4e4d-91cf-cb51058c114a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:49.057373 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d40d6-c009-4c22-be34-e5a3d7e9ebee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:49.058912 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d40d6-c009-4c22-be34-e5a3d7e9ebee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:49.059268 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d40d6-c009-4c22-be34-e5a3d7e9ebee admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:49.059624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d40d6-c009-4c22-be34-e5a3d7e9ebee admin admin] PATH_INFO: `/v3/projects/28a18cc5692e478096446e7a316f276f` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:49.060885 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d40d6-c009-4c22-be34-e5a3d7e9ebee admin admin] RBAC: Authorizing `identity:delete_project(project_id=28a18cc5692e478096446e7a316f276f)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:49.064251 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d40d6-c009-4c22-be34-e5a3d7e9ebee admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:49.211183 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-43350397-fef4-427b-8266-d2ad0f84d951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60f6c32dfc474f0ea62f47960ca5e5bb'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:49.211768 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4c5d40d6-c009-4c22-be34-e5a3d7e9ebee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28a18cc5692e478096446e7a316f276f', 'request_id': 'req-4c5d40d6-c009-4c22-be34-e5a3d7e9ebee'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:49.219484 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4c5d40d6-c009-4c22-be34-e5a3d7e9ebee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28a18cc5692e478096446e7a316f276f', 'request_id': 'req-4c5d40d6-c009-4c22-be34-e5a3d7e9ebee'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:49.281491 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-43350397-fef4-427b-8266-d2ad0f84d951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60f6c32dfc474f0ea62f47960ca5e5bb'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:49.282208 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-43350397-fef4-427b-8266-d2ad0f84d951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60f6c32dfc474f0ea62f47960ca5e5bb'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:49.295691 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-43350397-fef4-427b-8266-d2ad0f84d951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60f6c32dfc474f0ea62f47960ca5e5bb'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:49.296452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-43350397-fef4-427b-8266-d2ad0f84d951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60f6c32dfc474f0ea62f47960ca5e5bb'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:49.309283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1029/2061] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:22:48 2022] DELETE /identity/v3/users/60f6c32dfc474f0ea62f47960ca5e5bb => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:49.400819 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4c5d40d6-c009-4c22-be34-e5a3d7e9ebee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28a18cc5692e478096446e7a316f276f', 'request_id': 'req-4c5d40d6-c009-4c22-be34-e5a3d7e9ebee'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:49.412422 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4c5d40d6-c009-4c22-be34-e5a3d7e9ebee admin admin] The token cache is being invalidate because project 28a18cc5692e478096446e7a316f276f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:49.412723 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4c5d40d6-c009-4c22-be34-e5a3d7e9ebee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:49.414839 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4c5d40d6-c009-4c22-be34-e5a3d7e9ebee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:49.415167 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1033/2062] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:22:49 2022] DELETE /identity/v3/projects/28a18cc5692e478096446e7a316f276f => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:49.420029 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43350397-fef4-427b-8266-d2ad0f84d951 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:49.421464 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-43350397-fef4-427b-8266-d2ad0f84d951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:49.487304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43350397-fef4-427b-8266-d2ad0f84d951 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:49.492270 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed20d1-0a4d-43ad-9e8d-5166710c7669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:49.493143 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed20d1-0a4d-43ad-9e8d-5166710c7669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:49.493419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed20d1-0a4d-43ad-9e8d-5166710c7669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:49.501153 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed20d1-0a4d-43ad-9e8d-5166710c7669 admin admin] PATH_INFO: `/v3/users/ae875a51b1ff4dd0a590eed247f05665` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:49.501153 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed20d1-0a4d-43ad-9e8d-5166710c7669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae875a51b1ff4dd0a590eed247f05665)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:49.501153 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed20d1-0a4d-43ad-9e8d-5166710c7669 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:49.706951 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5eed20d1-0a4d-43ad-9e8d-5166710c7669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae875a51b1ff4dd0a590eed247f05665'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:49.772453 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5eed20d1-0a4d-43ad-9e8d-5166710c7669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae875a51b1ff4dd0a590eed247f05665'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:49.773149 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5eed20d1-0a4d-43ad-9e8d-5166710c7669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae875a51b1ff4dd0a590eed247f05665'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:49.785458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5eed20d1-0a4d-43ad-9e8d-5166710c7669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae875a51b1ff4dd0a590eed247f05665'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:49.786886 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5eed20d1-0a4d-43ad-9e8d-5166710c7669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae875a51b1ff4dd0a590eed247f05665'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:49.802875 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1030/2063] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:22:49 2022] DELETE /identity/v3/users/ae875a51b1ff4dd0a590eed247f05665 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:49.868659 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d40d6-c009-4c22-be34-e5a3d7e9ebee admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:49.870382 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4c5d40d6-c009-4c22-be34-e5a3d7e9ebee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:49.967343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d40d6-c009-4c22-be34-e5a3d7e9ebee admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:50.025266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86548ea6-906c-468b-95c7-6b99af3ee138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:50.026043 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86548ea6-906c-468b-95c7-6b99af3ee138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:50.026382 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86548ea6-906c-468b-95c7-6b99af3ee138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:50.026661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86548ea6-906c-468b-95c7-6b99af3ee138 admin admin] PATH_INFO: `/v3/projects/8a19102deab342be92db3c461e8c6543` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:50.028377 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86548ea6-906c-468b-95c7-6b99af3ee138 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a19102deab342be92db3c461e8c6543)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:50.030446 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86548ea6-906c-468b-95c7-6b99af3ee138 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:50.134004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-86548ea6-906c-468b-95c7-6b99af3ee138 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a19102deab342be92db3c461e8c6543', 'request_id': 'req-86548ea6-906c-468b-95c7-6b99af3ee138'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:50.140825 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-86548ea6-906c-468b-95c7-6b99af3ee138 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a19102deab342be92db3c461e8c6543', 'request_id': 'req-86548ea6-906c-468b-95c7-6b99af3ee138'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:50.195779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-86548ea6-906c-468b-95c7-6b99af3ee138 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a19102deab342be92db3c461e8c6543', 'request_id': 'req-86548ea6-906c-468b-95c7-6b99af3ee138'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:50.221143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-86548ea6-906c-468b-95c7-6b99af3ee138 admin admin] The token cache is being invalidate because project 8a19102deab342be92db3c461e8c6543 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:50.221780 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-86548ea6-906c-468b-95c7-6b99af3ee138 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:50.222104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-86548ea6-906c-468b-95c7-6b99af3ee138 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:50.223914 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1034/2064] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:22:49 2022] DELETE /identity/v3/projects/8a19102deab342be92db3c461e8c6543 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:50.228590 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c847a-5508-499c-afaa-ea7f3e1265be None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:50.229061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c847a-5508-499c-afaa-ea7f3e1265be None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:50.229155 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c847a-5508-499c-afaa-ea7f3e1265be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:50.256297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91947e95-e830-4d3f-a5a6-fb676305012b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:50.256587 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91947e95-e830-4d3f-a5a6-fb676305012b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:50.256865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91947e95-e830-4d3f-a5a6-fb676305012b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:50.258604 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-f01c847a-5508-499c-afaa-ea7f3e1265be None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:50.259819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f01c847a-5508-499c-afaa-ea7f3e1265be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:50.293325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-91947e95-e830-4d3f-a5a6-fb676305012b None None] MFA Rules not processed for user `53bfaa101108411dbe19fcbf4311d05f`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:50.294880 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-91947e95-e830-4d3f-a5a6-fb676305012b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:50.331950 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1031/2065] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:50.332905 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c847a-5508-499c-afaa-ea7f3e1265be None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:50.334214 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f01c847a-5508-499c-afaa-ea7f3e1265be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:50.350610 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c847a-5508-499c-afaa-ea7f3e1265be None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:50.355654 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c994a14-09b0-4c58-9ac1-2499fdfc8065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:50.356519 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c994a14-09b0-4c58-9ac1-2499fdfc8065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:50.356798 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c994a14-09b0-4c58-9ac1-2499fdfc8065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:50.357280 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c994a14-09b0-4c58-9ac1-2499fdfc8065 admin admin] PATH_INFO: `/v3/projects/503ffcfe61994d2388ef4d7a189f228d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:50.358505 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c994a14-09b0-4c58-9ac1-2499fdfc8065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=503ffcfe61994d2388ef4d7a189f228d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:50.360971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c994a14-09b0-4c58-9ac1-2499fdfc8065 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:50.379803 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1035/2066] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:50.381615 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d34059-444d-4495-a6e4-340eb0fd99f6 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:50.381959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d34059-444d-4495-a6e4-340eb0fd99f6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:50.382325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d34059-444d-4495-a6e4-340eb0fd99f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:50.405099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-63d34059-444d-4495-a6e4-340eb0fd99f6 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:50.406340 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-63d34059-444d-4495-a6e4-340eb0fd99f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:50.414754 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1036/2067] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:50.415564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d34059-444d-4495-a6e4-340eb0fd99f6 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:50.419536 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-63d34059-444d-4495-a6e4-340eb0fd99f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:50.431630 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d34059-444d-4495-a6e4-340eb0fd99f6 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:50.436224 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d6b6b-1cb3-43be-aeec-c3e9bdd2846c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:50.436876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d6b6b-1cb3-43be-aeec-c3e9bdd2846c admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:50.437155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d6b6b-1cb3-43be-aeec-c3e9bdd2846c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:50.437427 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d6b6b-1cb3-43be-aeec-c3e9bdd2846c admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:50.438186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d6b6b-1cb3-43be-aeec-c3e9bdd2846c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:50.440093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d6b6b-1cb3-43be-aeec-c3e9bdd2846c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:50.481397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3c994a14-09b0-4c58-9ac1-2499fdfc8065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '503ffcfe61994d2388ef4d7a189f228d', 'request_id': 'req-3c994a14-09b0-4c58-9ac1-2499fdfc8065'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:50.554804 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1037/2068] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:22:50 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:50.554804 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d6b6b-1cb3-43be-aeec-c3e9bdd2846c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:50.555561 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3c994a14-09b0-4c58-9ac1-2499fdfc8065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '503ffcfe61994d2388ef4d7a189f228d', 'request_id': 'req-3c994a14-09b0-4c58-9ac1-2499fdfc8065'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:50.563829 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3c994a14-09b0-4c58-9ac1-2499fdfc8065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '503ffcfe61994d2388ef4d7a189f228d', 'request_id': 'req-3c994a14-09b0-4c58-9ac1-2499fdfc8065'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:50.575304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3c994a14-09b0-4c58-9ac1-2499fdfc8065 admin admin] The token cache is being invalidate because project 503ffcfe61994d2388ef4d7a189f228d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:50.575602 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3c994a14-09b0-4c58-9ac1-2499fdfc8065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:50.576305 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3c994a14-09b0-4c58-9ac1-2499fdfc8065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:50.578179 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1032/2069] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:22:50 2022] DELETE /identity/v3/projects/503ffcfe61994d2388ef4d7a189f228d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:50.578923 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c994a14-09b0-4c58-9ac1-2499fdfc8065 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:50.580208 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3c994a14-09b0-4c58-9ac1-2499fdfc8065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:50.624073 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d6b6b-1cb3-43be-aeec-c3e9bdd2846c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:50.629021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2177379-4444-4777-9ddf-eb0658085a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:50.629671 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2177379-4444-4777-9ddf-eb0658085a51 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:50.629951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2177379-4444-4777-9ddf-eb0658085a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:50.630255 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2177379-4444-4777-9ddf-eb0658085a51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:50.630973 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2177379-4444-4777-9ddf-eb0658085a51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:22:50.631273 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2177379-4444-4777-9ddf-eb0658085a51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:50.632905 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2177379-4444-4777-9ddf-eb0658085a51 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:50.644091 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1038/2070] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:22:50.645299 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac22d9-c2d9-4e9a-80e9-edcd26a2cf29 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:50.645589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac22d9-c2d9-4e9a-80e9-edcd26a2cf29 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:50.645867 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac22d9-c2d9-4e9a-80e9-edcd26a2cf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:50.652787 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c994a14-09b0-4c58-9ac1-2499fdfc8065 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:50.657505 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30886c18-d579-4a6e-a43d-9131abc3156e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:50.658203 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30886c18-d579-4a6e-a43d-9131abc3156e admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:50.658495 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30886c18-d579-4a6e-a43d-9131abc3156e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:50.658775 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30886c18-d579-4a6e-a43d-9131abc3156e admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:50.659464 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30886c18-d579-4a6e-a43d-9131abc3156e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:50.661386 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30886c18-d579-4a6e-a43d-9131abc3156e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:50.663875 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-99ac22d9-c2d9-4e9a-80e9-edcd26a2cf29 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:50.665057 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-99ac22d9-c2d9-4e9a-80e9-edcd26a2cf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:50.678310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1039/2071] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:50.678310 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac22d9-c2d9-4e9a-80e9-edcd26a2cf29 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:50.679383 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-99ac22d9-c2d9-4e9a-80e9-edcd26a2cf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:50.692160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac22d9-c2d9-4e9a-80e9-edcd26a2cf29 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:50.697074 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554dbfbb-2695-4e64-a611-49cd4a8379c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:50.697749 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554dbfbb-2695-4e64-a611-49cd4a8379c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:50.698027 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554dbfbb-2695-4e64-a611-49cd4a8379c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:50.698330 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554dbfbb-2695-4e64-a611-49cd4a8379c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:50.699821 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554dbfbb-2695-4e64-a611-49cd4a8379c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:50.701918 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554dbfbb-2695-4e64-a611-49cd4a8379c0 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:50.796230 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1033/2072] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:22:50 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:50.797811 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f980d8-97ce-4332-9913-5e21cd8804e3 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:50.798538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f980d8-97ce-4332-9913-5e21cd8804e3 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:50.798920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f980d8-97ce-4332-9913-5e21cd8804e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:50.818204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-28f980d8-97ce-4332-9913-5e21cd8804e3 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:50.819470 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-28f980d8-97ce-4332-9913-5e21cd8804e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:50.820249 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1040/2073] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:22:50 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:50.821074 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554dbfbb-2695-4e64-a611-49cd4a8379c0 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:50.910776 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554dbfbb-2695-4e64-a611-49cd4a8379c0 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:50.912096 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1034/2074] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:50.913085 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f980d8-97ce-4332-9913-5e21cd8804e3 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:50.923750 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f980d8-97ce-4332-9913-5e21cd8804e3 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:50.923958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19670d8-8e0c-402c-9a2b-b2934f03609e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:50.924844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19670d8-8e0c-402c-9a2b-b2934f03609e admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:50.925349 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19670d8-8e0c-402c-9a2b-b2934f03609e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:50.925902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19670d8-8e0c-402c-9a2b-b2934f03609e admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:50.926944 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19670d8-8e0c-402c-9a2b-b2934f03609e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:50.928738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3e68e-0e82-459e-98b5-6bbd17c20b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:50.929070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19670d8-8e0c-402c-9a2b-b2934f03609e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:50.930019 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3e68e-0e82-459e-98b5-6bbd17c20b0e admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:50.930704 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3e68e-0e82-459e-98b5-6bbd17c20b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:50.931158 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3e68e-0e82-459e-98b5-6bbd17c20b0e admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:50.932575 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3e68e-0e82-459e-98b5-6bbd17c20b0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:50.935379 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3e68e-0e82-459e-98b5-6bbd17c20b0e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:50.949732 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1041/2075] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:50.950972 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19670d8-8e0c-402c-9a2b-b2934f03609e admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:50.965868 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19670d8-8e0c-402c-9a2b-b2934f03609e admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:50.970833 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e204a-f13d-4ba2-b52d-72d9e3cb8b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:50.971863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e204a-f13d-4ba2-b52d-72d9e3cb8b29 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:50.971863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e204a-f13d-4ba2-b52d-72d9e3cb8b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:50.972157 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e204a-f13d-4ba2-b52d-72d9e3cb8b29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:50.972755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e204a-f13d-4ba2-b52d-72d9e3cb8b29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:22:50.973068 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e204a-f13d-4ba2-b52d-72d9e3cb8b29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:50.974736 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e204a-f13d-4ba2-b52d-72d9e3cb8b29 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:50.990320 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1042/2076] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:22:50.991935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e204a-f13d-4ba2-b52d-72d9e3cb8b29 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:51.005496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e204a-f13d-4ba2-b52d-72d9e3cb8b29 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:51.010329 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e250c-b419-4883-96b7-5cdd89e1382d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:51.011812 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e250c-b419-4883-96b7-5cdd89e1382d admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:51.012159 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e250c-b419-4883-96b7-5cdd89e1382d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:51.012504 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e250c-b419-4883-96b7-5cdd89e1382d admin admin] PATH_INFO: `/v3/projects/31b254f0d5844ff2815af14795100636/users/9f604dfadb914462a1e2fa1d7cf95d2b/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:51.028775 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e250c-b419-4883-96b7-5cdd89e1382d admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b254f0d5844ff2815af14795100636, user_id=9f604dfadb914462a1e2fa1d7cf95d2b, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:51.031723 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e250c-b419-4883-96b7-5cdd89e1382d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:51.131951 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1035/2077] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:22:50 2022] POST /identity/v3/users => generated 292 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:51.131951 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3e68e-0e82-459e-98b5-6bbd17c20b0e admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:51.139909 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3e68e-0e82-459e-98b5-6bbd17c20b0e admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:51.144563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662742c-cfcb-4a5d-9c73-1ab33f75830b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:51.145199 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662742c-cfcb-4a5d-9c73-1ab33f75830b admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:51.145495 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662742c-cfcb-4a5d-9c73-1ab33f75830b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:51.145750 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662742c-cfcb-4a5d-9c73-1ab33f75830b admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:51.146479 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662742c-cfcb-4a5d-9c73-1ab33f75830b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:51.148403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662742c-cfcb-4a5d-9c73-1ab33f75830b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:51.167908 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1043/2078] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:50 2022] PUT /identity/v3/projects/31b254f0d5844ff2815af14795100636/users/9f604dfadb914462a1e2fa1d7cf95d2b/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:51.168701 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e250c-b419-4883-96b7-5cdd89e1382d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:51.229276 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e250c-b419-4883-96b7-5cdd89e1382d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:51.233900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81a967-67a4-41ec-83de-0c1d9b986246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:51.234576 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81a967-67a4-41ec-83de-0c1d9b986246 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:51.234856 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81a967-67a4-41ec-83de-0c1d9b986246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:51.235132 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81a967-67a4-41ec-83de-0c1d9b986246 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:51.235857 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81a967-67a4-41ec-83de-0c1d9b986246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:51.237469 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81a967-67a4-41ec-83de-0c1d9b986246 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:51.248871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1044/2079] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:51.250087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81a967-67a4-41ec-83de-0c1d9b986246 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:51.260410 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81a967-67a4-41ec-83de-0c1d9b986246 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:51.265880 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0afcb6-cff8-47ce-ba0d-4a275f0fd370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:51.266562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0afcb6-cff8-47ce-ba0d-4a275f0fd370 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:51.266844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0afcb6-cff8-47ce-ba0d-4a275f0fd370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:51.267146 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0afcb6-cff8-47ce-ba0d-4a275f0fd370 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:51.267872 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0afcb6-cff8-47ce-ba0d-4a275f0fd370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:51.269458 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0afcb6-cff8-47ce-ba0d-4a275f0fd370 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:51.280084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1045/2080] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:51.280924 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0afcb6-cff8-47ce-ba0d-4a275f0fd370 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:51.289809 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1036/2081] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:22:51 2022] POST /identity/v3/projects => generated 369 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:51.290795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662742c-cfcb-4a5d-9c73-1ab33f75830b admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:51.291745 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0afcb6-cff8-47ce-ba0d-4a275f0fd370 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:51.356123 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7793a-0dde-4e34-85f5-c65c797338b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:51.356797 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7793a-0dde-4e34-85f5-c65c797338b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:51.357079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7793a-0dde-4e34-85f5-c65c797338b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:51.357351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7793a-0dde-4e34-85f5-c65c797338b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:51.358082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7793a-0dde-4e34-85f5-c65c797338b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:51.358852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662742c-cfcb-4a5d-9c73-1ab33f75830b admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:51.359792 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7793a-0dde-4e34-85f5-c65c797338b4 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:51.363688 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023df8a-0f78-47ba-b3d8-958f2b1e9617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:51.364572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023df8a-0f78-47ba-b3d8-958f2b1e9617 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:51.364853 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023df8a-0f78-47ba-b3d8-958f2b1e9617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:51.365124 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023df8a-0f78-47ba-b3d8-958f2b1e9617 admin admin] PATH_INFO: `/v3/projects/31b254f0d5844ff2815af14795100636/users/9f604dfadb914462a1e2fa1d7cf95d2b/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:51.367173 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023df8a-0f78-47ba-b3d8-958f2b1e9617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b254f0d5844ff2815af14795100636, user_id=9f604dfadb914462a1e2fa1d7cf95d2b, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:51.369814 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1046/2082] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:51.369923 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023df8a-0f78-47ba-b3d8-958f2b1e9617 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:51.371216 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7793a-0dde-4e34-85f5-c65c797338b4 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:51.381140 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1037/2083] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:51 2022] PUT /identity/v3/projects/31b254f0d5844ff2815af14795100636/users/9f604dfadb914462a1e2fa1d7cf95d2b/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:51.381360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7793a-0dde-4e34-85f5-c65c797338b4 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:51.381776 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023df8a-0f78-47ba-b3d8-958f2b1e9617 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:51.449467 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023df8a-0f78-47ba-b3d8-958f2b1e9617 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:51.454496 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1859e0f-c901-4976-85e4-403fd9127390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:51.455428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1859e0f-c901-4976-85e4-403fd9127390 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:51.455669 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21519396-f7d8-4b52-b23c-6cbd80be4ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:51.455802 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1859e0f-c901-4976-85e4-403fd9127390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:51.456117 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1859e0f-c901-4976-85e4-403fd9127390 admin admin] PATH_INFO: `/v3/projects/14bef94eb6d642d1adb9c83a4ff93ffa/users/8bb9f72d0faa46e1ab839c9ae6f29268/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:51.456709 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21519396-f7d8-4b52-b23c-6cbd80be4ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:51.457238 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21519396-f7d8-4b52-b23c-6cbd80be4ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:51.457622 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21519396-f7d8-4b52-b23c-6cbd80be4ce4 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:51.458478 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21519396-f7d8-4b52-b23c-6cbd80be4ce4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:51.460683 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21519396-f7d8-4b52-b23c-6cbd80be4ce4 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:51.471458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1859e0f-c901-4976-85e4-403fd9127390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14bef94eb6d642d1adb9c83a4ff93ffa, user_id=8bb9f72d0faa46e1ab839c9ae6f29268, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:51.474162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1859e0f-c901-4976-85e4-403fd9127390 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:51.575866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1047/2084] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:22:51 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:51.580596 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21519396-f7d8-4b52-b23c-6cbd80be4ce4 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:51.594714 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21519396-f7d8-4b52-b23c-6cbd80be4ce4 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:51.597706 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1038/2085] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:51 2022] PUT /identity/v3/projects/14bef94eb6d642d1adb9c83a4ff93ffa/users/8bb9f72d0faa46e1ab839c9ae6f29268/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:51.609318 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20aa2c5-5150-426b-ab18-67724a012cf0 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:51.609632 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20aa2c5-5150-426b-ab18-67724a012cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:51.609935 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20aa2c5-5150-426b-ab18-67724a012cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:51.639400 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-e20aa2c5-5150-426b-ab18-67724a012cf0 None None] MFA Rules not processed for user `8bb9f72d0faa46e1ab839c9ae6f29268`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:51.640621 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e20aa2c5-5150-426b-ab18-67724a012cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:51.654769 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661749e-c692-4c71-b0db-a6955a52b36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:51.655367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661749e-c692-4c71-b0db-a6955a52b36a admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:51.655643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661749e-c692-4c71-b0db-a6955a52b36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:51.655917 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661749e-c692-4c71-b0db-a6955a52b36a admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:51.656636 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661749e-c692-4c71-b0db-a6955a52b36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:51.658269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661749e-c692-4c71-b0db-a6955a52b36a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:51.668689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1048/2086] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:22:51.672322 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661749e-c692-4c71-b0db-a6955a52b36a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:51.682367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661749e-c692-4c71-b0db-a6955a52b36a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:51.688579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b2ec4-3138-415c-877a-50f0fc27622f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:51.688579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b2ec4-3138-415c-877a-50f0fc27622f admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:51.688579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b2ec4-3138-415c-877a-50f0fc27622f admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:51.688579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b2ec4-3138-415c-877a-50f0fc27622f admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:51.689283 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b2ec4-3138-415c-877a-50f0fc27622f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:51.690987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b2ec4-3138-415c-877a-50f0fc27622f admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:51.701903 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1049/2087] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:51.705892 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b2ec4-3138-415c-877a-50f0fc27622f admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:51.710360 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1039/2088] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:51.718474 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b2ec4-3138-415c-877a-50f0fc27622f admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:51.721867 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20aa2c5-5150-426b-ab18-67724a012cf0 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:51.724278 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27f438-958a-40a4-846d-28c00bfd3d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:51.725253 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27f438-958a-40a4-846d-28c00bfd3d4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:51.725966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27f438-958a-40a4-846d-28c00bfd3d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:51.725966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27f438-958a-40a4-846d-28c00bfd3d4b admin admin] PATH_INFO: `/v3/projects/4d728a3266f14792ad4feea58ccbf1f6/users/86bac93336f548f5b19b8789fe3d05ff/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:51.736367 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20aa2c5-5150-426b-ab18-67724a012cf0 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:51.740947 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40fda4-4c58-490d-8980-c538b768595d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:51.751951 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40fda4-4c58-490d-8980-c538b768595d admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:51.751951 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40fda4-4c58-490d-8980-c538b768595d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:51.751951 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40fda4-4c58-490d-8980-c538b768595d admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:51.751951 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40fda4-4c58-490d-8980-c538b768595d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:51.752456 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27f438-958a-40a4-846d-28c00bfd3d4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d728a3266f14792ad4feea58ccbf1f6, user_id=86bac93336f548f5b19b8789fe3d05ff, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:51.752546 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40fda4-4c58-490d-8980-c538b768595d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:51.752618 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27f438-958a-40a4-846d-28c00bfd3d4b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:51.852058 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1050/2089] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:51 2022] PUT /identity/v3/projects/4d728a3266f14792ad4feea58ccbf1f6/users/86bac93336f548f5b19b8789fe3d05ff/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:51.862155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7267d32-042a-4588-a371-0f1f4f5584cc None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:51.862449 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7267d32-042a-4588-a371-0f1f4f5584cc None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:51.862889 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7267d32-042a-4588-a371-0f1f4f5584cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:51.879459 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1040/2090] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:22:51 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:51.889074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40fda4-4c58-490d-8980-c538b768595d admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:51.890151 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c7267d32-042a-4588-a371-0f1f4f5584cc None None] MFA Rules not processed for user `86bac93336f548f5b19b8789fe3d05ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:51.891360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c7267d32-042a-4588-a371-0f1f4f5584cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:51.952590 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40fda4-4c58-490d-8980-c538b768595d admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:51.960331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1051/2091] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:51.961054 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afecf1d-6ca0-4a14-82da-e101882b8eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:51.961054 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afecf1d-6ca0-4a14-82da-e101882b8eab admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:51.961054 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afecf1d-6ca0-4a14-82da-e101882b8eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:51.961054 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afecf1d-6ca0-4a14-82da-e101882b8eab admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:51.961363 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afecf1d-6ca0-4a14-82da-e101882b8eab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:51.962271 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afecf1d-6ca0-4a14-82da-e101882b8eab admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:51.962459 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7267d32-042a-4588-a371-0f1f4f5584cc None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:51.975284 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7267d32-042a-4588-a371-0f1f4f5584cc None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:51.980644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe9431-4d35-40f1-974a-d2975c75077a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:51.981363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe9431-4d35-40f1-974a-d2975c75077a admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:51.990024 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe9431-4d35-40f1-974a-d2975c75077a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:51.990024 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe9431-4d35-40f1-974a-d2975c75077a admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:51.990024 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe9431-4d35-40f1-974a-d2975c75077a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:51.990024 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe9431-4d35-40f1-974a-d2975c75077a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:52.107612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1041/2092] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:22:51 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:52.107816 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1052/2093] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:22:51 2022] POST /identity/v3/projects => generated 369 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:52.109272 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe9431-4d35-40f1-974a-d2975c75077a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:52.110937 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afecf1d-6ca0-4a14-82da-e101882b8eab admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:52.121004 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afecf1d-6ca0-4a14-82da-e101882b8eab admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:52.182499 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe9431-4d35-40f1-974a-d2975c75077a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:52.186608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbad54-1241-45e8-bf18-bbb171f4c67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:52.187352 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbad54-1241-45e8-bf18-bbb171f4c67d admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:52.187636 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbad54-1241-45e8-bf18-bbb171f4c67d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:52.187916 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbad54-1241-45e8-bf18-bbb171f4c67d admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:52.188164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7fe00-a7b0-4647-80ee-d21ef1465c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:52.188753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbad54-1241-45e8-bf18-bbb171f4c67d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:52.189207 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7fe00-a7b0-4647-80ee-d21ef1465c71 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:52.189645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7fe00-a7b0-4647-80ee-d21ef1465c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:52.189927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7fe00-a7b0-4647-80ee-d21ef1465c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:52.190762 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7fe00-a7b0-4647-80ee-d21ef1465c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:52.190934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbad54-1241-45e8-bf18-bbb171f4c67d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:52.193190 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7fe00-a7b0-4647-80ee-d21ef1465c71 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:52.210253 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1053/2094] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:22:52.211177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7fe00-a7b0-4647-80ee-d21ef1465c71 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:52.222426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7fe00-a7b0-4647-80ee-d21ef1465c71 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:52.227273 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c60bf-d850-4080-8461-be84230e127d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:52.231312 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c60bf-d850-4080-8461-be84230e127d admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:52.231312 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c60bf-d850-4080-8461-be84230e127d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:52.231312 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c60bf-d850-4080-8461-be84230e127d admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:52.231312 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c60bf-d850-4080-8461-be84230e127d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:52.231312 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c60bf-d850-4080-8461-be84230e127d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:52.242177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1054/2095] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:52.247042 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c60bf-d850-4080-8461-be84230e127d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:52.258334 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c60bf-d850-4080-8461-be84230e127d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:52.265034 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1042/2096] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:22:52 2022] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:52.265225 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e319770-6ac8-4276-a909-ee3fe9a973b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:52.266196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e319770-6ac8-4276-a909-ee3fe9a973b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:52.266590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e319770-6ac8-4276-a909-ee3fe9a973b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:52.266991 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e319770-6ac8-4276-a909-ee3fe9a973b7 admin admin] PATH_INFO: `/v3/projects/86f0dd56abb746d79885f77ebd489a4b/users/b3901ec0b35b406d855bb46033665826/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:52.268602 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbad54-1241-45e8-bf18-bbb171f4c67d admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:52.285132 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbad54-1241-45e8-bf18-bbb171f4c67d admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:52.291551 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47328cf5-e794-4a7d-aa6d-f9421fbba4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:52.293660 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e319770-6ac8-4276-a909-ee3fe9a973b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86f0dd56abb746d79885f77ebd489a4b, user_id=b3901ec0b35b406d855bb46033665826, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:52.294478 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47328cf5-e794-4a7d-aa6d-f9421fbba4cb admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:52.295423 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47328cf5-e794-4a7d-aa6d-f9421fbba4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:52.295817 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47328cf5-e794-4a7d-aa6d-f9421fbba4cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:52.296505 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e319770-6ac8-4276-a909-ee3fe9a973b7 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:52.296780 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47328cf5-e794-4a7d-aa6d-f9421fbba4cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:52.298558 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47328cf5-e794-4a7d-aa6d-f9421fbba4cb admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:52.308928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1043/2097] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:22:52.313171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47328cf5-e794-4a7d-aa6d-f9421fbba4cb admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:52.323194 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47328cf5-e794-4a7d-aa6d-f9421fbba4cb admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:52.330178 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3deb51c-a62f-4e64-97e4-6cf58342d1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:52.330515 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deb51c-a62f-4e64-97e4-6cf58342d1eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:52.331010 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deb51c-a62f-4e64-97e4-6cf58342d1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:52.331362 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deb51c-a62f-4e64-97e4-6cf58342d1eb admin admin] PATH_INFO: `/v3/projects/ef0cdf786d0447c1ad5ff7d607cde456/users/d2aeaadc264f4dcc858e1c244d6a1b20/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:52.347420 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3deb51c-a62f-4e64-97e4-6cf58342d1eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef0cdf786d0447c1ad5ff7d607cde456, user_id=d2aeaadc264f4dcc858e1c244d6a1b20, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:52.350227 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3deb51c-a62f-4e64-97e4-6cf58342d1eb admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:52.379146 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1055/2098] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:52 2022] PUT /identity/v3/projects/86f0dd56abb746d79885f77ebd489a4b/users/b3901ec0b35b406d855bb46033665826/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:52.390445 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c906a10-a29e-48c2-a867-ddced128ca7b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:52.390736 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c906a10-a29e-48c2-a867-ddced128ca7b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:52.391016 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c906a10-a29e-48c2-a867-ddced128ca7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:52.416709 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6c906a10-a29e-48c2-a867-ddced128ca7b None None] MFA Rules not processed for user `b3901ec0b35b406d855bb46033665826`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:52.418461 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6c906a10-a29e-48c2-a867-ddced128ca7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:52.464238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1044/2099] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:52 2022] PUT /identity/v3/projects/ef0cdf786d0447c1ad5ff7d607cde456/users/d2aeaadc264f4dcc858e1c244d6a1b20/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:52.470268 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3deb51c-a62f-4e64-97e4-6cf58342d1eb admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:52.503335 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1056/2100] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:52.507233 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c906a10-a29e-48c2-a867-ddced128ca7b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:52.546243 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3deb51c-a62f-4e64-97e4-6cf58342d1eb admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:52.551219 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c88ef-cd5c-476a-98cb-9419e3c430bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:52.551946 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c88ef-cd5c-476a-98cb-9419e3c430bb admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:52.552434 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c88ef-cd5c-476a-98cb-9419e3c430bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:52.552541 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c88ef-cd5c-476a-98cb-9419e3c430bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:52.553254 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c88ef-cd5c-476a-98cb-9419e3c430bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:52.555015 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c88ef-cd5c-476a-98cb-9419e3c430bb admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:52.570225 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1045/2101] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:22:52.573831 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c88ef-cd5c-476a-98cb-9419e3c430bb admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:52.584056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c88ef-cd5c-476a-98cb-9419e3c430bb admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:52.585817 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c906a10-a29e-48c2-a867-ddced128ca7b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:52.589640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df097ae-e912-47d2-8c9b-0e7fdecd9c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:52.590585 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df097ae-e912-47d2-8c9b-0e7fdecd9c8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:52.590861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df097ae-e912-47d2-8c9b-0e7fdecd9c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:52.591099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9ba4f-6444-4a03-9f27-cb8cc5f498be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:52.591282 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df097ae-e912-47d2-8c9b-0e7fdecd9c8c admin admin] PATH_INFO: `/v3/projects/ef0cdf786d0447c1ad5ff7d607cde456/users/d2aeaadc264f4dcc858e1c244d6a1b20/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:52.591768 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9ba4f-6444-4a03-9f27-cb8cc5f498be admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:52.592047 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9ba4f-6444-4a03-9f27-cb8cc5f498be admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:52.592462 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9ba4f-6444-4a03-9f27-cb8cc5f498be admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:52.593018 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9ba4f-6444-4a03-9f27-cb8cc5f498be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:52.593302 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df097ae-e912-47d2-8c9b-0e7fdecd9c8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef0cdf786d0447c1ad5ff7d607cde456, user_id=d2aeaadc264f4dcc858e1c244d6a1b20, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:52.596462 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9ba4f-6444-4a03-9f27-cb8cc5f498be admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:52.601663 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df097ae-e912-47d2-8c9b-0e7fdecd9c8c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:52.616471 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1046/2102] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:52 2022] PUT /identity/v3/projects/ef0cdf786d0447c1ad5ff7d607cde456/users/d2aeaadc264f4dcc858e1c244d6a1b20/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:52.627515 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef793d-5de1-42ed-b5a8-0fffb7d55530 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:52.627809 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef793d-5de1-42ed-b5a8-0fffb7d55530 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:52.628113 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef793d-5de1-42ed-b5a8-0fffb7d55530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:52.654439 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d4ef793d-5de1-42ed-b5a8-0fffb7d55530 None None] MFA Rules not processed for user `d2aeaadc264f4dcc858e1c244d6a1b20`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:52.655841 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d4ef793d-5de1-42ed-b5a8-0fffb7d55530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:52.724418 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1047/2103] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:52 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:52.735333 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef793d-5de1-42ed-b5a8-0fffb7d55530 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:52.736713 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d4ef793d-5de1-42ed-b5a8-0fffb7d55530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:52.745858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1057/2104] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:22:52 2022] POST /identity/v3/projects => generated 383 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:52.753682 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9ba4f-6444-4a03-9f27-cb8cc5f498be admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:52.802115 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef793d-5de1-42ed-b5a8-0fffb7d55530 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:52.819641 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9ba4f-6444-4a03-9f27-cb8cc5f498be admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:52.824950 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674f823-0fa5-48b8-91cc-95d413d367fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:52.825643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674f823-0fa5-48b8-91cc-95d413d367fd admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:52.825929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674f823-0fa5-48b8-91cc-95d413d367fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:52.826233 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674f823-0fa5-48b8-91cc-95d413d367fd admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:52.826928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674f823-0fa5-48b8-91cc-95d413d367fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:52.828885 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674f823-0fa5-48b8-91cc-95d413d367fd admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:52.884576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749adcf7-601f-41b7-8ee4-d04b28f96483 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:52.885442 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749adcf7-601f-41b7-8ee4-d04b28f96483 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:52.885740 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749adcf7-601f-41b7-8ee4-d04b28f96483 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:52.886114 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749adcf7-601f-41b7-8ee4-d04b28f96483 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:52.961414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1058/2105] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:22:52 2022] POST /identity/v3/users => generated 298 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:52.961414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba9029-3cab-4483-8310-d83290234f7e None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:52.961414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba9029-3cab-4483-8310-d83290234f7e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:52.961414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba9029-3cab-4483-8310-d83290234f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:52.997796 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-faba9029-3cab-4483-8310-d83290234f7e None None] MFA Rules not processed for user `9f604dfadb914462a1e2fa1d7cf95d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:53.001966 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749adcf7-601f-41b7-8ee4-d04b28f96483 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:53.002083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-faba9029-3cab-4483-8310-d83290234f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:53.002213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749adcf7-601f-41b7-8ee4-d04b28f96483 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:53.026599 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1048/2106] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:52 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:22:53.028293 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749adcf7-601f-41b7-8ee4-d04b28f96483 service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:53.053049 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749adcf7-601f-41b7-8ee4-d04b28f96483 service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:53.062528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98e8d8-c579-43a3-9d1d-0bff0cb682e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:53.063552 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98e8d8-c579-43a3-9d1d-0bff0cb682e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:53.063833 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98e8d8-c579-43a3-9d1d-0bff0cb682e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:53.064111 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98e8d8-c579-43a3-9d1d-0bff0cb682e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:53.064964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98e8d8-c579-43a3-9d1d-0bff0cb682e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:53.066924 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98e8d8-c579-43a3-9d1d-0bff0cb682e6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:53.080537 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1049/2107] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:53.085048 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98e8d8-c579-43a3-9d1d-0bff0cb682e6 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:53.085180 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1059/2108] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:53.096349 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98e8d8-c579-43a3-9d1d-0bff0cb682e6 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:53.104820 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d8274-597b-4bc0-ba35-c9187c2698bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:53.104820 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d8274-597b-4bc0-ba35-c9187c2698bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:53.104820 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d8274-597b-4bc0-ba35-c9187c2698bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:53.104820 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d8274-597b-4bc0-ba35-c9187c2698bb admin admin] PATH_INFO: `/v3/projects/92f7e939fa884cbd8e0472eb696e29f7/users/80877a76a58247d5b4100425a47c9930/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:53.117902 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d8274-597b-4bc0-ba35-c9187c2698bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=92f7e939fa884cbd8e0472eb696e29f7, user_id=80877a76a58247d5b4100425a47c9930, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:53.121200 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d8274-597b-4bc0-ba35-c9187c2698bb admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:53.163830 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba9029-3cab-4483-8310-d83290234f7e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:53.174103 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba9029-3cab-4483-8310-d83290234f7e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:53.177756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7e9d2-9ebd-43b6-97c2-6d91e02e8afb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:53.178432 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7e9d2-9ebd-43b6-97c2-6d91e02e8afb service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:53.178720 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7e9d2-9ebd-43b6-97c2-6d91e02e8afb service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:53.178994 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7e9d2-9ebd-43b6-97c2-6d91e02e8afb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:53.180780 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4be7e9d2-9ebd-43b6-97c2-6d91e02e8afb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:53.242636 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7e9d2-9ebd-43b6-97c2-6d91e02e8afb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:53.243215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7e9d2-9ebd-43b6-97c2-6d91e02e8afb service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:53.249090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1050/2109] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:53 2022] PUT /identity/v3/projects/92f7e939fa884cbd8e0472eb696e29f7/users/80877a76a58247d5b4100425a47c9930/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:53.250099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d8274-597b-4bc0-ba35-c9187c2698bb admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:53.255037 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1060/2110] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:22:53.328310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d8274-597b-4bc0-ba35-c9187c2698bb admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:53.333513 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa064ba2-7c4c-4949-93f6-edd78e5df3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:53.334221 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa064ba2-7c4c-4949-93f6-edd78e5df3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:53.334545 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa064ba2-7c4c-4949-93f6-edd78e5df3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:53.334946 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa064ba2-7c4c-4949-93f6-edd78e5df3a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:53.335726 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa064ba2-7c4c-4949-93f6-edd78e5df3a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:53.337435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa064ba2-7c4c-4949-93f6-edd78e5df3a5 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:53.352640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1051/2111] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:53.357671 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7e9d2-9ebd-43b6-97c2-6d91e02e8afb service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:53.375171 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7e9d2-9ebd-43b6-97c2-6d91e02e8afb service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:53.385457 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4816348-df47-4e72-811b-e3045cfcd5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:53.386441 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4816348-df47-4e72-811b-e3045cfcd5dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:53.386730 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4816348-df47-4e72-811b-e3045cfcd5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:53.387007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4816348-df47-4e72-811b-e3045cfcd5dc admin admin] PATH_INFO: `/v3/projects/92f7e939fa884cbd8e0472eb696e29f7/users/80877a76a58247d5b4100425a47c9930/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:53.389013 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4816348-df47-4e72-811b-e3045cfcd5dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=92f7e939fa884cbd8e0472eb696e29f7, user_id=80877a76a58247d5b4100425a47c9930, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:53.391880 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4816348-df47-4e72-811b-e3045cfcd5dc admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:53.403516 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1061/2112] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:22:53 2022] PUT /identity/v3/projects/92f7e939fa884cbd8e0472eb696e29f7/users/80877a76a58247d5b4100425a47c9930/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:53.414464 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68320a-9f67-41b7-b963-bd06fd5a2443 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:53.414789 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68320a-9f67-41b7-b963-bd06fd5a2443 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:53.415032 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68320a-9f67-41b7-b963-bd06fd5a2443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:53.444466 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-8a68320a-9f67-41b7-b963-bd06fd5a2443 None None] MFA Rules not processed for user `80877a76a58247d5b4100425a47c9930`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:53.446234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8a68320a-9f67-41b7-b963-bd06fd5a2443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:53.516163 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1052/2113] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:53.722214 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4816348-df47-4e72-811b-e3045cfcd5dc admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:53.723990 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e4816348-df47-4e72-811b-e3045cfcd5dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:53.787290 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4816348-df47-4e72-811b-e3045cfcd5dc admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:53.790825 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d60b5-fc6a-4f27-8a58-32c5959f7970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:53.791470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d60b5-fc6a-4f27-8a58-32c5959f7970 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:53.791755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d60b5-fc6a-4f27-8a58-32c5959f7970 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:53.792028 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d60b5-fc6a-4f27-8a58-32c5959f7970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:53.849060 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d60b5-fc6a-4f27-8a58-32c5959f7970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:53.850592 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d60b5-fc6a-4f27-8a58-32c5959f7970 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:53.859811 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1062/2114] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:55.419811 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68320a-9f67-41b7-b963-bd06fd5a2443 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:55.428997 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68320a-9f67-41b7-b963-bd06fd5a2443 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:55.432530 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2072710-f9fa-4e9b-8e82-562c8bd435b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:55.433712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2072710-f9fa-4e9b-8e82-562c8bd435b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:55.433999 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2072710-f9fa-4e9b-8e82-562c8bd435b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:55.434308 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2072710-f9fa-4e9b-8e82-562c8bd435b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:55.491845 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2072710-f9fa-4e9b-8e82-562c8bd435b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:55.493312 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2072710-f9fa-4e9b-8e82-562c8bd435b7 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:55.503441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1053/2115] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:55 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:56.283029 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d60b5-fc6a-4f27-8a58-32c5959f7970 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:56.300093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d60b5-fc6a-4f27-8a58-32c5959f7970 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:56.303860 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a781b43-5774-4825-a34f-cfe002f04ea6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:56.304515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a781b43-5774-4825-a34f-cfe002f04ea6 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:56.304795 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a781b43-5774-4825-a34f-cfe002f04ea6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:56.305073 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a781b43-5774-4825-a34f-cfe002f04ea6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:56.365921 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a781b43-5774-4825-a34f-cfe002f04ea6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:56.367396 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a781b43-5774-4825-a34f-cfe002f04ea6 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:56.376585 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1063/2116] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:58.187921 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2072710-f9fa-4e9b-8e82-562c8bd435b7 service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:58.196274 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2072710-f9fa-4e9b-8e82-562c8bd435b7 service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:58.200411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb5ceb-d630-4afd-ae8b-a9de4af7c98c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:58.201040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb5ceb-d630-4afd-ae8b-a9de4af7c98c service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:58.201316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb5ceb-d630-4afd-ae8b-a9de4af7c98c service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:58.201583 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb5ceb-d630-4afd-ae8b-a9de4af7c98c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:58.210180 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb5ceb-d630-4afd-ae8b-a9de4af7c98c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:58.211594 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb5ceb-d630-4afd-ae8b-a9de4af7c98c service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:58.221188 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1054/2117] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:58.981950 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a781b43-5774-4825-a34f-cfe002f04ea6 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:59.050220 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a781b43-5774-4825-a34f-cfe002f04ea6 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:59.050220 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549135f-d7df-45a5-a252-96047f1fb3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:59.050427 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549135f-d7df-45a5-a252-96047f1fb3f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:59.050610 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549135f-d7df-45a5-a252-96047f1fb3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:59.050881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549135f-d7df-45a5-a252-96047f1fb3f2 admin admin] PATH_INFO: `/v3/users/86bac93336f548f5b19b8789fe3d05ff` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:59.052113 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549135f-d7df-45a5-a252-96047f1fb3f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86bac93336f548f5b19b8789fe3d05ff)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:59.053968 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549135f-d7df-45a5-a252-96047f1fb3f2 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:59.332427 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c549135f-d7df-45a5-a252-96047f1fb3f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86bac93336f548f5b19b8789fe3d05ff'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:59.344150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c549135f-d7df-45a5-a252-96047f1fb3f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86bac93336f548f5b19b8789fe3d05ff'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:59.344821 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c549135f-d7df-45a5-a252-96047f1fb3f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86bac93336f548f5b19b8789fe3d05ff'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:59.345426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c549135f-d7df-45a5-a252-96047f1fb3f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86bac93336f548f5b19b8789fe3d05ff'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:59.352319 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c549135f-d7df-45a5-a252-96047f1fb3f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86bac93336f548f5b19b8789fe3d05ff'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:59.482110 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1064/2118] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:22:58 2022] DELETE /identity/v3/users/86bac93336f548f5b19b8789fe3d05ff => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:59.486583 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a1376-b318-4b35-8ece-270a8b667691 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:59.494026 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a1376-b318-4b35-8ece-270a8b667691 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:59.494026 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a1376-b318-4b35-8ece-270a8b667691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:59.504100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-487a1376-b318-4b35-8ece-270a8b667691 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:59.505298 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-487a1376-b318-4b35-8ece-270a8b667691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:59.562811 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1055/2119] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:59.572816 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549135f-d7df-45a5-a252-96047f1fb3f2 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:59.574237 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c549135f-d7df-45a5-a252-96047f1fb3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:59.631652 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549135f-d7df-45a5-a252-96047f1fb3f2 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:59.635404 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b54d5-559f-4341-970c-578a172d49c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:59.636057 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b54d5-559f-4341-970c-578a172d49c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:59.636343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b54d5-559f-4341-970c-578a172d49c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:59.636619 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b54d5-559f-4341-970c-578a172d49c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:59.646257 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b54d5-559f-4341-970c-578a172d49c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:59.648020 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b54d5-559f-4341-970c-578a172d49c4 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:59.657510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1065/2120] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:22:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:00.327454 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a1376-b318-4b35-8ece-270a8b667691 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:00.329032 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-487a1376-b318-4b35-8ece-270a8b667691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:00.425205 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a1376-b318-4b35-8ece-270a8b667691 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:00.429769 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43522b-a372-4f09-aaf5-47bd58676be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:00.430664 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43522b-a372-4f09-aaf5-47bd58676be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:00.430948 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43522b-a372-4f09-aaf5-47bd58676be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:00.431227 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43522b-a372-4f09-aaf5-47bd58676be6 admin admin] PATH_INFO: `/v3/projects/4d728a3266f14792ad4feea58ccbf1f6` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:00.432464 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43522b-a372-4f09-aaf5-47bd58676be6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d728a3266f14792ad4feea58ccbf1f6)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:00.434412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43522b-a372-4f09-aaf5-47bd58676be6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:00.692272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9f43522b-a372-4f09-aaf5-47bd58676be6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d728a3266f14792ad4feea58ccbf1f6', 'request_id': 'req-9f43522b-a372-4f09-aaf5-47bd58676be6'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:00.795352 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9f43522b-a372-4f09-aaf5-47bd58676be6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d728a3266f14792ad4feea58ccbf1f6', 'request_id': 'req-9f43522b-a372-4f09-aaf5-47bd58676be6'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:00.803771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9f43522b-a372-4f09-aaf5-47bd58676be6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d728a3266f14792ad4feea58ccbf1f6', 'request_id': 'req-9f43522b-a372-4f09-aaf5-47bd58676be6'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:00.815606 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9f43522b-a372-4f09-aaf5-47bd58676be6 admin admin] The token cache is being invalidate because project 4d728a3266f14792ad4feea58ccbf1f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:00.815982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9f43522b-a372-4f09-aaf5-47bd58676be6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:00.816727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9f43522b-a372-4f09-aaf5-47bd58676be6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:00.818356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1056/2121] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:23:00 2022] DELETE /identity/v3/projects/4d728a3266f14792ad4feea58ccbf1f6 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:00.822277 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b54d5-559f-4341-970c-578a172d49c4 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:00.866767 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b54d5-559f-4341-970c-578a172d49c4 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:00.926206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca507faf-6eeb-47c4-bf65-4bc9c37a73d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:00.927031 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca507faf-6eeb-47c4-bf65-4bc9c37a73d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:00.927330 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca507faf-6eeb-47c4-bf65-4bc9c37a73d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:00.927608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca507faf-6eeb-47c4-bf65-4bc9c37a73d5 admin admin] PATH_INFO: `/v3/users/d2aeaadc264f4dcc858e1c244d6a1b20` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:00.928814 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca507faf-6eeb-47c4-bf65-4bc9c37a73d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2aeaadc264f4dcc858e1c244d6a1b20)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:00.930872 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca507faf-6eeb-47c4-bf65-4bc9c37a73d5 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:01.197889 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ca507faf-6eeb-47c4-bf65-4bc9c37a73d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2aeaadc264f4dcc858e1c244d6a1b20'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:01.212288 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ca507faf-6eeb-47c4-bf65-4bc9c37a73d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2aeaadc264f4dcc858e1c244d6a1b20'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:01.212288 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ca507faf-6eeb-47c4-bf65-4bc9c37a73d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2aeaadc264f4dcc858e1c244d6a1b20'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:01.212288 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ca507faf-6eeb-47c4-bf65-4bc9c37a73d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2aeaadc264f4dcc858e1c244d6a1b20'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:01.218889 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ca507faf-6eeb-47c4-bf65-4bc9c37a73d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2aeaadc264f4dcc858e1c244d6a1b20'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:01.321632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1066/2122] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:23:00 2022] DELETE /identity/v3/users/d2aeaadc264f4dcc858e1c244d6a1b20 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:01.832658 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43522b-a372-4f09-aaf5-47bd58676be6 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:01.833152 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9f43522b-a372-4f09-aaf5-47bd58676be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:01.849856 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43522b-a372-4f09-aaf5-47bd58676be6 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:01.910057 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7d4cf-d189-4458-a560-ce57652b3429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:01.910954 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7d4cf-d189-4458-a560-ce57652b3429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:01.911240 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7d4cf-d189-4458-a560-ce57652b3429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:01.911517 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7d4cf-d189-4458-a560-ce57652b3429 admin admin] PATH_INFO: `/v3/projects/ef0cdf786d0447c1ad5ff7d607cde456` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:01.912707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7d4cf-d189-4458-a560-ce57652b3429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef0cdf786d0447c1ad5ff7d607cde456)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:01.914815 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7d4cf-d189-4458-a560-ce57652b3429 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:02.063166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-78a7d4cf-d189-4458-a560-ce57652b3429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef0cdf786d0447c1ad5ff7d607cde456', 'request_id': 'req-78a7d4cf-d189-4458-a560-ce57652b3429'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:02.189371 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-78a7d4cf-d189-4458-a560-ce57652b3429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef0cdf786d0447c1ad5ff7d607cde456', 'request_id': 'req-78a7d4cf-d189-4458-a560-ce57652b3429'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:02.196330 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-78a7d4cf-d189-4458-a560-ce57652b3429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef0cdf786d0447c1ad5ff7d607cde456', 'request_id': 'req-78a7d4cf-d189-4458-a560-ce57652b3429'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:02.206713 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-78a7d4cf-d189-4458-a560-ce57652b3429 admin admin] The token cache is being invalidate because project ef0cdf786d0447c1ad5ff7d607cde456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:02.206995 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-78a7d4cf-d189-4458-a560-ce57652b3429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:02.207627 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-78a7d4cf-d189-4458-a560-ce57652b3429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:02.209245 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1057/2123] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:23:01 2022] DELETE /identity/v3/projects/ef0cdf786d0447c1ad5ff7d607cde456 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:02.214193 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808352d-cbc2-4da3-8ba6-6f85d5f00791 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:02.214665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808352d-cbc2-4da3-8ba6-6f85d5f00791 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:02.214756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808352d-cbc2-4da3-8ba6-6f85d5f00791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:02.260118 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b808352d-cbc2-4da3-8ba6-6f85d5f00791 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:02.261234 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b808352d-cbc2-4da3-8ba6-6f85d5f00791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:02.319149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1067/2124] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:23:02.326981 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea10d9c-662c-4f5b-8830-4c04df291198 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:02.327255 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea10d9c-662c-4f5b-8830-4c04df291198 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:02.327537 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea10d9c-662c-4f5b-8830-4c04df291198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:02.354495 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-bea10d9c-662c-4f5b-8830-4c04df291198 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:02.355692 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-bea10d9c-662c-4f5b-8830-4c04df291198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:02.364170 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1058/2125] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:23:02.368688 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808352d-cbc2-4da3-8ba6-6f85d5f00791 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:02.379607 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808352d-cbc2-4da3-8ba6-6f85d5f00791 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:02.384300 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86318547-f05f-4a78-b6a3-034c4226e5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:02.384951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86318547-f05f-4a78-b6a3-034c4226e5ea admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:02.385229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86318547-f05f-4a78-b6a3-034c4226e5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:02.385500 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86318547-f05f-4a78-b6a3-034c4226e5ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:02.386248 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86318547-f05f-4a78-b6a3-034c4226e5ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:23:02.386579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86318547-f05f-4a78-b6a3-034c4226e5ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:02.388232 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86318547-f05f-4a78-b6a3-034c4226e5ea admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:02.399784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1068/2126] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:23:02.404158 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea10d9c-662c-4f5b-8830-4c04df291198 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:02.413514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea10d9c-662c-4f5b-8830-4c04df291198 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:02.418324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d6a07-0b2b-45a9-b80f-51bd7321b4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:02.419499 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d6a07-0b2b-45a9-b80f-51bd7321b4ef admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:02.419786 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d6a07-0b2b-45a9-b80f-51bd7321b4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:02.420072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d6a07-0b2b-45a9-b80f-51bd7321b4ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:02.420810 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d6a07-0b2b-45a9-b80f-51bd7321b4ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:02.423132 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d6a07-0b2b-45a9-b80f-51bd7321b4ef admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:02.534254 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1059/2127] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:23:02 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:23:02.539098 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86318547-f05f-4a78-b6a3-034c4226e5ea admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:02.549589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86318547-f05f-4a78-b6a3-034c4226e5ea admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:02.605980 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226183f-2480-4efe-bcaf-214a15640a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:02.607281 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226183f-2480-4efe-bcaf-214a15640a78 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:02.607570 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226183f-2480-4efe-bcaf-214a15640a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:02.607848 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226183f-2480-4efe-bcaf-214a15640a78 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:02.608557 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226183f-2480-4efe-bcaf-214a15640a78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:02.610589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226183f-2480-4efe-bcaf-214a15640a78 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:02.707105 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1069/2128] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:23:02 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:02.708496 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d6a07-0b2b-45a9-b80f-51bd7321b4ef admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:02.719533 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d6a07-0b2b-45a9-b80f-51bd7321b4ef admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:02.724263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f839b-998c-4c4f-ac48-019e7abb9124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:02.725163 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f839b-998c-4c4f-ac48-019e7abb9124 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:02.725408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f839b-998c-4c4f-ac48-019e7abb9124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:02.725683 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f839b-998c-4c4f-ac48-019e7abb9124 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:02.726452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f839b-998c-4c4f-ac48-019e7abb9124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:02.728057 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f839b-998c-4c4f-ac48-019e7abb9124 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:02.742149 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1060/2129] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:02.743937 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226183f-2480-4efe-bcaf-214a15640a78 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:02.754325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226183f-2480-4efe-bcaf-214a15640a78 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:02.758987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7b076-6160-4890-af3b-0a6c121c46e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:02.759648 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7b076-6160-4890-af3b-0a6c121c46e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:02.759927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7b076-6160-4890-af3b-0a6c121c46e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:02.760201 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7b076-6160-4890-af3b-0a6c121c46e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:02.761095 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7b076-6160-4890-af3b-0a6c121c46e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:02.762827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7b076-6160-4890-af3b-0a6c121c46e6 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:02.772969 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1070/2130] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:23:02.777794 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f839b-998c-4c4f-ac48-019e7abb9124 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:02.788343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f839b-998c-4c4f-ac48-019e7abb9124 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:02.793096 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0aa69-55d6-4b3c-9cf4-ada5f5c21a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:02.793967 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0aa69-55d6-4b3c-9cf4-ada5f5c21a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:02.794844 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0aa69-55d6-4b3c-9cf4-ada5f5c21a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:02.795116 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0aa69-55d6-4b3c-9cf4-ada5f5c21a15 admin admin] PATH_INFO: `/v3/projects/1c8bcf38bb3e4c07b29d30f20a11b1f5/users/6bbb3a6f12024291bbe4b2cba4eecb69/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:02.811403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0aa69-55d6-4b3c-9cf4-ada5f5c21a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c8bcf38bb3e4c07b29d30f20a11b1f5, user_id=6bbb3a6f12024291bbe4b2cba4eecb69, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:02.815074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0aa69-55d6-4b3c-9cf4-ada5f5c21a15 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:02.924523 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1061/2131] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:23:02 2022] PUT /identity/v3/projects/1c8bcf38bb3e4c07b29d30f20a11b1f5/users/6bbb3a6f12024291bbe4b2cba4eecb69/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:02.929745 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619798b3-deed-49a1-83b1-037efd1b8ece None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:02.929910 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619798b3-deed-49a1-83b1-037efd1b8ece None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:02.930216 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619798b3-deed-49a1-83b1-037efd1b8ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:02.958834 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-619798b3-deed-49a1-83b1-037efd1b8ece None None] MFA Rules not processed for user `6bbb3a6f12024291bbe4b2cba4eecb69`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:02.960114 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-619798b3-deed-49a1-83b1-037efd1b8ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:03.022341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1071/2132] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:03.026613 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0aa69-55d6-4b3c-9cf4-ada5f5c21a15 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:03.091133 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0aa69-55d6-4b3c-9cf4-ada5f5c21a15 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:03.096114 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ebcac-8b78-4e71-9bf0-99cd5e5bca28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:03.096772 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ebcac-8b78-4e71-9bf0-99cd5e5bca28 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:03.097049 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ebcac-8b78-4e71-9bf0-99cd5e5bca28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:03.097321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ebcac-8b78-4e71-9bf0-99cd5e5bca28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:03.098002 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ebcac-8b78-4e71-9bf0-99cd5e5bca28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:03.099998 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ebcac-8b78-4e71-9bf0-99cd5e5bca28 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:03.230025 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1062/2133] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:23:03 2022] POST /identity/v3/projects => generated 379 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:03.234817 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619798b3-deed-49a1-83b1-037efd1b8ece None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:03.245163 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619798b3-deed-49a1-83b1-037efd1b8ece None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:03.303525 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7481b-4853-48f6-9bd0-c6ced7eff12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:03.304200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7481b-4853-48f6-9bd0-c6ced7eff12b admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:03.304479 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7481b-4853-48f6-9bd0-c6ced7eff12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:03.304751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7481b-4853-48f6-9bd0-c6ced7eff12b admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:03.305442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7481b-4853-48f6-9bd0-c6ced7eff12b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:03.307381 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7481b-4853-48f6-9bd0-c6ced7eff12b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:03.429503 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1072/2134] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:23:03 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:03.433570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ebcac-8b78-4e71-9bf0-99cd5e5bca28 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:03.444239 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ebcac-8b78-4e71-9bf0-99cd5e5bca28 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:03.448895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54902a-595c-454f-bbeb-321a3f32e8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:03.449551 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54902a-595c-454f-bbeb-321a3f32e8bb admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:03.450108 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54902a-595c-454f-bbeb-321a3f32e8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:03.450421 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54902a-595c-454f-bbeb-321a3f32e8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:03.451149 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54902a-595c-454f-bbeb-321a3f32e8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:03.452737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54902a-595c-454f-bbeb-321a3f32e8bb admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:03.463211 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1063/2135] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:03.477370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7481b-4853-48f6-9bd0-c6ced7eff12b admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:03.487754 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7481b-4853-48f6-9bd0-c6ced7eff12b admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:03.492329 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672edc9-6346-4bf9-b88a-945c6fd7e87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:03.492974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672edc9-6346-4bf9-b88a-945c6fd7e87a admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:03.493258 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672edc9-6346-4bf9-b88a-945c6fd7e87a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:03.493531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672edc9-6346-4bf9-b88a-945c6fd7e87a admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:03.494303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672edc9-6346-4bf9-b88a-945c6fd7e87a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:03.495963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672edc9-6346-4bf9-b88a-945c6fd7e87a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:03.506309 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1073/2136] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:03.510302 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54902a-595c-454f-bbeb-321a3f32e8bb admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:03.520241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54902a-595c-454f-bbeb-321a3f32e8bb admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:03.524892 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6beaa9f-6db6-4af4-ba3c-a09f48f939f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:03.525856 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6beaa9f-6db6-4af4-ba3c-a09f48f939f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:03.526096 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6beaa9f-6db6-4af4-ba3c-a09f48f939f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:03.526393 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6beaa9f-6db6-4af4-ba3c-a09f48f939f7 admin admin] PATH_INFO: `/v3/projects/c51c33d7c15d4504a393bcb2b8d326d4/users/cdeb7fbf30f243c7b6083c94aa2ed189/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:03.540674 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672edc9-6346-4bf9-b88a-945c6fd7e87a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:03.541533 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6beaa9f-6db6-4af4-ba3c-a09f48f939f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c51c33d7c15d4504a393bcb2b8d326d4, user_id=cdeb7fbf30f243c7b6083c94aa2ed189, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:03.542430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6672edc9-6346-4bf9-b88a-945c6fd7e87a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:03.544874 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6beaa9f-6db6-4af4-ba3c-a09f48f939f7 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:03.555610 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672edc9-6346-4bf9-b88a-945c6fd7e87a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:03.560307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973446d-2735-4c6f-ae85-f5018f6495ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:03.561159 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973446d-2735-4c6f-ae85-f5018f6495ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:03.561441 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973446d-2735-4c6f-ae85-f5018f6495ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:03.561712 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973446d-2735-4c6f-ae85-f5018f6495ea admin admin] PATH_INFO: `/v3/users/fc3c04b512cc4130a7931206cc486a60` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:03.562942 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973446d-2735-4c6f-ae85-f5018f6495ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc3c04b512cc4130a7931206cc486a60)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:03.564865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973446d-2735-4c6f-ae85-f5018f6495ea admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:03.635242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1064/2137] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:23:03 2022] PUT /identity/v3/projects/c51c33d7c15d4504a393bcb2b8d326d4/users/cdeb7fbf30f243c7b6083c94aa2ed189/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:03.645560 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d9ac2-2ae0-4be3-885a-debc5c1b4592 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:03.645874 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d9ac2-2ae0-4be3-885a-debc5c1b4592 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:03.646172 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d9ac2-2ae0-4be3-885a-debc5c1b4592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:03.671798 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-cf8d9ac2-2ae0-4be3-885a-debc5c1b4592 None None] MFA Rules not processed for user `cdeb7fbf30f243c7b6083c94aa2ed189`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:03.672991 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-cf8d9ac2-2ae0-4be3-885a-debc5c1b4592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:03.735773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1065/2138] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:23:03.740112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d9ac2-2ae0-4be3-885a-debc5c1b4592 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:03.780090 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9973446d-2735-4c6f-ae85-f5018f6495ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc3c04b512cc4130a7931206cc486a60'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:03.791707 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9973446d-2735-4c6f-ae85-f5018f6495ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc3c04b512cc4130a7931206cc486a60'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:03.792365 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9973446d-2735-4c6f-ae85-f5018f6495ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc3c04b512cc4130a7931206cc486a60'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:03.792965 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9973446d-2735-4c6f-ae85-f5018f6495ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc3c04b512cc4130a7931206cc486a60'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:03.799407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d9ac2-2ae0-4be3-885a-debc5c1b4592 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:03.799843 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9973446d-2735-4c6f-ae85-f5018f6495ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc3c04b512cc4130a7931206cc486a60'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:03.803986 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e843c70-8e77-4dde-a473-695cc36de186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:03.804639 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e843c70-8e77-4dde-a473-695cc36de186 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:03.804922 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e843c70-8e77-4dde-a473-695cc36de186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:03.805193 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e843c70-8e77-4dde-a473-695cc36de186 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:03.805871 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e843c70-8e77-4dde-a473-695cc36de186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:03.807816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e843c70-8e77-4dde-a473-695cc36de186 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:03.900806 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1074/2139] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:23:03 2022] DELETE /identity/v3/users/fc3c04b512cc4130a7931206cc486a60 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:23:03.906309 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6229eae-0cba-4e12-91e9-02e17ede6d68 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:03.906602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6229eae-0cba-4e12-91e9-02e17ede6d68 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:03.906882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6229eae-0cba-4e12-91e9-02e17ede6d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:03.924909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b6229eae-0cba-4e12-91e9-02e17ede6d68 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:03.926198 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b6229eae-0cba-4e12-91e9-02e17ede6d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:03.937236 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1066/2140] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:23:03 2022] POST /identity/v3/projects => generated 377 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:23:03.943969 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e843c70-8e77-4dde-a473-695cc36de186 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:03.943969 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0e843c70-8e77-4dde-a473-695cc36de186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:04.007295 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1075/2141] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:23:04.015739 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e843c70-8e77-4dde-a473-695cc36de186 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:04.020559 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1cf3b-ef79-439d-afc8-c7c83bf824da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:04.024291 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1cf3b-ef79-439d-afc8-c7c83bf824da admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:04.024291 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1cf3b-ef79-439d-afc8-c7c83bf824da admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:04.024291 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1cf3b-ef79-439d-afc8-c7c83bf824da admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:04.024291 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1cf3b-ef79-439d-afc8-c7c83bf824da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:04.024611 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6229eae-0cba-4e12-91e9-02e17ede6d68 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:04.024686 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1cf3b-ef79-439d-afc8-c7c83bf824da admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:04.025732 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b6229eae-0cba-4e12-91e9-02e17ede6d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:04.119515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6229eae-0cba-4e12-91e9-02e17ede6d68 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:04.126965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1067/2142] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:23:03 2022] POST /identity/v3/users => generated 295 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:04.127834 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1cf3b-ef79-439d-afc8-c7c83bf824da admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:04.137316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1cf3b-ef79-439d-afc8-c7c83bf824da admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:04.142698 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f63deb-37e7-4383-ae1b-fcfd3c7c954b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:04.143340 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f63deb-37e7-4383-ae1b-fcfd3c7c954b admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:04.143625 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f63deb-37e7-4383-ae1b-fcfd3c7c954b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:04.143898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f63deb-37e7-4383-ae1b-fcfd3c7c954b admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:04.144625 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f63deb-37e7-4383-ae1b-fcfd3c7c954b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:04.146234 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f63deb-37e7-4383-ae1b-fcfd3c7c954b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:04.159350 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1068/2143] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:23:04.160327 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f63deb-37e7-4383-ae1b-fcfd3c7c954b admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:04.168576 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a81e4-47b6-43d7-b87e-1d1f633a46ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:04.169295 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a81e4-47b6-43d7-b87e-1d1f633a46ba service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:04.169611 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a81e4-47b6-43d7-b87e-1d1f633a46ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:04.169726 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f63deb-37e7-4383-ae1b-fcfd3c7c954b admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:04.169891 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a81e4-47b6-43d7-b87e-1d1f633a46ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:04.174219 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22106ea2-72ff-4dd2-ad85-6193a1c54aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:04.175066 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22106ea2-72ff-4dd2-ad85-6193a1c54aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:04.175347 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22106ea2-72ff-4dd2-ad85-6193a1c54aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:04.175620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22106ea2-72ff-4dd2-ad85-6193a1c54aa0 admin admin] PATH_INFO: `/v3/projects/6360c2381c3e47638eadbb672d174a2b/users/5b7b8bf5555a473e876271d7cae54f62/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:04.179129 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a81e4-47b6-43d7-b87e-1d1f633a46ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:04.180587 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a81e4-47b6-43d7-b87e-1d1f633a46ba service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:04.191140 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1076/2144] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:23:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:23:04.195668 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22106ea2-72ff-4dd2-ad85-6193a1c54aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6360c2381c3e47638eadbb672d174a2b, user_id=5b7b8bf5555a473e876271d7cae54f62, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:04.198464 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22106ea2-72ff-4dd2-ad85-6193a1c54aa0 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:04.349729 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1069/2145] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:23:04 2022] PUT /identity/v3/projects/6360c2381c3e47638eadbb672d174a2b/users/5b7b8bf5555a473e876271d7cae54f62/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:04.353888 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a81e4-47b6-43d7-b87e-1d1f633a46ba service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:04.363523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a81e4-47b6-43d7-b87e-1d1f633a46ba service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:04.424065 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21384d-b674-4b44-ab68-d9ec57d1c87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:04.425095 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21384d-b674-4b44-ab68-d9ec57d1c87e admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:04.427649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21384d-b674-4b44-ab68-d9ec57d1c87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:04.427649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21384d-b674-4b44-ab68-d9ec57d1c87e admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:04.427649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21384d-b674-4b44-ab68-d9ec57d1c87e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:04.428290 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21384d-b674-4b44-ab68-d9ec57d1c87e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:04.442169 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1077/2146] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:04.443366 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22106ea2-72ff-4dd2-ad85-6193a1c54aa0 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:04.453834 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22106ea2-72ff-4dd2-ad85-6193a1c54aa0 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:04.458679 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557def16-654e-4cbb-baf8-297d4474c3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:04.459565 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557def16-654e-4cbb-baf8-297d4474c3be admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:04.459850 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557def16-654e-4cbb-baf8-297d4474c3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:04.460132 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557def16-654e-4cbb-baf8-297d4474c3be admin admin] PATH_INFO: `/v3/projects/6360c2381c3e47638eadbb672d174a2b/users/5b7b8bf5555a473e876271d7cae54f62/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:04.462593 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557def16-654e-4cbb-baf8-297d4474c3be admin admin] RBAC: Authorizing `identity:create_grant(project_id=6360c2381c3e47638eadbb672d174a2b, user_id=5b7b8bf5555a473e876271d7cae54f62, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:04.465390 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557def16-654e-4cbb-baf8-297d4474c3be admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:04.475951 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1070/2147] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:23:04 2022] PUT /identity/v3/projects/6360c2381c3e47638eadbb672d174a2b/users/5b7b8bf5555a473e876271d7cae54f62/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:04.486592 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2215b-75c9-4e11-8cd5-a3a54832a75f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:04.486909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2215b-75c9-4e11-8cd5-a3a54832a75f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:04.487189 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2215b-75c9-4e11-8cd5-a3a54832a75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:04.516888 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-68e2215b-75c9-4e11-8cd5-a3a54832a75f None None] MFA Rules not processed for user `5b7b8bf5555a473e876271d7cae54f62`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:04.518136 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-68e2215b-75c9-4e11-8cd5-a3a54832a75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:04.589782 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1078/2148] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:04.601509 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557def16-654e-4cbb-baf8-297d4474c3be admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:04.603184 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-557def16-654e-4cbb-baf8-297d4474c3be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:04.660712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557def16-654e-4cbb-baf8-297d4474c3be admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:04.664391 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065223d7-cb6c-4bdb-8bfc-e7dd9d2c0673 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:04.665036 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065223d7-cb6c-4bdb-8bfc-e7dd9d2c0673 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:04.665317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065223d7-cb6c-4bdb-8bfc-e7dd9d2c0673 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:04.665591 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065223d7-cb6c-4bdb-8bfc-e7dd9d2c0673 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:04.675070 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065223d7-cb6c-4bdb-8bfc-e7dd9d2c0673 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:04.676500 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065223d7-cb6c-4bdb-8bfc-e7dd9d2c0673 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:04.686322 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1071/2149] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:23:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:23:04.790599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2215b-75c9-4e11-8cd5-a3a54832a75f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:04.792037 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-68e2215b-75c9-4e11-8cd5-a3a54832a75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:04.827277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065223d7-cb6c-4bdb-8bfc-e7dd9d2c0673 service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:04.828700 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-065223d7-cb6c-4bdb-8bfc-e7dd9d2c0673 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:04.839450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065223d7-cb6c-4bdb-8bfc-e7dd9d2c0673 service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:04.843586 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df88c7-929e-4e51-87e3-285c0cda954d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:04.844216 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df88c7-929e-4e51-87e3-285c0cda954d service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:04.844492 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df88c7-929e-4e51-87e3-285c0cda954d service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:04.844762 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df88c7-929e-4e51-87e3-285c0cda954d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:04.846527 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-08df88c7-929e-4e51-87e3-285c0cda954d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:04.858242 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2215b-75c9-4e11-8cd5-a3a54832a75f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:04.862678 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd62df-12d6-4bcd-954a-4c89040722d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:04.863522 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd62df-12d6-4bcd-954a-4c89040722d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:04.863912 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd62df-12d6-4bcd-954a-4c89040722d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:04.864189 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd62df-12d6-4bcd-954a-4c89040722d4 admin admin] PATH_INFO: `/v3/projects/d972fb70dbc542bb902d0cad941b83ee` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:04.865401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd62df-12d6-4bcd-954a-4c89040722d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d972fb70dbc542bb902d0cad941b83ee)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:04.867354 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd62df-12d6-4bcd-954a-4c89040722d4 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:04.906309 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df88c7-929e-4e51-87e3-285c0cda954d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:04.907747 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df88c7-929e-4e51-87e3-285c0cda954d service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:04.916841 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1072/2150] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:23:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:23:04.974640 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-86fd62df-12d6-4bcd-954a-4c89040722d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd972fb70dbc542bb902d0cad941b83ee', 'request_id': 'req-86fd62df-12d6-4bcd-954a-4c89040722d4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:04.979429 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-86fd62df-12d6-4bcd-954a-4c89040722d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd972fb70dbc542bb902d0cad941b83ee', 'request_id': 'req-86fd62df-12d6-4bcd-954a-4c89040722d4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:05.085471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-86fd62df-12d6-4bcd-954a-4c89040722d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd972fb70dbc542bb902d0cad941b83ee', 'request_id': 'req-86fd62df-12d6-4bcd-954a-4c89040722d4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:05.098072 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-86fd62df-12d6-4bcd-954a-4c89040722d4 admin admin] The token cache is being invalidate because project d972fb70dbc542bb902d0cad941b83ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:05.098554 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-86fd62df-12d6-4bcd-954a-4c89040722d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:05.099435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-86fd62df-12d6-4bcd-954a-4c89040722d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:05.102099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1079/2151] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:23:04 2022] DELETE /identity/v3/projects/d972fb70dbc542bb902d0cad941b83ee => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:05.105861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df88c7-929e-4e51-87e3-285c0cda954d service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:05.116966 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df88c7-929e-4e51-87e3-285c0cda954d service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:05.183557 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e687639-397a-4111-b190-e0db01e5dc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:05.184439 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e687639-397a-4111-b190-e0db01e5dc6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:05.185465 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e687639-397a-4111-b190-e0db01e5dc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:05.186165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e687639-397a-4111-b190-e0db01e5dc6b admin admin] PATH_INFO: `/v3/users/164724135b344273bb9cdd7e7d8a6250` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:05.195159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e687639-397a-4111-b190-e0db01e5dc6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=164724135b344273bb9cdd7e7d8a6250)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:05.197144 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e687639-397a-4111-b190-e0db01e5dc6b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:05.476395 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3e687639-397a-4111-b190-e0db01e5dc6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '164724135b344273bb9cdd7e7d8a6250'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:05.607120 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3e687639-397a-4111-b190-e0db01e5dc6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '164724135b344273bb9cdd7e7d8a6250'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:05.607754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3e687639-397a-4111-b190-e0db01e5dc6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '164724135b344273bb9cdd7e7d8a6250'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:05.620075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3e687639-397a-4111-b190-e0db01e5dc6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '164724135b344273bb9cdd7e7d8a6250'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:05.620771 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3e687639-397a-4111-b190-e0db01e5dc6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '164724135b344273bb9cdd7e7d8a6250'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:05.634378 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1073/2152] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:23:05 2022] DELETE /identity/v3/users/164724135b344273bb9cdd7e7d8a6250 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:06.078018 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd62df-12d6-4bcd-954a-4c89040722d4 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:06.080313 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-86fd62df-12d6-4bcd-954a-4c89040722d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:06.111229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd62df-12d6-4bcd-954a-4c89040722d4 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:06.167974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee012d4d-915c-4245-ac48-5d1b14ac2e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:06.168927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee012d4d-915c-4245-ac48-5d1b14ac2e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:06.169274 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee012d4d-915c-4245-ac48-5d1b14ac2e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:06.169551 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee012d4d-915c-4245-ac48-5d1b14ac2e65 admin admin] PATH_INFO: `/v3/projects/6c0be83db166477d8cf2f252bfd053df` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:06.170874 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee012d4d-915c-4245-ac48-5d1b14ac2e65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c0be83db166477d8cf2f252bfd053df)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:06.172889 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee012d4d-915c-4245-ac48-5d1b14ac2e65 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:06.349676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ee012d4d-915c-4245-ac48-5d1b14ac2e65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c0be83db166477d8cf2f252bfd053df', 'request_id': 'req-ee012d4d-915c-4245-ac48-5d1b14ac2e65'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:06.355913 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ee012d4d-915c-4245-ac48-5d1b14ac2e65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c0be83db166477d8cf2f252bfd053df', 'request_id': 'req-ee012d4d-915c-4245-ac48-5d1b14ac2e65'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:06.480820 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ee012d4d-915c-4245-ac48-5d1b14ac2e65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c0be83db166477d8cf2f252bfd053df', 'request_id': 'req-ee012d4d-915c-4245-ac48-5d1b14ac2e65'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:06.492840 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ee012d4d-915c-4245-ac48-5d1b14ac2e65 admin admin] The token cache is being invalidate because project 6c0be83db166477d8cf2f252bfd053df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:06.493133 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ee012d4d-915c-4245-ac48-5d1b14ac2e65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:06.493802 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ee012d4d-915c-4245-ac48-5d1b14ac2e65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:06.495421 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1080/2153] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:23:06 2022] DELETE /identity/v3/projects/6c0be83db166477d8cf2f252bfd053df => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:06.509428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae599d6-5d08-4701-8653-f4da7eb27f9d None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:06.509428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae599d6-5d08-4701-8653-f4da7eb27f9d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:06.509428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae599d6-5d08-4701-8653-f4da7eb27f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:06.522377 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-eae599d6-5d08-4701-8653-f4da7eb27f9d None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:06.523592 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-eae599d6-5d08-4701-8653-f4da7eb27f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:06.588408 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1074/2154] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:23:06.596578 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549700c-bffb-4025-bdfb-813a04324856 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:06.596864 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549700c-bffb-4025-bdfb-813a04324856 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:06.597140 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549700c-bffb-4025-bdfb-813a04324856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:06.615179 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9549700c-bffb-4025-bdfb-813a04324856 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:06.616414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9549700c-bffb-4025-bdfb-813a04324856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:06.625171 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1081/2155] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:06.629759 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae599d6-5d08-4701-8653-f4da7eb27f9d None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:06.640251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae599d6-5d08-4701-8653-f4da7eb27f9d None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:06.645148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe765c-ec97-4ff8-9ad4-508773403430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:06.645806 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe765c-ec97-4ff8-9ad4-508773403430 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:06.646092 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe765c-ec97-4ff8-9ad4-508773403430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:06.647071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe765c-ec97-4ff8-9ad4-508773403430 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:06.647200 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe765c-ec97-4ff8-9ad4-508773403430 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:23:06.647516 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe765c-ec97-4ff8-9ad4-508773403430 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:06.649112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe765c-ec97-4ff8-9ad4-508773403430 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:06.661272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1075/2156] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:23:06.665528 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549700c-bffb-4025-bdfb-813a04324856 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:06.675269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549700c-bffb-4025-bdfb-813a04324856 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:06.680047 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6d5bd-a69f-4820-8271-973b21246bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:06.680696 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6d5bd-a69f-4820-8271-973b21246bac admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:06.681486 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6d5bd-a69f-4820-8271-973b21246bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:06.681486 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6d5bd-a69f-4820-8271-973b21246bac admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:06.681967 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6d5bd-a69f-4820-8271-973b21246bac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:06.684422 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6d5bd-a69f-4820-8271-973b21246bac admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:06.780823 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1082/2157] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:23:06 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:06.785323 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe765c-ec97-4ff8-9ad4-508773403430 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:06.795772 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe765c-ec97-4ff8-9ad4-508773403430 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:06.849910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906d444-0396-4686-9023-cdf300936e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:06.850532 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906d444-0396-4686-9023-cdf300936e4f admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:06.850813 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906d444-0396-4686-9023-cdf300936e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:06.851087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906d444-0396-4686-9023-cdf300936e4f admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:06.851761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906d444-0396-4686-9023-cdf300936e4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:06.853661 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906d444-0396-4686-9023-cdf300936e4f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:06.961148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1076/2158] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:23:06 2022] POST /identity/v3/users => generated 283 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:06.965241 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6d5bd-a69f-4820-8271-973b21246bac admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:06.975577 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6d5bd-a69f-4820-8271-973b21246bac admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:06.980393 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729bc4f-7198-4186-ab8c-6fe6da86c57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:06.981049 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729bc4f-7198-4186-ab8c-6fe6da86c57c admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:06.981334 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729bc4f-7198-4186-ab8c-6fe6da86c57c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:06.982104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729bc4f-7198-4186-ab8c-6fe6da86c57c admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:06.982866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729bc4f-7198-4186-ab8c-6fe6da86c57c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:06.984479 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729bc4f-7198-4186-ab8c-6fe6da86c57c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:06.995076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1083/2159] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:07.000069 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906d444-0396-4686-9023-cdf300936e4f admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:07.010251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906d444-0396-4686-9023-cdf300936e4f admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:07.015419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0debc7-2488-42a8-8f49-ece5fad0c2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:07.016246 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0debc7-2488-42a8-8f49-ece5fad0c2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:07.016557 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0debc7-2488-42a8-8f49-ece5fad0c2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:07.016874 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0debc7-2488-42a8-8f49-ece5fad0c2a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:07.023139 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0debc7-2488-42a8-8f49-ece5fad0c2a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:07.023139 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0debc7-2488-42a8-8f49-ece5fad0c2a3 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:07.032984 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1077/2160] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:07.034163 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729bc4f-7198-4186-ab8c-6fe6da86c57c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:07.044708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729bc4f-7198-4186-ab8c-6fe6da86c57c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:07.054902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5beeeb-640a-4471-a83a-2216c91bd2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:07.054902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5beeeb-640a-4471-a83a-2216c91bd2be admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:07.054902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5beeeb-640a-4471-a83a-2216c91bd2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:07.054902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5beeeb-640a-4471-a83a-2216c91bd2be admin admin] PATH_INFO: `/v3/projects/a943bdb55fa34b2d924171fb21abd04a/users/97d634a0c9ae461895a970dfcf64b59b/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:07.069900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5beeeb-640a-4471-a83a-2216c91bd2be admin admin] RBAC: Authorizing `identity:create_grant(project_id=a943bdb55fa34b2d924171fb21abd04a, user_id=97d634a0c9ae461895a970dfcf64b59b, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:07.072615 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5beeeb-640a-4471-a83a-2216c91bd2be admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:07.161135 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1084/2161] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:23:07 2022] PUT /identity/v3/projects/a943bdb55fa34b2d924171fb21abd04a/users/97d634a0c9ae461895a970dfcf64b59b/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:07.172892 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a64f6-0e44-45fb-8f7f-0cc9397b4d1c None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:07.173181 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a64f6-0e44-45fb-8f7f-0cc9397b4d1c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:07.173459 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a64f6-0e44-45fb-8f7f-0cc9397b4d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:07.203171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-159a64f6-0e44-45fb-8f7f-0cc9397b4d1c None None] MFA Rules not processed for user `97d634a0c9ae461895a970dfcf64b59b`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:07.204722 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-159a64f6-0e44-45fb-8f7f-0cc9397b4d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:07.274204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1078/2162] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:07.279412 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5beeeb-640a-4471-a83a-2216c91bd2be admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:07.342358 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5beeeb-640a-4471-a83a-2216c91bd2be admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:07.346992 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6936688-ca48-4b19-8466-8e4aa1497c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:07.347761 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6936688-ca48-4b19-8466-8e4aa1497c79 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:07.348037 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6936688-ca48-4b19-8466-8e4aa1497c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:07.348309 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6936688-ca48-4b19-8466-8e4aa1497c79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:07.349054 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6936688-ca48-4b19-8466-8e4aa1497c79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:07.350956 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6936688-ca48-4b19-8466-8e4aa1497c79 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:07.409499 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a64f6-0e44-45fb-8f7f-0cc9397b4d1c None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:07.411463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-159a64f6-0e44-45fb-8f7f-0cc9397b4d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:07.425618 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a64f6-0e44-45fb-8f7f-0cc9397b4d1c None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:07.430387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d8cfe-4f00-488b-b1ce-71f94a4c62c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:07.431254 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d8cfe-4f00-488b-b1ce-71f94a4c62c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:07.431535 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d8cfe-4f00-488b-b1ce-71f94a4c62c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:07.431812 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d8cfe-4f00-488b-b1ce-71f94a4c62c4 admin admin] PATH_INFO: `/v3/users/8bb9f72d0faa46e1ab839c9ae6f29268` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:07.433015 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d8cfe-4f00-488b-b1ce-71f94a4c62c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bb9f72d0faa46e1ab839c9ae6f29268)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:07.434988 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d8cfe-4f00-488b-b1ce-71f94a4c62c4 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:07.518170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1085/2163] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:23:07 2022] POST /identity/v3/projects => generated 363 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:07.521722 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6936688-ca48-4b19-8466-8e4aa1497c79 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:07.581891 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6936688-ca48-4b19-8466-8e4aa1497c79 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:07.586821 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759d5a6-1d7c-42c9-b179-2d7b2458d81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:07.587575 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759d5a6-1d7c-42c9-b179-2d7b2458d81d admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:07.587844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759d5a6-1d7c-42c9-b179-2d7b2458d81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:07.592498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759d5a6-1d7c-42c9-b179-2d7b2458d81d admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:07.592498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759d5a6-1d7c-42c9-b179-2d7b2458d81d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:07.592498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759d5a6-1d7c-42c9-b179-2d7b2458d81d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:07.764324 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1086/2164] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:23:07 2022] POST /identity/v3/users => generated 288 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:23:07.765578 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759d5a6-1d7c-42c9-b179-2d7b2458d81d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:07.769091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-944d8cfe-4f00-488b-b1ce-71f94a4c62c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bb9f72d0faa46e1ab839c9ae6f29268'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:07.775216 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759d5a6-1d7c-42c9-b179-2d7b2458d81d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:07.780629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ae063-85b2-4feb-aed3-5ed08988a2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:07.781277 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ae063-85b2-4feb-aed3-5ed08988a2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:07.781566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ae063-85b2-4feb-aed3-5ed08988a2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:07.781838 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ae063-85b2-4feb-aed3-5ed08988a2b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:07.782607 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ae063-85b2-4feb-aed3-5ed08988a2b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:07.784222 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ae063-85b2-4feb-aed3-5ed08988a2b8 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:07.803906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1087/2165] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:23:07.804887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ae063-85b2-4feb-aed3-5ed08988a2b8 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:07.815319 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ae063-85b2-4feb-aed3-5ed08988a2b8 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:07.820615 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ec56c-adf1-43a1-9c9f-25c4f521e50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:07.821552 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ec56c-adf1-43a1-9c9f-25c4f521e50e admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:07.821835 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ec56c-adf1-43a1-9c9f-25c4f521e50e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:07.822108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ec56c-adf1-43a1-9c9f-25c4f521e50e admin admin] PATH_INFO: `/v3/projects/95c098908e5c48a7a8f24bc84ccedceb/users/3190677e21a04d748a9110355a1889df/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:07.842600 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ec56c-adf1-43a1-9c9f-25c4f521e50e admin admin] RBAC: Authorizing `identity:create_grant(project_id=95c098908e5c48a7a8f24bc84ccedceb, user_id=3190677e21a04d748a9110355a1889df, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:07.845245 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ec56c-adf1-43a1-9c9f-25c4f521e50e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:07.846729 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-944d8cfe-4f00-488b-b1ce-71f94a4c62c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bb9f72d0faa46e1ab839c9ae6f29268'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:07.847415 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-944d8cfe-4f00-488b-b1ce-71f94a4c62c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bb9f72d0faa46e1ab839c9ae6f29268'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:07.860353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-944d8cfe-4f00-488b-b1ce-71f94a4c62c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bb9f72d0faa46e1ab839c9ae6f29268'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:07.861004 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-944d8cfe-4f00-488b-b1ce-71f94a4c62c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bb9f72d0faa46e1ab839c9ae6f29268'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:07.873043 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1079/2166] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:23:07 2022] DELETE /identity/v3/users/8bb9f72d0faa46e1ab839c9ae6f29268 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:23:07.877257 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66784617-2046-4b14-80ad-322a441446ec None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:07.877546 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66784617-2046-4b14-80ad-322a441446ec None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:07.877823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66784617-2046-4b14-80ad-322a441446ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:07.894250 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-66784617-2046-4b14-80ad-322a441446ec None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:07.895365 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-66784617-2046-4b14-80ad-322a441446ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:07.953821 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1080/2167] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:23:07.956366 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1088/2168] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:23:07 2022] PUT /identity/v3/projects/95c098908e5c48a7a8f24bc84ccedceb/users/3190677e21a04d748a9110355a1889df/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:23:07.964695 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66784617-2046-4b14-80ad-322a441446ec None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:07.964695 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-66784617-2046-4b14-80ad-322a441446ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:07.965186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ec56c-adf1-43a1-9c9f-25c4f521e50e admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:07.965186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e87ec56c-adf1-43a1-9c9f-25c4f521e50e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:07.974052 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66784617-2046-4b14-80ad-322a441446ec None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:08.027093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ec56c-adf1-43a1-9c9f-25c4f521e50e admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:08.033398 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f676d31-dd78-41f4-81de-d7cde34be4ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:08.034274 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f676d31-dd78-41f4-81de-d7cde34be4ab service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:08.034712 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f676d31-dd78-41f4-81de-d7cde34be4ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:08.034991 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f676d31-dd78-41f4-81de-d7cde34be4ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:08.035604 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93c2a1-35c9-4ae3-8465-780f7c0da9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:08.036277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93c2a1-35c9-4ae3-8465-780f7c0da9ae admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:08.036553 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93c2a1-35c9-4ae3-8465-780f7c0da9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:08.036825 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93c2a1-35c9-4ae3-8465-780f7c0da9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:08.037549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93c2a1-35c9-4ae3-8465-780f7c0da9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:08.039197 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93c2a1-35c9-4ae3-8465-780f7c0da9ae admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:08.049232 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f676d31-dd78-41f4-81de-d7cde34be4ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:08.049232 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f676d31-dd78-41f4-81de-d7cde34be4ab service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:08.053875 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1081/2169] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:08.056929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93c2a1-35c9-4ae3-8465-780f7c0da9ae admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:08.074439 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1089/2170] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:23:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:23:08.075195 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93c2a1-35c9-4ae3-8465-780f7c0da9ae admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:08.080448 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d481e-93b9-45c0-afcc-2a39cacb879f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:08.081511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d481e-93b9-45c0-afcc-2a39cacb879f admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:08.081902 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d481e-93b9-45c0-afcc-2a39cacb879f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:08.082493 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d481e-93b9-45c0-afcc-2a39cacb879f admin admin] PATH_INFO: `/v3/projects/95c098908e5c48a7a8f24bc84ccedceb/users/3190677e21a04d748a9110355a1889df/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:08.084350 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d481e-93b9-45c0-afcc-2a39cacb879f admin admin] RBAC: Authorizing `identity:create_grant(project_id=95c098908e5c48a7a8f24bc84ccedceb, user_id=3190677e21a04d748a9110355a1889df, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:08.087339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d481e-93b9-45c0-afcc-2a39cacb879f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:08.112639 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ec4d7-de4e-468b-b244-914959ef1580 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:08.113084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ec4d7-de4e-468b-b244-914959ef1580 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:08.113384 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ec4d7-de4e-468b-b244-914959ef1580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:08.114849 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1082/2171] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:23:08 2022] PUT /identity/v3/projects/95c098908e5c48a7a8f24bc84ccedceb/users/3190677e21a04d748a9110355a1889df/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:23:08.169896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-851ec4d7-de4e-468b-b244-914959ef1580 None None] MFA Rules not processed for user `3190677e21a04d748a9110355a1889df`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:08.171434 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-851ec4d7-de4e-468b-b244-914959ef1580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:08.259859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1090/2172] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:08 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:08.294238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d481e-93b9-45c0-afcc-2a39cacb879f admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:08.296051 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-812d481e-93b9-45c0-afcc-2a39cacb879f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:08.360761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d481e-93b9-45c0-afcc-2a39cacb879f admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:08.364755 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59654e-d1f3-489c-8758-808361463ad3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:08.365468 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59654e-d1f3-489c-8758-808361463ad3 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:08.365879 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59654e-d1f3-489c-8758-808361463ad3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:08.366246 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59654e-d1f3-489c-8758-808361463ad3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:08.376023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59654e-d1f3-489c-8758-808361463ad3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:08.377529 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59654e-d1f3-489c-8758-808361463ad3 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:08.388251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1083/2173] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:23:08 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:08.536116 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ec4d7-de4e-468b-b244-914959ef1580 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:08.538957 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-851ec4d7-de4e-468b-b244-914959ef1580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:08.611982 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ec4d7-de4e-468b-b244-914959ef1580 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:08.616822 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476f983-fe8e-4fbc-b9a9-b5104e98890b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:08.617690 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476f983-fe8e-4fbc-b9a9-b5104e98890b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:08.619530 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476f983-fe8e-4fbc-b9a9-b5104e98890b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:08.619530 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476f983-fe8e-4fbc-b9a9-b5104e98890b admin admin] PATH_INFO: `/v3/projects/14bef94eb6d642d1adb9c83a4ff93ffa` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:08.619530 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2476f983-fe8e-4fbc-b9a9-b5104e98890b admin admin] RBAC: Authorizing `identity:delete_project(project_id=14bef94eb6d642d1adb9c83a4ff93ffa)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:08.622560 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2476f983-fe8e-4fbc-b9a9-b5104e98890b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:08.749380 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-2476f983-fe8e-4fbc-b9a9-b5104e98890b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14bef94eb6d642d1adb9c83a4ff93ffa', 'request_id': 'req-2476f983-fe8e-4fbc-b9a9-b5104e98890b'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:08.755552 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-2476f983-fe8e-4fbc-b9a9-b5104e98890b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14bef94eb6d642d1adb9c83a4ff93ffa', 'request_id': 'req-2476f983-fe8e-4fbc-b9a9-b5104e98890b'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:08.773998 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59654e-d1f3-489c-8758-808361463ad3 service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:08.783399 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59654e-d1f3-489c-8758-808361463ad3 service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:08.834917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ea82f-6805-4b30-adfc-4e3e0ce75148 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:08.835706 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ea82f-6805-4b30-adfc-4e3e0ce75148 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:08.836029 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ea82f-6805-4b30-adfc-4e3e0ce75148 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:08.836290 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ea82f-6805-4b30-adfc-4e3e0ce75148 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:08.838070 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-896ea82f-6805-4b30-adfc-4e3e0ce75148 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:08.881530 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-2476f983-fe8e-4fbc-b9a9-b5104e98890b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14bef94eb6d642d1adb9c83a4ff93ffa', 'request_id': 'req-2476f983-fe8e-4fbc-b9a9-b5104e98890b'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:08.924723 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-2476f983-fe8e-4fbc-b9a9-b5104e98890b admin admin] The token cache is being invalidate because project 14bef94eb6d642d1adb9c83a4ff93ffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:08.928847 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-2476f983-fe8e-4fbc-b9a9-b5104e98890b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:08.930419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-2476f983-fe8e-4fbc-b9a9-b5104e98890b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:08.933738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1091/2174] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:23:08 2022] DELETE /identity/v3/projects/14bef94eb6d642d1adb9c83a4ff93ffa => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:08.934697 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ea82f-6805-4b30-adfc-4e3e0ce75148 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:08.936747 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ea82f-6805-4b30-adfc-4e3e0ce75148 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:08.938166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476f983-fe8e-4fbc-b9a9-b5104e98890b admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:08.940884 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2476f983-fe8e-4fbc-b9a9-b5104e98890b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:08.952511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1084/2175] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:23:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:09.083613 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476f983-fe8e-4fbc-b9a9-b5104e98890b admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:09.083613 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280c43d-470c-4cc7-ac3e-e70906b3051a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:09.083613 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280c43d-470c-4cc7-ac3e-e70906b3051a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:09.083613 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280c43d-470c-4cc7-ac3e-e70906b3051a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:09.084584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280c43d-470c-4cc7-ac3e-e70906b3051a admin admin] PATH_INFO: `/v3/users/b3901ec0b35b406d855bb46033665826` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:09.084584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280c43d-470c-4cc7-ac3e-e70906b3051a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3901ec0b35b406d855bb46033665826)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:09.084584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280c43d-470c-4cc7-ac3e-e70906b3051a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:09.453520 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e280c43d-470c-4cc7-ac3e-e70906b3051a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3901ec0b35b406d855bb46033665826'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:09.472018 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e280c43d-470c-4cc7-ac3e-e70906b3051a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3901ec0b35b406d855bb46033665826'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:09.472789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e280c43d-470c-4cc7-ac3e-e70906b3051a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3901ec0b35b406d855bb46033665826'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:09.473371 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e280c43d-470c-4cc7-ac3e-e70906b3051a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3901ec0b35b406d855bb46033665826'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:09.486303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e280c43d-470c-4cc7-ac3e-e70906b3051a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3901ec0b35b406d855bb46033665826'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:09.600789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1092/2176] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:23:08 2022] DELETE /identity/v3/users/b3901ec0b35b406d855bb46033665826 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:10.077583 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ea82f-6805-4b30-adfc-4e3e0ce75148 service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:10.096754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ea82f-6805-4b30-adfc-4e3e0ce75148 service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:10.166609 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831b7f1-18e7-406a-9cf7-ae8f47bb5b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:10.167482 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831b7f1-18e7-406a-9cf7-ae8f47bb5b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:10.167764 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831b7f1-18e7-406a-9cf7-ae8f47bb5b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:10.168040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831b7f1-18e7-406a-9cf7-ae8f47bb5b00 admin admin] PATH_INFO: `/v3/projects/86f0dd56abb746d79885f77ebd489a4b` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:10.170103 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831b7f1-18e7-406a-9cf7-ae8f47bb5b00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86f0dd56abb746d79885f77ebd489a4b)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:10.172203 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831b7f1-18e7-406a-9cf7-ae8f47bb5b00 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:10.286917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f831b7f1-18e7-406a-9cf7-ae8f47bb5b00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86f0dd56abb746d79885f77ebd489a4b', 'request_id': 'req-f831b7f1-18e7-406a-9cf7-ae8f47bb5b00'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:10.355229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f831b7f1-18e7-406a-9cf7-ae8f47bb5b00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86f0dd56abb746d79885f77ebd489a4b', 'request_id': 'req-f831b7f1-18e7-406a-9cf7-ae8f47bb5b00'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:10.362979 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f831b7f1-18e7-406a-9cf7-ae8f47bb5b00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86f0dd56abb746d79885f77ebd489a4b', 'request_id': 'req-f831b7f1-18e7-406a-9cf7-ae8f47bb5b00'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:10.373692 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f831b7f1-18e7-406a-9cf7-ae8f47bb5b00 admin admin] The token cache is being invalidate because project 86f0dd56abb746d79885f77ebd489a4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:10.373984 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f831b7f1-18e7-406a-9cf7-ae8f47bb5b00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:10.374660 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f831b7f1-18e7-406a-9cf7-ae8f47bb5b00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:10.376203 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1085/2177] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:23:10 2022] DELETE /identity/v3/projects/86f0dd56abb746d79885f77ebd489a4b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:10.380265 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280c43d-470c-4cc7-ac3e-e70906b3051a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:10.381866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e280c43d-470c-4cc7-ac3e-e70906b3051a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:10.396200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280c43d-470c-4cc7-ac3e-e70906b3051a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:10.453686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd56839-a2e2-4fcb-a396-670dc64e9321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:10.454593 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd56839-a2e2-4fcb-a396-670dc64e9321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:10.455040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd56839-a2e2-4fcb-a396-670dc64e9321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:10.455431 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd56839-a2e2-4fcb-a396-670dc64e9321 admin admin] PATH_INFO: `/v3/users/80877a76a58247d5b4100425a47c9930` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:10.456636 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd56839-a2e2-4fcb-a396-670dc64e9321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80877a76a58247d5b4100425a47c9930)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:10.458604 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd56839-a2e2-4fcb-a396-670dc64e9321 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:10.710174 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-cbd56839-a2e2-4fcb-a396-670dc64e9321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80877a76a58247d5b4100425a47c9930'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:10.724178 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-cbd56839-a2e2-4fcb-a396-670dc64e9321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80877a76a58247d5b4100425a47c9930'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:10.725050 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-cbd56839-a2e2-4fcb-a396-670dc64e9321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80877a76a58247d5b4100425a47c9930'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:10.725899 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-cbd56839-a2e2-4fcb-a396-670dc64e9321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80877a76a58247d5b4100425a47c9930'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:10.737678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831b7f1-18e7-406a-9cf7-ae8f47bb5b00 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:10.739475 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f831b7f1-18e7-406a-9cf7-ae8f47bb5b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:10.740401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-cbd56839-a2e2-4fcb-a396-670dc64e9321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80877a76a58247d5b4100425a47c9930'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:10.756673 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831b7f1-18e7-406a-9cf7-ae8f47bb5b00 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:10.761300 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ff601-a23f-4f4d-b9da-0b4c9962514c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:10.762288 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ff601-a23f-4f4d-b9da-0b4c9962514c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:10.762635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ff601-a23f-4f4d-b9da-0b4c9962514c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:10.763532 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ff601-a23f-4f4d-b9da-0b4c9962514c admin admin] PATH_INFO: `/v3/users/6bbb3a6f12024291bbe4b2cba4eecb69` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:10.764834 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ff601-a23f-4f4d-b9da-0b4c9962514c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bbb3a6f12024291bbe4b2cba4eecb69)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:10.766969 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ff601-a23f-4f4d-b9da-0b4c9962514c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:10.842846 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1093/2178] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:23:10 2022] DELETE /identity/v3/users/80877a76a58247d5b4100425a47c9930 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:10.963318 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e50ff601-a23f-4f4d-b9da-0b4c9962514c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bbb3a6f12024291bbe4b2cba4eecb69'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:11.063714 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e50ff601-a23f-4f4d-b9da-0b4c9962514c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bbb3a6f12024291bbe4b2cba4eecb69'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:11.064363 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e50ff601-a23f-4f4d-b9da-0b4c9962514c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bbb3a6f12024291bbe4b2cba4eecb69'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:11.091356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e50ff601-a23f-4f4d-b9da-0b4c9962514c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bbb3a6f12024291bbe4b2cba4eecb69'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:11.092086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e50ff601-a23f-4f4d-b9da-0b4c9962514c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bbb3a6f12024291bbe4b2cba4eecb69'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:11.123746 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1086/2179] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:23:10 2022] DELETE /identity/v3/users/6bbb3a6f12024291bbe4b2cba4eecb69 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:23:11.129022 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93936b-e1b2-4c4e-9be4-ef74ed266d1d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:11.130170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93936b-e1b2-4c4e-9be4-ef74ed266d1d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:11.130556 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93936b-e1b2-4c4e-9be4-ef74ed266d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:11.157170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-2c93936b-e1b2-4c4e-9be4-ef74ed266d1d None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:11.158651 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2c93936b-e1b2-4c4e-9be4-ef74ed266d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:11.226863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1094/2180] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:11.237694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ff601-a23f-4f4d-b9da-0b4c9962514c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:11.242068 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e50ff601-a23f-4f4d-b9da-0b4c9962514c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:11.302864 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ff601-a23f-4f4d-b9da-0b4c9962514c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:11.306634 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906963e-f949-4315-8f6a-750a20d22de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:11.307328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906963e-f949-4315-8f6a-750a20d22de1 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:11.307594 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906963e-f949-4315-8f6a-750a20d22de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:11.307872 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906963e-f949-4315-8f6a-750a20d22de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:11.317624 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906963e-f949-4315-8f6a-750a20d22de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:11.319161 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906963e-f949-4315-8f6a-750a20d22de1 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:11.328782 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1087/2181] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:23:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:11.370841 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93936b-e1b2-4c4e-9be4-ef74ed266d1d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:11.370841 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2c93936b-e1b2-4c4e-9be4-ef74ed266d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:11.378537 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93936b-e1b2-4c4e-9be4-ef74ed266d1d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:11.383956 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13f5c7-3d70-486d-b0b9-a819b6328442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:11.385135 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13f5c7-3d70-486d-b0b9-a819b6328442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:11.385643 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13f5c7-3d70-486d-b0b9-a819b6328442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:11.386159 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13f5c7-3d70-486d-b0b9-a819b6328442 admin admin] PATH_INFO: `/v3/projects/92f7e939fa884cbd8e0472eb696e29f7` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:11.387619 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13f5c7-3d70-486d-b0b9-a819b6328442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92f7e939fa884cbd8e0472eb696e29f7)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:11.389872 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13f5c7-3d70-486d-b0b9-a819b6328442 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:11.515536 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4a13f5c7-3d70-486d-b0b9-a819b6328442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92f7e939fa884cbd8e0472eb696e29f7', 'request_id': 'req-4a13f5c7-3d70-486d-b0b9-a819b6328442'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:11.522084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4a13f5c7-3d70-486d-b0b9-a819b6328442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92f7e939fa884cbd8e0472eb696e29f7', 'request_id': 'req-4a13f5c7-3d70-486d-b0b9-a819b6328442'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:11.657186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4a13f5c7-3d70-486d-b0b9-a819b6328442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92f7e939fa884cbd8e0472eb696e29f7', 'request_id': 'req-4a13f5c7-3d70-486d-b0b9-a819b6328442'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:11.668940 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4a13f5c7-3d70-486d-b0b9-a819b6328442 admin admin] The token cache is being invalidate because project 92f7e939fa884cbd8e0472eb696e29f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:11.669426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4a13f5c7-3d70-486d-b0b9-a819b6328442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:11.670090 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4a13f5c7-3d70-486d-b0b9-a819b6328442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:11.671679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1095/2182] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:23:11 2022] DELETE /identity/v3/projects/92f7e939fa884cbd8e0472eb696e29f7 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:11.676662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb78f9-5ee4-4d50-85e5-e1bc7915ed88 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:11.676949 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb78f9-5ee4-4d50-85e5-e1bc7915ed88 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:11.677221 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb78f9-5ee4-4d50-85e5-e1bc7915ed88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:11.695615 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-34cb78f9-5ee4-4d50-85e5-e1bc7915ed88 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:11.696871 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-34cb78f9-5ee4-4d50-85e5-e1bc7915ed88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:11.762611 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1088/2183] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:11.770713 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214440cf-d392-48b4-a638-eaaf0538bc01 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:11.770999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214440cf-d392-48b4-a638-eaaf0538bc01 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:11.771276 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214440cf-d392-48b4-a638-eaaf0538bc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:11.795881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-214440cf-d392-48b4-a638-eaaf0538bc01 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:11.797360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-214440cf-d392-48b4-a638-eaaf0538bc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:11.798015 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb78f9-5ee4-4d50-85e5-e1bc7915ed88 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:11.799383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-34cb78f9-5ee4-4d50-85e5-e1bc7915ed88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:11.811733 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1096/2184] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:23:11.813521 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb78f9-5ee4-4d50-85e5-e1bc7915ed88 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:11.815267 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214440cf-d392-48b4-a638-eaaf0538bc01 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:11.819133 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa1c2f-c682-4feb-b892-688cab402ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:11.820501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa1c2f-c682-4feb-b892-688cab402ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:11.820501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa1c2f-c682-4feb-b892-688cab402ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:11.821189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa1c2f-c682-4feb-b892-688cab402ca8 admin admin] PATH_INFO: `/v3/projects/1c8bcf38bb3e4c07b29d30f20a11b1f5` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:11.825133 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa1c2f-c682-4feb-b892-688cab402ca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c8bcf38bb3e4c07b29d30f20a11b1f5)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:11.826751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214440cf-d392-48b4-a638-eaaf0538bc01 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:11.827269 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa1c2f-c682-4feb-b892-688cab402ca8 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:11.835315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526fd5b-1a7f-4a7b-b3fb-946ac9be89b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:11.836663 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526fd5b-1a7f-4a7b-b3fb-946ac9be89b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:11.836999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526fd5b-1a7f-4a7b-b3fb-946ac9be89b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:11.837593 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526fd5b-1a7f-4a7b-b3fb-946ac9be89b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:11.840065 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526fd5b-1a7f-4a7b-b3fb-946ac9be89b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:23:11.840394 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526fd5b-1a7f-4a7b-b3fb-946ac9be89b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:11.844108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526fd5b-1a7f-4a7b-b3fb-946ac9be89b6 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:11.865350 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1097/2185] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:23:11.866296 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526fd5b-1a7f-4a7b-b3fb-946ac9be89b6 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:11.876836 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526fd5b-1a7f-4a7b-b3fb-946ac9be89b6 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:11.881818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f638d-a82d-4028-b174-c5d882ca808f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:11.882641 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f638d-a82d-4028-b174-c5d882ca808f admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:11.882911 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f638d-a82d-4028-b174-c5d882ca808f admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:11.883203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f638d-a82d-4028-b174-c5d882ca808f admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:11.883905 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f638d-a82d-4028-b174-c5d882ca808f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:11.885831 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f638d-a82d-4028-b174-c5d882ca808f admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:11.948568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-acaa1c2f-c682-4feb-b892-688cab402ca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c8bcf38bb3e4c07b29d30f20a11b1f5', 'request_id': 'req-acaa1c2f-c682-4feb-b892-688cab402ca8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:12.017915 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-acaa1c2f-c682-4feb-b892-688cab402ca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c8bcf38bb3e4c07b29d30f20a11b1f5', 'request_id': 'req-acaa1c2f-c682-4feb-b892-688cab402ca8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:12.025193 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-acaa1c2f-c682-4feb-b892-688cab402ca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c8bcf38bb3e4c07b29d30f20a11b1f5', 'request_id': 'req-acaa1c2f-c682-4feb-b892-688cab402ca8'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:12.025825 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1098/2186] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:23:11 2022] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:23:12.031401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f638d-a82d-4028-b174-c5d882ca808f admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:12.041451 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-acaa1c2f-c682-4feb-b892-688cab402ca8 admin admin] The token cache is being invalidate because project 1c8bcf38bb3e4c07b29d30f20a11b1f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:12.042146 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-acaa1c2f-c682-4feb-b892-688cab402ca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:12.043079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-acaa1c2f-c682-4feb-b892-688cab402ca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:12.045762 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1089/2187] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:23:11 2022] DELETE /identity/v3/projects/1c8bcf38bb3e4c07b29d30f20a11b1f5 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:23:12.049120 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa1c2f-c682-4feb-b892-688cab402ca8 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:12.050979 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-acaa1c2f-c682-4feb-b892-688cab402ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:12.118849 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f638d-a82d-4028-b174-c5d882ca808f admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:12.124067 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61f0b3-7cb5-4ff0-bbef-a853e54daed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:12.128739 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61f0b3-7cb5-4ff0-bbef-a853e54daed5 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:12.128739 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61f0b3-7cb5-4ff0-bbef-a853e54daed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:12.128739 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61f0b3-7cb5-4ff0-bbef-a853e54daed5 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:12.128739 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61f0b3-7cb5-4ff0-bbef-a853e54daed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:12.129100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa1c2f-c682-4feb-b892-688cab402ca8 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:12.129539 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61f0b3-7cb5-4ff0-bbef-a853e54daed5 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:12.136382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb014e-714e-45a2-a9c4-1440d534cd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:12.137497 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb014e-714e-45a2-a9c4-1440d534cd1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:12.138439 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb014e-714e-45a2-a9c4-1440d534cd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:12.138816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb014e-714e-45a2-a9c4-1440d534cd1e admin admin] PATH_INFO: `/v3/users/cdeb7fbf30f243c7b6083c94aa2ed189` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:12.140689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb014e-714e-45a2-a9c4-1440d534cd1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdeb7fbf30f243c7b6083c94aa2ed189)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:12.142828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb014e-714e-45a2-a9c4-1440d534cd1e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:12.246756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1099/2188] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:23:12 2022] POST /identity/v3/users => generated 288 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:12.253471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61f0b3-7cb5-4ff0-bbef-a853e54daed5 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:12.255076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2d61f0b3-7cb5-4ff0-bbef-a853e54daed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:12.267016 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61f0b3-7cb5-4ff0-bbef-a853e54daed5 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:12.271614 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70bb6d-bb8a-4a11-82a0-d2d821192f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:12.272237 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70bb6d-bb8a-4a11-82a0-d2d821192f88 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:12.272515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70bb6d-bb8a-4a11-82a0-d2d821192f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:12.272784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70bb6d-bb8a-4a11-82a0-d2d821192f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:12.273498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70bb6d-bb8a-4a11-82a0-d2d821192f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:12.275102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70bb6d-bb8a-4a11-82a0-d2d821192f88 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:12.284599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1100/2189] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:23:12.288343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70bb6d-bb8a-4a11-82a0-d2d821192f88 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:12.297262 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70bb6d-bb8a-4a11-82a0-d2d821192f88 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:12.301779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e33eaf-0066-4e61-b7ce-bdd5d00588df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:12.302395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e33eaf-0066-4e61-b7ce-bdd5d00588df admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:12.302674 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e33eaf-0066-4e61-b7ce-bdd5d00588df admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:12.302945 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e33eaf-0066-4e61-b7ce-bdd5d00588df admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:12.303629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e33eaf-0066-4e61-b7ce-bdd5d00588df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:12.305130 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e33eaf-0066-4e61-b7ce-bdd5d00588df admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:12.315467 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1101/2190] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:23:12.328945 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e33eaf-0066-4e61-b7ce-bdd5d00588df admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:12.338448 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e33eaf-0066-4e61-b7ce-bdd5d00588df admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:12.343030 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84d907-464b-444f-8725-fd461d4a50e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:12.343879 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84d907-464b-444f-8725-fd461d4a50e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:12.344160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84d907-464b-444f-8725-fd461d4a50e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:12.344436 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84d907-464b-444f-8725-fd461d4a50e7 admin admin] PATH_INFO: `/v3/projects/fa49f4881c1041528d8071d3cc64a5b0/users/5d7434af378b4247aefbe0783cd128c0/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:12.378009 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84d907-464b-444f-8725-fd461d4a50e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa49f4881c1041528d8071d3cc64a5b0, user_id=5d7434af378b4247aefbe0783cd128c0, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:12.378115 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b0bb014e-714e-45a2-a9c4-1440d534cd1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdeb7fbf30f243c7b6083c94aa2ed189'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:12.378247 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84d907-464b-444f-8725-fd461d4a50e7 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:12.566397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b0bb014e-714e-45a2-a9c4-1440d534cd1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdeb7fbf30f243c7b6083c94aa2ed189'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:12.567176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b0bb014e-714e-45a2-a9c4-1440d534cd1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdeb7fbf30f243c7b6083c94aa2ed189'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:12.572613 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1102/2191] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:23:12 2022] PUT /identity/v3/projects/fa49f4881c1041528d8071d3cc64a5b0/users/5d7434af378b4247aefbe0783cd128c0/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:23:12.581343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b0bb014e-714e-45a2-a9c4-1440d534cd1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdeb7fbf30f243c7b6083c94aa2ed189'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:12.584559 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b0bb014e-714e-45a2-a9c4-1440d534cd1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdeb7fbf30f243c7b6083c94aa2ed189'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:12.585262 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7982382-787d-4800-9b2e-8736db4d2783 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:12.585552 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7982382-787d-4800-9b2e-8736db4d2783 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:12.585830 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7982382-787d-4800-9b2e-8736db4d2783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:12.607957 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1090/2192] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:23:12 2022] DELETE /identity/v3/users/cdeb7fbf30f243c7b6083c94aa2ed189 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:12.623872 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b7982382-787d-4800-9b2e-8736db4d2783 None None] MFA Rules not processed for user `5d7434af378b4247aefbe0783cd128c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:12.623872 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b7982382-787d-4800-9b2e-8736db4d2783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:12.688924 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1103/2193] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:23:12.703932 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb014e-714e-45a2-a9c4-1440d534cd1e admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:12.705371 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b0bb014e-714e-45a2-a9c4-1440d534cd1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:12.761554 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb014e-714e-45a2-a9c4-1440d534cd1e admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:12.765123 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908a1dc-6b80-4de3-b04e-aa45f5915b25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:12.765762 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908a1dc-6b80-4de3-b04e-aa45f5915b25 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:12.766069 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908a1dc-6b80-4de3-b04e-aa45f5915b25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:12.766384 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908a1dc-6b80-4de3-b04e-aa45f5915b25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:12.774491 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908a1dc-6b80-4de3-b04e-aa45f5915b25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:12.776059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908a1dc-6b80-4de3-b04e-aa45f5915b25 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:12.784592 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1091/2194] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:23:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:13.076034 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7982382-787d-4800-9b2e-8736db4d2783 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:13.081381 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b7982382-787d-4800-9b2e-8736db4d2783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:13.146198 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7982382-787d-4800-9b2e-8736db4d2783 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:13.151227 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe65ee5-b485-4477-a594-1b18a6d49c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:13.152087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe65ee5-b485-4477-a594-1b18a6d49c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:13.152371 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe65ee5-b485-4477-a594-1b18a6d49c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:13.152650 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe65ee5-b485-4477-a594-1b18a6d49c67 admin admin] PATH_INFO: `/v3/projects/c51c33d7c15d4504a393bcb2b8d326d4` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:13.154629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe65ee5-b485-4477-a594-1b18a6d49c67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c51c33d7c15d4504a393bcb2b8d326d4)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:13.156558 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe65ee5-b485-4477-a594-1b18a6d49c67 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:13.297825 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-cbe65ee5-b485-4477-a594-1b18a6d49c67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c51c33d7c15d4504a393bcb2b8d326d4', 'request_id': 'req-cbe65ee5-b485-4477-a594-1b18a6d49c67'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:13.304006 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-cbe65ee5-b485-4477-a594-1b18a6d49c67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c51c33d7c15d4504a393bcb2b8d326d4', 'request_id': 'req-cbe65ee5-b485-4477-a594-1b18a6d49c67'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:13.383419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-cbe65ee5-b485-4477-a594-1b18a6d49c67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c51c33d7c15d4504a393bcb2b8d326d4', 'request_id': 'req-cbe65ee5-b485-4477-a594-1b18a6d49c67'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:13.394433 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-cbe65ee5-b485-4477-a594-1b18a6d49c67 admin admin] The token cache is being invalidate because project c51c33d7c15d4504a393bcb2b8d326d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:13.395575 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-cbe65ee5-b485-4477-a594-1b18a6d49c67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:13.395575 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-cbe65ee5-b485-4477-a594-1b18a6d49c67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:13.396907 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1104/2195] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:23:13 2022] DELETE /identity/v3/projects/c51c33d7c15d4504a393bcb2b8d326d4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:13.400894 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908a1dc-6b80-4de3-b04e-aa45f5915b25 service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:13.414779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908a1dc-6b80-4de3-b04e-aa45f5915b25 service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:13.477684 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fabc1a-2385-4d2a-8f83-6109b921fec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:13.478607 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fabc1a-2385-4d2a-8f83-6109b921fec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:13.478890 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fabc1a-2385-4d2a-8f83-6109b921fec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:13.479166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fabc1a-2385-4d2a-8f83-6109b921fec9 admin admin] PATH_INFO: `/v3/users/5b7b8bf5555a473e876271d7cae54f62` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:13.480342 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fabc1a-2385-4d2a-8f83-6109b921fec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b7b8bf5555a473e876271d7cae54f62)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:13.482669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fabc1a-2385-4d2a-8f83-6109b921fec9 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:13.665983 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a6fabc1a-2385-4d2a-8f83-6109b921fec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b7b8bf5555a473e876271d7cae54f62'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:13.760263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a6fabc1a-2385-4d2a-8f83-6109b921fec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b7b8bf5555a473e876271d7cae54f62'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:13.760814 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a6fabc1a-2385-4d2a-8f83-6109b921fec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b7b8bf5555a473e876271d7cae54f62'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:13.772989 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a6fabc1a-2385-4d2a-8f83-6109b921fec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b7b8bf5555a473e876271d7cae54f62'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:13.773645 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a6fabc1a-2385-4d2a-8f83-6109b921fec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b7b8bf5555a473e876271d7cae54f62'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:13.785848 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1092/2196] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:23:13 2022] DELETE /identity/v3/users/5b7b8bf5555a473e876271d7cae54f62 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:14.260130 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe65ee5-b485-4477-a594-1b18a6d49c67 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:14.274219 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cbe65ee5-b485-4477-a594-1b18a6d49c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:14.287482 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe65ee5-b485-4477-a594-1b18a6d49c67 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:14.385689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433216c-edd7-42a2-88b9-24894b50275c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:14.385689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433216c-edd7-42a2-88b9-24894b50275c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:14.385689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433216c-edd7-42a2-88b9-24894b50275c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:14.385689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433216c-edd7-42a2-88b9-24894b50275c admin admin] PATH_INFO: `/v3/projects/6360c2381c3e47638eadbb672d174a2b` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:14.386094 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433216c-edd7-42a2-88b9-24894b50275c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6360c2381c3e47638eadbb672d174a2b)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:14.386094 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433216c-edd7-42a2-88b9-24894b50275c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:14.510490 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7433216c-edd7-42a2-88b9-24894b50275c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6360c2381c3e47638eadbb672d174a2b', 'request_id': 'req-7433216c-edd7-42a2-88b9-24894b50275c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:14.517768 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7433216c-edd7-42a2-88b9-24894b50275c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6360c2381c3e47638eadbb672d174a2b', 'request_id': 'req-7433216c-edd7-42a2-88b9-24894b50275c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:14.617174 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7433216c-edd7-42a2-88b9-24894b50275c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6360c2381c3e47638eadbb672d174a2b', 'request_id': 'req-7433216c-edd7-42a2-88b9-24894b50275c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:14.629727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7433216c-edd7-42a2-88b9-24894b50275c admin admin] The token cache is being invalidate because project 6360c2381c3e47638eadbb672d174a2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:14.630093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7433216c-edd7-42a2-88b9-24894b50275c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:14.630850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7433216c-edd7-42a2-88b9-24894b50275c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:14.632762 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1105/2197] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:23:14 2022] DELETE /identity/v3/projects/6360c2381c3e47638eadbb672d174a2b => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:14.639077 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3df9c4-bd25-4484-8dda-415844621aee None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:14.639501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3df9c4-bd25-4484-8dda-415844621aee None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:14.639620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3df9c4-bd25-4484-8dda-415844621aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:14.668829 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-ea3df9c4-bd25-4484-8dda-415844621aee None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:14.670030 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ea3df9c4-bd25-4484-8dda-415844621aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:14.727520 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1093/2198] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:14.735821 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23c136-cb8b-4f1f-8fe7-bc519d21ee3c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:14.736111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23c136-cb8b-4f1f-8fe7-bc519d21ee3c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:14.736867 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23c136-cb8b-4f1f-8fe7-bc519d21ee3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:14.755244 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1b23c136-cb8b-4f1f-8fe7-bc519d21ee3c None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:14.756459 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1b23c136-cb8b-4f1f-8fe7-bc519d21ee3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:14.765423 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1106/2199] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:14.769621 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3df9c4-bd25-4484-8dda-415844621aee None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:14.779509 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3df9c4-bd25-4484-8dda-415844621aee None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:14.784153 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e37bf9-687f-4a7c-8362-e9a9c95ff342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:14.784804 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e37bf9-687f-4a7c-8362-e9a9c95ff342 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:14.785092 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e37bf9-687f-4a7c-8362-e9a9c95ff342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:14.785365 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e37bf9-687f-4a7c-8362-e9a9c95ff342 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:14.786092 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e37bf9-687f-4a7c-8362-e9a9c95ff342 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:23:14.786524 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e37bf9-687f-4a7c-8362-e9a9c95ff342 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:14.788427 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e37bf9-687f-4a7c-8362-e9a9c95ff342 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:14.800009 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1094/2200] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:23:14.804527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23c136-cb8b-4f1f-8fe7-bc519d21ee3c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:14.814773 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23c136-cb8b-4f1f-8fe7-bc519d21ee3c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:14.819968 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e370b-e206-4cbd-b6e3-78142f5a2371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:14.820621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e370b-e206-4cbd-b6e3-78142f5a2371 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:14.820992 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e370b-e206-4cbd-b6e3-78142f5a2371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:14.821276 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e370b-e206-4cbd-b6e3-78142f5a2371 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:14.821970 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e370b-e206-4cbd-b6e3-78142f5a2371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:14.824077 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e370b-e206-4cbd-b6e3-78142f5a2371 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:14.922764 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1107/2201] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:23:14 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:14.926694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e37bf9-687f-4a7c-8362-e9a9c95ff342 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:14.937086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e37bf9-687f-4a7c-8362-e9a9c95ff342 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:14.994583 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c60a0-a138-4ca1-9c4e-abab0db4ee8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:14.995292 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c60a0-a138-4ca1-9c4e-abab0db4ee8a admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:14.995575 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c60a0-a138-4ca1-9c4e-abab0db4ee8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:14.995850 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c60a0-a138-4ca1-9c4e-abab0db4ee8a admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:14.996801 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c60a0-a138-4ca1-9c4e-abab0db4ee8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:14.999461 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c60a0-a138-4ca1-9c4e-abab0db4ee8a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:15.109913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1095/2202] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:23:14 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:23:15.113408 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e370b-e206-4cbd-b6e3-78142f5a2371 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:15.124928 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e370b-e206-4cbd-b6e3-78142f5a2371 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:15.129671 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785b1c1-1c45-4bed-9a8d-d128aa175c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:15.130389 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785b1c1-1c45-4bed-9a8d-d128aa175c9f admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:15.130676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785b1c1-1c45-4bed-9a8d-d128aa175c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:15.130998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785b1c1-1c45-4bed-9a8d-d128aa175c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:15.131731 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785b1c1-1c45-4bed-9a8d-d128aa175c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:15.133356 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785b1c1-1c45-4bed-9a8d-d128aa175c9f admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:15.146197 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1108/2203] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:23:15.162948 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c60a0-a138-4ca1-9c4e-abab0db4ee8a admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:15.164766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c60a0-a138-4ca1-9c4e-abab0db4ee8a admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:15.170253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d007f-c76f-482d-a74e-44322d11ece1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:15.170774 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d007f-c76f-482d-a74e-44322d11ece1 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:15.171039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d007f-c76f-482d-a74e-44322d11ece1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:15.171310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d007f-c76f-482d-a74e-44322d11ece1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:15.172029 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d007f-c76f-482d-a74e-44322d11ece1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:15.173621 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d007f-c76f-482d-a74e-44322d11ece1 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:15.183593 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1096/2204] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:23:15.188373 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785b1c1-1c45-4bed-9a8d-d128aa175c9f admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:15.198013 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785b1c1-1c45-4bed-9a8d-d128aa175c9f admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:15.202793 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4168fb-edb3-486f-aa09-00bc00a9ade8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:15.203702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4168fb-edb3-486f-aa09-00bc00a9ade8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:15.203961 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4168fb-edb3-486f-aa09-00bc00a9ade8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:15.204242 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4168fb-edb3-486f-aa09-00bc00a9ade8 admin admin] PATH_INFO: `/v3/projects/bbb1c148a55a4a97ab56c023061fe566/users/ba021b664682480e93d2b5cb7a6827b7/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:15.220383 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4168fb-edb3-486f-aa09-00bc00a9ade8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb1c148a55a4a97ab56c023061fe566, user_id=ba021b664682480e93d2b5cb7a6827b7, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:15.223111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4168fb-edb3-486f-aa09-00bc00a9ade8 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:15.327222 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1109/2205] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:23:15 2022] PUT /identity/v3/projects/bbb1c148a55a4a97ab56c023061fe566/users/ba021b664682480e93d2b5cb7a6827b7/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:15.346176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0b4b5-c9b5-4e8d-b4a3-cab0e1565a5b None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:15.346467 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0b4b5-c9b5-4e8d-b4a3-cab0e1565a5b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:15.346742 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0b4b5-c9b5-4e8d-b4a3-cab0e1565a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:15.374371 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-bee0b4b5-c9b5-4e8d-b4a3-cab0e1565a5b None None] MFA Rules not processed for user `ba021b664682480e93d2b5cb7a6827b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:15.375507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-bee0b4b5-c9b5-4e8d-b4a3-cab0e1565a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:15.441287 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1097/2206] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:15.445682 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4168fb-edb3-486f-aa09-00bc00a9ade8 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:15.531534 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4168fb-edb3-486f-aa09-00bc00a9ade8 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:15.536866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52bb13-23aa-443e-82c7-66d4ec97d48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:15.537531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52bb13-23aa-443e-82c7-66d4ec97d48d admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:15.537816 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52bb13-23aa-443e-82c7-66d4ec97d48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:15.538243 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52bb13-23aa-443e-82c7-66d4ec97d48d admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:15.539056 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52bb13-23aa-443e-82c7-66d4ec97d48d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:15.541114 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52bb13-23aa-443e-82c7-66d4ec97d48d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:15.732466 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1110/2207] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:23:15 2022] POST /identity/v3/projects => generated 387 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:15.736430 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0b4b5-c9b5-4e8d-b4a3-cab0e1565a5b None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:15.748558 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0b4b5-c9b5-4e8d-b4a3-cab0e1565a5b None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:15.794551 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6491aa9-341d-49c6-b8ff-8daa1fff9d5c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:15.795355 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6491aa9-341d-49c6-b8ff-8daa1fff9d5c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:15.795874 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6491aa9-341d-49c6-b8ff-8daa1fff9d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:15.820755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e6491aa9-341d-49c6-b8ff-8daa1fff9d5c None None] MFA Rules not processed for user `5d7434af378b4247aefbe0783cd128c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:15.822007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e6491aa9-341d-49c6-b8ff-8daa1fff9d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:15.827878 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2704f-64cf-4228-8fd6-fcf0c8dad095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:15.828832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2704f-64cf-4228-8fd6-fcf0c8dad095 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:15.829152 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2704f-64cf-4228-8fd6-fcf0c8dad095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:15.829398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2704f-64cf-4228-8fd6-fcf0c8dad095 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:15.830100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2704f-64cf-4228-8fd6-fcf0c8dad095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:15.832076 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2704f-64cf-4228-8fd6-fcf0c8dad095 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:15.880936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1111/2208] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:15.881498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6491aa9-341d-49c6-b8ff-8daa1fff9d5c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:15.885734 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e6491aa9-341d-49c6-b8ff-8daa1fff9d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:15.899386 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6491aa9-341d-49c6-b8ff-8daa1fff9d5c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:15.909684 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f21fc-983c-4043-9355-437cd23c2760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:15.909684 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f21fc-983c-4043-9355-437cd23c2760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:15.909684 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f21fc-983c-4043-9355-437cd23c2760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:15.909684 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f21fc-983c-4043-9355-437cd23c2760 admin admin] PATH_INFO: `/v3/users/97d634a0c9ae461895a970dfcf64b59b` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:15.910082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f21fc-983c-4043-9355-437cd23c2760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97d634a0c9ae461895a970dfcf64b59b)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:15.910082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f21fc-983c-4043-9355-437cd23c2760 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:15.944030 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1098/2209] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:23:15 2022] POST /identity/v3/users => generated 300 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:15.944030 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2704f-64cf-4228-8fd6-fcf0c8dad095 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:15.953570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2704f-64cf-4228-8fd6-fcf0c8dad095 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:15.958205 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7e92b-e543-4e53-95f1-2c553cb08e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:15.958862 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7e92b-e543-4e53-95f1-2c553cb08e94 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:15.959146 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7e92b-e543-4e53-95f1-2c553cb08e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:15.959425 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7e92b-e543-4e53-95f1-2c553cb08e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:15.960214 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7e92b-e543-4e53-95f1-2c553cb08e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:15.961809 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7e92b-e543-4e53-95f1-2c553cb08e94 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:15.982059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1099/2210] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:23:15.985077 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7e92b-e543-4e53-95f1-2c553cb08e94 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:15.995638 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7e92b-e543-4e53-95f1-2c553cb08e94 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:16.001391 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e084f-e7e0-43be-984e-cff1a4b3538c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:16.002739 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e084f-e7e0-43be-984e-cff1a4b3538c admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:16.005050 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e084f-e7e0-43be-984e-cff1a4b3538c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:16.005050 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e084f-e7e0-43be-984e-cff1a4b3538c admin admin] PATH_INFO: `/v3/projects/121dc9957a9b4885bda0a112f9967857/users/f48819399b844bc294443faaf2907478/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:16.020751 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e084f-e7e0-43be-984e-cff1a4b3538c admin admin] RBAC: Authorizing `identity:create_grant(project_id=121dc9957a9b4885bda0a112f9967857, user_id=f48819399b844bc294443faaf2907478, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:16.024482 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e084f-e7e0-43be-984e-cff1a4b3538c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:16.094019 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-193f21fc-983c-4043-9355-437cd23c2760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97d634a0c9ae461895a970dfcf64b59b'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:16.106080 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-193f21fc-983c-4043-9355-437cd23c2760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97d634a0c9ae461895a970dfcf64b59b'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:16.106872 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-193f21fc-983c-4043-9355-437cd23c2760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97d634a0c9ae461895a970dfcf64b59b'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:16.107521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-193f21fc-983c-4043-9355-437cd23c2760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97d634a0c9ae461895a970dfcf64b59b'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:16.115045 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-193f21fc-983c-4043-9355-437cd23c2760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97d634a0c9ae461895a970dfcf64b59b'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:16.120384 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1100/2211] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:23:15 2022] PUT /identity/v3/projects/121dc9957a9b4885bda0a112f9967857/users/f48819399b844bc294443faaf2907478/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:23:16.124961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e084f-e7e0-43be-984e-cff1a4b3538c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:16.126839 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8b7e084f-e7e0-43be-984e-cff1a4b3538c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:16.177454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1112/2212] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:23:15 2022] DELETE /identity/v3/users/97d634a0c9ae461895a970dfcf64b59b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:16.183326 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eac8ab-84c9-4fab-850e-11ee0c72d429 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:16.183615 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eac8ab-84c9-4fab-850e-11ee0c72d429 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:16.183925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eac8ab-84c9-4fab-850e-11ee0c72d429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:16.203861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e084f-e7e0-43be-984e-cff1a4b3538c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:16.213009 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-98eac8ab-84c9-4fab-850e-11ee0c72d429 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:16.214060 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-98eac8ab-84c9-4fab-850e-11ee0c72d429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:16.276554 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64165dc8-6a32-4677-915e-75e749ad6957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:16.276554 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64165dc8-6a32-4677-915e-75e749ad6957 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:16.276554 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64165dc8-6a32-4677-915e-75e749ad6957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:16.276554 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64165dc8-6a32-4677-915e-75e749ad6957 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:16.279040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64165dc8-6a32-4677-915e-75e749ad6957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:16.280784 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64165dc8-6a32-4677-915e-75e749ad6957 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:16.291310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1101/2213] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:23:16.295407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64165dc8-6a32-4677-915e-75e749ad6957 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:16.304343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1113/2214] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:23:16.312364 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64165dc8-6a32-4677-915e-75e749ad6957 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:16.312364 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128a90e-7709-4885-b21c-6ee1895155d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:16.313189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128a90e-7709-4885-b21c-6ee1895155d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:16.313472 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128a90e-7709-4885-b21c-6ee1895155d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:16.313749 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128a90e-7709-4885-b21c-6ee1895155d6 admin admin] PATH_INFO: `/v3/projects/121dc9957a9b4885bda0a112f9967857/users/f48819399b844bc294443faaf2907478/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:16.315996 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128a90e-7709-4885-b21c-6ee1895155d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=121dc9957a9b4885bda0a112f9967857, user_id=f48819399b844bc294443faaf2907478, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:16.319105 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128a90e-7709-4885-b21c-6ee1895155d6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:16.319940 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eac8ab-84c9-4fab-850e-11ee0c72d429 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:16.321316 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-98eac8ab-84c9-4fab-850e-11ee0c72d429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:16.331803 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1102/2215] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:23:16 2022] PUT /identity/v3/projects/121dc9957a9b4885bda0a112f9967857/users/f48819399b844bc294443faaf2907478/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:23:16.349294 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62eb53-faf7-4643-9940-64d7ef3fb270 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:16.349660 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62eb53-faf7-4643-9940-64d7ef3fb270 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:16.349942 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62eb53-faf7-4643-9940-64d7ef3fb270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:16.378918 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-fe62eb53-faf7-4643-9940-64d7ef3fb270 None None] MFA Rules not processed for user `f48819399b844bc294443faaf2907478`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:16.380154 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-fe62eb53-faf7-4643-9940-64d7ef3fb270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:16.380469 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eac8ab-84c9-4fab-850e-11ee0c72d429 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:16.428978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fefe86-452a-44fc-a5d9-296a902d55bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:16.429733 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fefe86-452a-44fc-a5d9-296a902d55bd service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:16.430163 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fefe86-452a-44fc-a5d9-296a902d55bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:16.430454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fefe86-452a-44fc-a5d9-296a902d55bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:16.451651 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1103/2216] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:23:16.466371 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62eb53-faf7-4643-9940-64d7ef3fb270 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:16.467786 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-fe62eb53-faf7-4643-9940-64d7ef3fb270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:16.511098 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fefe86-452a-44fc-a5d9-296a902d55bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:16.512618 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fefe86-452a-44fc-a5d9-296a902d55bd service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:16.524873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1114/2217] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:23:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:23:16.538617 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62eb53-faf7-4643-9940-64d7ef3fb270 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:16.543360 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e54633-9eff-47af-87eb-d3d3f94f0d46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:16.545783 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e54633-9eff-47af-87eb-d3d3f94f0d46 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:16.545783 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e54633-9eff-47af-87eb-d3d3f94f0d46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:16.545783 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e54633-9eff-47af-87eb-d3d3f94f0d46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:16.562255 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e54633-9eff-47af-87eb-d3d3f94f0d46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:16.564420 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e54633-9eff-47af-87eb-d3d3f94f0d46 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:16.577657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1104/2218] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:23:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:23:17.095498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fefe86-452a-44fc-a5d9-296a902d55bd service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:17.097020 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-21fefe86-452a-44fc-a5d9-296a902d55bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:17.112524 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fefe86-452a-44fc-a5d9-296a902d55bd service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:17.125263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c971a-38b4-41a2-82f2-e09c209e27f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:17.125263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c971a-38b4-41a2-82f2-e09c209e27f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:17.125263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c971a-38b4-41a2-82f2-e09c209e27f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:17.125263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c971a-38b4-41a2-82f2-e09c209e27f6 admin admin] PATH_INFO: `/v3/projects/a943bdb55fa34b2d924171fb21abd04a` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:17.126019 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c971a-38b4-41a2-82f2-e09c209e27f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a943bdb55fa34b2d924171fb21abd04a)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:17.127118 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c971a-38b4-41a2-82f2-e09c209e27f6 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:17.241778 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c91c971a-38b4-41a2-82f2-e09c209e27f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a943bdb55fa34b2d924171fb21abd04a', 'request_id': 'req-c91c971a-38b4-41a2-82f2-e09c209e27f6'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:17.248596 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c91c971a-38b4-41a2-82f2-e09c209e27f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a943bdb55fa34b2d924171fb21abd04a', 'request_id': 'req-c91c971a-38b4-41a2-82f2-e09c209e27f6'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:17.343389 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c91c971a-38b4-41a2-82f2-e09c209e27f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a943bdb55fa34b2d924171fb21abd04a', 'request_id': 'req-c91c971a-38b4-41a2-82f2-e09c209e27f6'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:17.357772 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c91c971a-38b4-41a2-82f2-e09c209e27f6 admin admin] The token cache is being invalidate because project a943bdb55fa34b2d924171fb21abd04a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:17.358065 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c91c971a-38b4-41a2-82f2-e09c209e27f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:17.358818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c91c971a-38b4-41a2-82f2-e09c209e27f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:17.360640 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1115/2219] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:23:17 2022] DELETE /identity/v3/projects/a943bdb55fa34b2d924171fb21abd04a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:17.364741 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e54633-9eff-47af-87eb-d3d3f94f0d46 service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:17.377048 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e54633-9eff-47af-87eb-d3d3f94f0d46 service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:17.440780 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ddeeb-d74f-4882-b60d-41d631612d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:17.441702 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ddeeb-d74f-4882-b60d-41d631612d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:17.441991 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ddeeb-d74f-4882-b60d-41d631612d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:17.442300 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ddeeb-d74f-4882-b60d-41d631612d36 admin admin] PATH_INFO: `/v3/users/3190677e21a04d748a9110355a1889df` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:17.443585 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ddeeb-d74f-4882-b60d-41d631612d36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3190677e21a04d748a9110355a1889df)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:17.445513 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ddeeb-d74f-4882-b60d-41d631612d36 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:17.705831 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-106ddeeb-d74f-4882-b60d-41d631612d36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3190677e21a04d748a9110355a1889df'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:17.844306 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-106ddeeb-d74f-4882-b60d-41d631612d36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3190677e21a04d748a9110355a1889df'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:17.846044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-106ddeeb-d74f-4882-b60d-41d631612d36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3190677e21a04d748a9110355a1889df'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:17.861791 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-106ddeeb-d74f-4882-b60d-41d631612d36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3190677e21a04d748a9110355a1889df'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:17.863366 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-106ddeeb-d74f-4882-b60d-41d631612d36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3190677e21a04d748a9110355a1889df'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:17.880880 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1105/2220] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:23:17 2022] DELETE /identity/v3/users/3190677e21a04d748a9110355a1889df => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:17.933620 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c971a-38b4-41a2-82f2-e09c209e27f6 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:17.935758 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c91c971a-38b4-41a2-82f2-e09c209e27f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:17.950478 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c971a-38b4-41a2-82f2-e09c209e27f6 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:18.018223 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0ff07-06c9-44f2-8334-f5a23549edfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:18.019067 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0ff07-06c9-44f2-8334-f5a23549edfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:18.019346 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0ff07-06c9-44f2-8334-f5a23549edfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:18.019619 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0ff07-06c9-44f2-8334-f5a23549edfb admin admin] PATH_INFO: `/v3/users/ba021b664682480e93d2b5cb7a6827b7` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:18.020808 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0ff07-06c9-44f2-8334-f5a23549edfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba021b664682480e93d2b5cb7a6827b7)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:18.022880 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0ff07-06c9-44f2-8334-f5a23549edfb admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:18.238424 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-03c0ff07-06c9-44f2-8334-f5a23549edfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba021b664682480e93d2b5cb7a6827b7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:18.255187 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-03c0ff07-06c9-44f2-8334-f5a23549edfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba021b664682480e93d2b5cb7a6827b7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:18.256186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-03c0ff07-06c9-44f2-8334-f5a23549edfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba021b664682480e93d2b5cb7a6827b7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:18.256803 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-03c0ff07-06c9-44f2-8334-f5a23549edfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba021b664682480e93d2b5cb7a6827b7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:18.267580 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-03c0ff07-06c9-44f2-8334-f5a23549edfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba021b664682480e93d2b5cb7a6827b7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:18.373496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1116/2221] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:23:17 2022] DELETE /identity/v3/users/ba021b664682480e93d2b5cb7a6827b7 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:18.378151 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb849ae-0096-47f0-8f97-050ff40f5ef9 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:18.378659 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb849ae-0096-47f0-8f97-050ff40f5ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:18.378773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb849ae-0096-47f0-8f97-050ff40f5ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:18.397779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-6cb849ae-0096-47f0-8f97-050ff40f5ef9 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:18.399056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6cb849ae-0096-47f0-8f97-050ff40f5ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:18.469276 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1106/2222] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:18.479324 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0ff07-06c9-44f2-8334-f5a23549edfb admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:18.480931 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-03c0ff07-06c9-44f2-8334-f5a23549edfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:18.499751 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb849ae-0096-47f0-8f97-050ff40f5ef9 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:18.502035 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6cb849ae-0096-47f0-8f97-050ff40f5ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:18.520662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb849ae-0096-47f0-8f97-050ff40f5ef9 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:18.524401 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809fe59-58b0-436f-92f1-03027e2116af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:18.525695 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809fe59-58b0-436f-92f1-03027e2116af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:18.525983 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809fe59-58b0-436f-92f1-03027e2116af admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:18.526313 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809fe59-58b0-436f-92f1-03027e2116af admin admin] PATH_INFO: `/v3/projects/95c098908e5c48a7a8f24bc84ccedceb` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:18.527610 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809fe59-58b0-436f-92f1-03027e2116af admin admin] RBAC: Authorizing `identity:delete_project(project_id=95c098908e5c48a7a8f24bc84ccedceb)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:18.530792 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809fe59-58b0-436f-92f1-03027e2116af admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:18.555804 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0ff07-06c9-44f2-8334-f5a23549edfb admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:18.560208 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5de6a6-ded2-477b-9ea6-857ccfbd9fc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:18.560886 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5de6a6-ded2-477b-9ea6-857ccfbd9fc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:18.561165 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5de6a6-ded2-477b-9ea6-857ccfbd9fc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:18.561434 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5de6a6-ded2-477b-9ea6-857ccfbd9fc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:18.576649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5de6a6-ded2-477b-9ea6-857ccfbd9fc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:18.578152 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5de6a6-ded2-477b-9ea6-857ccfbd9fc0 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:18.588389 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1117/2223] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:23:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:18.702384 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8809fe59-58b0-436f-92f1-03027e2116af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95c098908e5c48a7a8f24bc84ccedceb', 'request_id': 'req-8809fe59-58b0-436f-92f1-03027e2116af'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:18.811846 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8809fe59-58b0-436f-92f1-03027e2116af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95c098908e5c48a7a8f24bc84ccedceb', 'request_id': 'req-8809fe59-58b0-436f-92f1-03027e2116af'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:18.818594 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8809fe59-58b0-436f-92f1-03027e2116af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95c098908e5c48a7a8f24bc84ccedceb', 'request_id': 'req-8809fe59-58b0-436f-92f1-03027e2116af'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:18.829741 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8809fe59-58b0-436f-92f1-03027e2116af admin admin] The token cache is being invalidate because project 95c098908e5c48a7a8f24bc84ccedceb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:18.844434 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8809fe59-58b0-436f-92f1-03027e2116af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:18.844434 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-8809fe59-58b0-436f-92f1-03027e2116af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:18.844434 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1107/2224] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:23:18 2022] DELETE /identity/v3/projects/95c098908e5c48a7a8f24bc84ccedceb => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:18.844735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d38e5-ca90-4341-bd2f-e4626cd2c550 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:18.844735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d38e5-ca90-4341-bd2f-e4626cd2c550 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:18.844735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d38e5-ca90-4341-bd2f-e4626cd2c550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:18.857203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c52d38e5-ca90-4341-bd2f-e4626cd2c550 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:18.858360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c52d38e5-ca90-4341-bd2f-e4626cd2c550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:18.923073 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1118/2225] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:18.931987 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08496b63-415d-47fb-82e5-8b990636563b None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:18.932341 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08496b63-415d-47fb-82e5-8b990636563b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:18.932538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08496b63-415d-47fb-82e5-8b990636563b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:18.953964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-08496b63-415d-47fb-82e5-8b990636563b None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:18.955217 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-08496b63-415d-47fb-82e5-8b990636563b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:18.964106 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1108/2226] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:18.969184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d38e5-ca90-4341-bd2f-e4626cd2c550 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:18.980569 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d38e5-ca90-4341-bd2f-e4626cd2c550 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:18.985834 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82ab99-1234-44af-b519-8fad54e58edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:18.986490 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82ab99-1234-44af-b519-8fad54e58edd admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:18.986754 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82ab99-1234-44af-b519-8fad54e58edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:18.987029 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82ab99-1234-44af-b519-8fad54e58edd admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:18.987850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82ab99-1234-44af-b519-8fad54e58edd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:23:18.988075 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82ab99-1234-44af-b519-8fad54e58edd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:18.989686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82ab99-1234-44af-b519-8fad54e58edd admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:19.003123 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1119/2227] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:23:19.007538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08496b63-415d-47fb-82e5-8b990636563b None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:19.018190 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08496b63-415d-47fb-82e5-8b990636563b None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:19.025035 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6301a4c-4835-4a88-a44c-070194e36b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:19.030157 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6301a4c-4835-4a88-a44c-070194e36b68 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:19.030157 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6301a4c-4835-4a88-a44c-070194e36b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:19.030157 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6301a4c-4835-4a88-a44c-070194e36b68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:19.030157 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6301a4c-4835-4a88-a44c-070194e36b68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:19.030157 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6301a4c-4835-4a88-a44c-070194e36b68 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:19.163548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1109/2228] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:23:19 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:19.167880 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82ab99-1234-44af-b519-8fad54e58edd admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:19.192035 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82ab99-1234-44af-b519-8fad54e58edd admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:19.192407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6301a4c-4835-4a88-a44c-070194e36b68 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:19.195123 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c6301a4c-4835-4a88-a44c-070194e36b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:19.304485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6dcc81-f98e-44bc-a2bc-1708f41afe48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:19.305289 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dcc81-f98e-44bc-a2bc-1708f41afe48 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:19.305569 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dcc81-f98e-44bc-a2bc-1708f41afe48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:19.306539 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dcc81-f98e-44bc-a2bc-1708f41afe48 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:19.307469 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6dcc81-f98e-44bc-a2bc-1708f41afe48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:19.314333 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6dcc81-f98e-44bc-a2bc-1708f41afe48 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:19.389443 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6301a4c-4835-4a88-a44c-070194e36b68 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:19.394055 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245d96e-c4ac-4654-aed7-59e59916fb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:19.394965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245d96e-c4ac-4654-aed7-59e59916fb40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:19.395252 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245d96e-c4ac-4654-aed7-59e59916fb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:19.395518 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245d96e-c4ac-4654-aed7-59e59916fb40 admin admin] PATH_INFO: `/v3/projects/bbb1c148a55a4a97ab56c023061fe566` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:19.396753 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245d96e-c4ac-4654-aed7-59e59916fb40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb1c148a55a4a97ab56c023061fe566)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:19.398750 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245d96e-c4ac-4654-aed7-59e59916fb40 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:19.531727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1120/2229] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:23:19 2022] POST /identity/v3/users => generated 292 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:19.535730 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6dcc81-f98e-44bc-a2bc-1708f41afe48 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:19.545828 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6dcc81-f98e-44bc-a2bc-1708f41afe48 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:19.550367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab9c10-1ea0-467b-af05-809ba554e68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:19.551006 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab9c10-1ea0-467b-af05-809ba554e68a admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:19.551288 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab9c10-1ea0-467b-af05-809ba554e68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:19.551564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab9c10-1ea0-467b-af05-809ba554e68a admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:19.552314 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab9c10-1ea0-467b-af05-809ba554e68a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:19.553925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab9c10-1ea0-467b-af05-809ba554e68a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:19.564104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1121/2230] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:23:19.568088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab9c10-1ea0-467b-af05-809ba554e68a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:19.578932 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab9c10-1ea0-467b-af05-809ba554e68a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:19.589866 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3245d96e-c4ac-4654-aed7-59e59916fb40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb1c148a55a4a97ab56c023061fe566', 'request_id': 'req-3245d96e-c4ac-4654-aed7-59e59916fb40'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:19.634840 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79527fb-a8b5-49c2-a1d8-42229565e4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:19.635503 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79527fb-a8b5-49c2-a1d8-42229565e4ed admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:19.635785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79527fb-a8b5-49c2-a1d8-42229565e4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:19.636060 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79527fb-a8b5-49c2-a1d8-42229565e4ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:19.636778 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79527fb-a8b5-49c2-a1d8-42229565e4ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:19.638586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79527fb-a8b5-49c2-a1d8-42229565e4ed admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:19.648256 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1122/2231] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:23:19.652437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79527fb-a8b5-49c2-a1d8-42229565e4ed admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:19.662120 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79527fb-a8b5-49c2-a1d8-42229565e4ed admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:19.666658 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffcce7-9b76-40b0-92bf-f560d5e58167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:19.667539 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffcce7-9b76-40b0-92bf-f560d5e58167 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:19.667866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffcce7-9b76-40b0-92bf-f560d5e58167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:19.668137 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffcce7-9b76-40b0-92bf-f560d5e58167 admin admin] PATH_INFO: `/v3/projects/8b797c25170a4d5fab56de4669d2c318/users/d2cb050ed41447e9bd9500416cc2a554/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:19.680693 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3245d96e-c4ac-4654-aed7-59e59916fb40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb1c148a55a4a97ab56c023061fe566', 'request_id': 'req-3245d96e-c4ac-4654-aed7-59e59916fb40'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:19.688689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3245d96e-c4ac-4654-aed7-59e59916fb40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb1c148a55a4a97ab56c023061fe566', 'request_id': 'req-3245d96e-c4ac-4654-aed7-59e59916fb40'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:19.693766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffcce7-9b76-40b0-92bf-f560d5e58167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b797c25170a4d5fab56de4669d2c318, user_id=d2cb050ed41447e9bd9500416cc2a554, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:19.696743 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffcce7-9b76-40b0-92bf-f560d5e58167 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:19.701625 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3245d96e-c4ac-4654-aed7-59e59916fb40 admin admin] The token cache is being invalidate because project bbb1c148a55a4a97ab56c023061fe566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:19.702164 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3245d96e-c4ac-4654-aed7-59e59916fb40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:19.703486 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3245d96e-c4ac-4654-aed7-59e59916fb40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:19.706927 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1110/2232] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:23:19 2022] DELETE /identity/v3/projects/bbb1c148a55a4a97ab56c023061fe566 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:19.711698 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245d96e-c4ac-4654-aed7-59e59916fb40 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:19.713161 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3245d96e-c4ac-4654-aed7-59e59916fb40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:19.730426 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245d96e-c4ac-4654-aed7-59e59916fb40 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:19.734462 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318e0bc-fa3e-46d6-84f8-ff7de34e53e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:19.735333 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318e0bc-fa3e-46d6-84f8-ff7de34e53e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:19.735665 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318e0bc-fa3e-46d6-84f8-ff7de34e53e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:19.735970 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318e0bc-fa3e-46d6-84f8-ff7de34e53e7 admin admin] PATH_INFO: `/v3/users/53bfaa101108411dbe19fcbf4311d05f` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:19.737266 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318e0bc-fa3e-46d6-84f8-ff7de34e53e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53bfaa101108411dbe19fcbf4311d05f)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:19.744542 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318e0bc-fa3e-46d6-84f8-ff7de34e53e7 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:19.776541 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1123/2233] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:23:19 2022] PUT /identity/v3/projects/8b797c25170a4d5fab56de4669d2c318/users/d2cb050ed41447e9bd9500416cc2a554/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:23:19.777556 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffcce7-9b76-40b0-92bf-f560d5e58167 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:19.779657 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-11ffcce7-9b76-40b0-92bf-f560d5e58167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:19.841231 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffcce7-9b76-40b0-92bf-f560d5e58167 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:19.845971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80be65e-9c93-45ec-af30-848a975bc54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:19.846873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80be65e-9c93-45ec-af30-848a975bc54c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:19.847155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80be65e-9c93-45ec-af30-848a975bc54c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:19.847437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80be65e-9c93-45ec-af30-848a975bc54c admin admin] PATH_INFO: `/v3/users/f48819399b844bc294443faaf2907478` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:19.848655 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80be65e-9c93-45ec-af30-848a975bc54c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f48819399b844bc294443faaf2907478)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:19.850635 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80be65e-9c93-45ec-af30-848a975bc54c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:20.026473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-4318e0bc-fa3e-46d6-84f8-ff7de34e53e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53bfaa101108411dbe19fcbf4311d05f'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:20.110661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e80be65e-9c93-45ec-af30-848a975bc54c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f48819399b844bc294443faaf2907478'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:20.122363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e80be65e-9c93-45ec-af30-848a975bc54c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f48819399b844bc294443faaf2907478'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:20.123047 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e80be65e-9c93-45ec-af30-848a975bc54c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f48819399b844bc294443faaf2907478'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:20.123639 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e80be65e-9c93-45ec-af30-848a975bc54c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f48819399b844bc294443faaf2907478'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:20.125964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-4318e0bc-fa3e-46d6-84f8-ff7de34e53e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53bfaa101108411dbe19fcbf4311d05f'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:20.126668 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-4318e0bc-fa3e-46d6-84f8-ff7de34e53e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53bfaa101108411dbe19fcbf4311d05f'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:20.132038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e80be65e-9c93-45ec-af30-848a975bc54c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f48819399b844bc294443faaf2907478'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:20.141078 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-4318e0bc-fa3e-46d6-84f8-ff7de34e53e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53bfaa101108411dbe19fcbf4311d05f'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:20.141737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-4318e0bc-fa3e-46d6-84f8-ff7de34e53e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53bfaa101108411dbe19fcbf4311d05f'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:20.154830 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1111/2234] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:23:19 2022] DELETE /identity/v3/users/53bfaa101108411dbe19fcbf4311d05f => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:20.157070 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597a5af-da71-42ca-85b8-8b132a57fae2 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:20.157070 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597a5af-da71-42ca-85b8-8b132a57fae2 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:20.157537 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597a5af-da71-42ca-85b8-8b132a57fae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:20.192839 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-1597a5af-da71-42ca-85b8-8b132a57fae2 None None] MFA Rules not processed for user `d2cb050ed41447e9bd9500416cc2a554`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:20.194148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1597a5af-da71-42ca-85b8-8b132a57fae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:20.230195 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1124/2235] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:23:19 2022] DELETE /identity/v3/users/f48819399b844bc294443faaf2907478 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:20.266102 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1112/2236] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:20.271008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80be65e-9c93-45ec-af30-848a975bc54c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:20.272445 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e80be65e-9c93-45ec-af30-848a975bc54c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:20.374599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80be65e-9c93-45ec-af30-848a975bc54c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:20.382024 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9600de1-828e-4f66-a95b-36c7e1808048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:20.383469 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9600de1-828e-4f66-a95b-36c7e1808048 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:20.383747 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9600de1-828e-4f66-a95b-36c7e1808048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:20.384016 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9600de1-828e-4f66-a95b-36c7e1808048 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:20.384714 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9600de1-828e-4f66-a95b-36c7e1808048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:20.387194 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9600de1-828e-4f66-a95b-36c7e1808048 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:20.527790 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1125/2237] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:23:20 2022] POST /identity/v3/projects => generated 381 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:20.530484 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597a5af-da71-42ca-85b8-8b132a57fae2 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:20.532146 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9600de1-828e-4f66-a95b-36c7e1808048 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:20.532878 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1597a5af-da71-42ca-85b8-8b132a57fae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:20.534699 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f9600de1-828e-4f66-a95b-36c7e1808048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:20.694428 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9600de1-828e-4f66-a95b-36c7e1808048 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:20.697900 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597a5af-da71-42ca-85b8-8b132a57fae2 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:20.700908 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f10762-4fe6-484b-ab7d-95ea993ed0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:20.701645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f10762-4fe6-484b-ab7d-95ea993ed0df admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:20.702040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f10762-4fe6-484b-ab7d-95ea993ed0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:20.702361 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f10762-4fe6-484b-ab7d-95ea993ed0df admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:20.703071 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f10762-4fe6-484b-ab7d-95ea993ed0df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:20.703784 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2291070-5488-47eb-b5aa-1f2b6849f17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:20.704751 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2291070-5488-47eb-b5aa-1f2b6849f17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:20.705269 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2291070-5488-47eb-b5aa-1f2b6849f17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:20.705777 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2291070-5488-47eb-b5aa-1f2b6849f17e admin admin] PATH_INFO: `/v3/projects/bf006e9d68304428b42387e1dbf2369a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:20.706202 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f10762-4fe6-484b-ab7d-95ea993ed0df admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:20.707229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2291070-5488-47eb-b5aa-1f2b6849f17e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf006e9d68304428b42387e1dbf2369a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:20.709298 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2291070-5488-47eb-b5aa-1f2b6849f17e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:20.778797 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1126/2238] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:23:20 2022] POST /identity/v3/users => generated 297 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:20.782951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f10762-4fe6-484b-ab7d-95ea993ed0df admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:20.806973 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f10762-4fe6-484b-ab7d-95ea993ed0df admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:20.806973 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f82e1c-938a-4a1d-9766-0c84b63efda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:20.806973 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f82e1c-938a-4a1d-9766-0c84b63efda1 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:20.806973 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f82e1c-938a-4a1d-9766-0c84b63efda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:20.807341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f82e1c-938a-4a1d-9766-0c84b63efda1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:20.807341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f82e1c-938a-4a1d-9766-0c84b63efda1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:20.807341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f82e1c-938a-4a1d-9766-0c84b63efda1 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:20.819290 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1127/2239] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:23:20.820373 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f82e1c-938a-4a1d-9766-0c84b63efda1 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:20.823266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c5f82e1c-938a-4a1d-9766-0c84b63efda1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:20.835417 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d2291070-5488-47eb-b5aa-1f2b6849f17e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf006e9d68304428b42387e1dbf2369a', 'request_id': 'req-d2291070-5488-47eb-b5aa-1f2b6849f17e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:20.838492 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f82e1c-938a-4a1d-9766-0c84b63efda1 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:20.896714 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7861ef-adf9-434f-9440-87c1bacc59b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:20.897768 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7861ef-adf9-434f-9440-87c1bacc59b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:20.898248 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7861ef-adf9-434f-9440-87c1bacc59b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:20.898530 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7861ef-adf9-434f-9440-87c1bacc59b9 admin admin] PATH_INFO: `/v3/projects/121dc9957a9b4885bda0a112f9967857` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:20.899732 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7861ef-adf9-434f-9440-87c1bacc59b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=121dc9957a9b4885bda0a112f9967857)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:20.901723 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7861ef-adf9-434f-9440-87c1bacc59b9 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:20.920628 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d2291070-5488-47eb-b5aa-1f2b6849f17e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf006e9d68304428b42387e1dbf2369a', 'request_id': 'req-d2291070-5488-47eb-b5aa-1f2b6849f17e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:20.927677 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d2291070-5488-47eb-b5aa-1f2b6849f17e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf006e9d68304428b42387e1dbf2369a', 'request_id': 'req-d2291070-5488-47eb-b5aa-1f2b6849f17e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:20.938746 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d2291070-5488-47eb-b5aa-1f2b6849f17e admin admin] The token cache is being invalidate because project bf006e9d68304428b42387e1dbf2369a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:20.944057 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d2291070-5488-47eb-b5aa-1f2b6849f17e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:20.944057 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d2291070-5488-47eb-b5aa-1f2b6849f17e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:20.944057 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1113/2240] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:23:20 2022] DELETE /identity/v3/projects/bf006e9d68304428b42387e1dbf2369a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:20.944057 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2291070-5488-47eb-b5aa-1f2b6849f17e admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:20.944057 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d2291070-5488-47eb-b5aa-1f2b6849f17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:20.956165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2291070-5488-47eb-b5aa-1f2b6849f17e admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:20.960806 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17411d32-2741-4f23-8250-b0c02022607c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:20.961735 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17411d32-2741-4f23-8250-b0c02022607c admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:20.962012 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17411d32-2741-4f23-8250-b0c02022607c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:20.962321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17411d32-2741-4f23-8250-b0c02022607c admin admin] PATH_INFO: `/v3/projects/6af0eab9c22f4d278e4e81cea1d623d7/users/2d02fefb3e9c4c6783c1be2bc08e1b62/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:20.978070 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17411d32-2741-4f23-8250-b0c02022607c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af0eab9c22f4d278e4e81cea1d623d7, user_id=2d02fefb3e9c4c6783c1be2bc08e1b62, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:20.980806 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17411d32-2741-4f23-8250-b0c02022607c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:21.074077 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4a7861ef-adf9-434f-9440-87c1bacc59b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '121dc9957a9b4885bda0a112f9967857', 'request_id': 'req-4a7861ef-adf9-434f-9440-87c1bacc59b9'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:21.077644 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1114/2241] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:23:20 2022] PUT /identity/v3/projects/6af0eab9c22f4d278e4e81cea1d623d7/users/2d02fefb3e9c4c6783c1be2bc08e1b62/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:21.083108 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17411d32-2741-4f23-8250-b0c02022607c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:21.087355 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4a7861ef-adf9-434f-9440-87c1bacc59b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '121dc9957a9b4885bda0a112f9967857', 'request_id': 'req-4a7861ef-adf9-434f-9440-87c1bacc59b9'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:21.087488 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-17411d32-2741-4f23-8250-b0c02022607c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:21.176472 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17411d32-2741-4f23-8250-b0c02022607c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:21.183403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0dc03f-3112-4970-918f-850c4c57133e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:21.184496 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0dc03f-3112-4970-918f-850c4c57133e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:21.184979 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0dc03f-3112-4970-918f-850c4c57133e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:21.185310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0dc03f-3112-4970-918f-850c4c57133e admin admin] PATH_INFO: `/v3/users/9f604dfadb914462a1e2fa1d7cf95d2b` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:21.186820 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0dc03f-3112-4970-918f-850c4c57133e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f604dfadb914462a1e2fa1d7cf95d2b)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:21.191738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0dc03f-3112-4970-918f-850c4c57133e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:21.213666 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4a7861ef-adf9-434f-9440-87c1bacc59b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '121dc9957a9b4885bda0a112f9967857', 'request_id': 'req-4a7861ef-adf9-434f-9440-87c1bacc59b9'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:21.236502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4a7861ef-adf9-434f-9440-87c1bacc59b9 admin admin] The token cache is being invalidate because project 121dc9957a9b4885bda0a112f9967857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:21.237026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4a7861ef-adf9-434f-9440-87c1bacc59b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:21.238231 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4a7861ef-adf9-434f-9440-87c1bacc59b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:21.239878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1128/2242] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:23:20 2022] DELETE /identity/v3/projects/121dc9957a9b4885bda0a112f9967857 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:21.240721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7861ef-adf9-434f-9440-87c1bacc59b9 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:21.242425 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4a7861ef-adf9-434f-9440-87c1bacc59b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:21.317241 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7861ef-adf9-434f-9440-87c1bacc59b9 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:21.322558 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f545edc-cb60-4b22-a521-09e33c703475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:21.323587 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f545edc-cb60-4b22-a521-09e33c703475 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:21.323875 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f545edc-cb60-4b22-a521-09e33c703475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:21.324257 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f545edc-cb60-4b22-a521-09e33c703475 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:21.325563 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f545edc-cb60-4b22-a521-09e33c703475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:21.327228 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f545edc-cb60-4b22-a521-09e33c703475 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:21.341947 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1129/2243] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:21.342634 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f545edc-cb60-4b22-a521-09e33c703475 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:21.345011 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9f545edc-cb60-4b22-a521-09e33c703475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:21.362988 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f545edc-cb60-4b22-a521-09e33c703475 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:21.368343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29086be2-e62c-4702-ac81-5d0981fdfc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:21.377770 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29086be2-e62c-4702-ac81-5d0981fdfc98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:21.377770 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29086be2-e62c-4702-ac81-5d0981fdfc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:21.377770 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29086be2-e62c-4702-ac81-5d0981fdfc98 admin admin] PATH_INFO: `/v3/users/9f0ba2c0c93d4759ad70719b0d32f7e8` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:21.377770 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29086be2-e62c-4702-ac81-5d0981fdfc98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f0ba2c0c93d4759ad70719b0d32f7e8)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:21.377770 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29086be2-e62c-4702-ac81-5d0981fdfc98 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:21.381917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ec0dc03f-3112-4970-918f-850c4c57133e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f604dfadb914462a1e2fa1d7cf95d2b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:21.480430 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ec0dc03f-3112-4970-918f-850c4c57133e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f604dfadb914462a1e2fa1d7cf95d2b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:21.482211 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ec0dc03f-3112-4970-918f-850c4c57133e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f604dfadb914462a1e2fa1d7cf95d2b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:21.527989 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ec0dc03f-3112-4970-918f-850c4c57133e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f604dfadb914462a1e2fa1d7cf95d2b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:21.528849 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ec0dc03f-3112-4970-918f-850c4c57133e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f604dfadb914462a1e2fa1d7cf95d2b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:21.544363 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1115/2244] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:23:21 2022] DELETE /identity/v3/users/9f604dfadb914462a1e2fa1d7cf95d2b => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:21.550274 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372c296-50d2-4919-b3ed-66a781b51a24 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:21.550274 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372c296-50d2-4919-b3ed-66a781b51a24 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:21.550274 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372c296-50d2-4919-b3ed-66a781b51a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:21.579048 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a372c296-50d2-4919-b3ed-66a781b51a24 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:21.580273 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a372c296-50d2-4919-b3ed-66a781b51a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:21.591020 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-29086be2-e62c-4702-ac81-5d0981fdfc98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f0ba2c0c93d4759ad70719b0d32f7e8'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:21.613044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-29086be2-e62c-4702-ac81-5d0981fdfc98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f0ba2c0c93d4759ad70719b0d32f7e8'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:21.613990 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-29086be2-e62c-4702-ac81-5d0981fdfc98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f0ba2c0c93d4759ad70719b0d32f7e8'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:21.615100 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-29086be2-e62c-4702-ac81-5d0981fdfc98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f0ba2c0c93d4759ad70719b0d32f7e8'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:21.626223 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-29086be2-e62c-4702-ac81-5d0981fdfc98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f0ba2c0c93d4759ad70719b0d32f7e8'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:21.686901 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1116/2245] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:21.686901 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372c296-50d2-4919-b3ed-66a781b51a24 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:21.698856 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a372c296-50d2-4919-b3ed-66a781b51a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:21.711902 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372c296-50d2-4919-b3ed-66a781b51a24 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:21.721428 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1130/2246] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:23:21 2022] DELETE /identity/v3/users/9f0ba2c0c93d4759ad70719b0d32f7e8 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:21.722801 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cac5b-5765-4615-ba39-9ea2b26fa3e1 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:21.723193 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cac5b-5765-4615-ba39-9ea2b26fa3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:21.723582 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cac5b-5765-4615-ba39-9ea2b26fa3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:21.729089 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05d341-d77b-478c-a155-941fe2603c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:21.730212 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05d341-d77b-478c-a155-941fe2603c9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:21.731090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05d341-d77b-478c-a155-941fe2603c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:21.732298 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05d341-d77b-478c-a155-941fe2603c9e admin admin] PATH_INFO: `/v3/projects/6af0eab9c22f4d278e4e81cea1d623d7/users/2d02fefb3e9c4c6783c1be2bc08e1b62/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:21.737361 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05d341-d77b-478c-a155-941fe2603c9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af0eab9c22f4d278e4e81cea1d623d7, user_id=2d02fefb3e9c4c6783c1be2bc08e1b62, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:21.740177 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05d341-d77b-478c-a155-941fe2603c9e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:21.753785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ca2cac5b-5765-4615-ba39-9ea2b26fa3e1 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:21.755539 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ca2cac5b-5765-4615-ba39-9ea2b26fa3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:21.777527 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1117/2247] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:23:21 2022] PUT /identity/v3/projects/6af0eab9c22f4d278e4e81cea1d623d7/users/2d02fefb3e9c4c6783c1be2bc08e1b62/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:21.779215 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df03bf-6f2f-4827-9109-1d455ca3419c None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:21.785629 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df03bf-6f2f-4827-9109-1d455ca3419c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:21.785629 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df03bf-6f2f-4827-9109-1d455ca3419c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:21.813229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-53df03bf-6f2f-4827-9109-1d455ca3419c None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:21.815929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-53df03bf-6f2f-4827-9109-1d455ca3419c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:21.830533 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1131/2248] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:21.831947 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0293de-1a78-425d-b08c-01842bbb7f05 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:21.832316 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0293de-1a78-425d-b08c-01842bbb7f05 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:21.832794 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0293de-1a78-425d-b08c-01842bbb7f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:21.862002 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6e0293de-1a78-425d-b08c-01842bbb7f05 None None] MFA Rules not processed for user `2d02fefb3e9c4c6783c1be2bc08e1b62`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:21.863399 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6e0293de-1a78-425d-b08c-01842bbb7f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:21.958280 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1118/2249] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:21.959160 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df03bf-6f2f-4827-9109-1d455ca3419c None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:21.972118 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df03bf-6f2f-4827-9109-1d455ca3419c None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:21.981688 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882cb75-cf6f-4ca2-9fef-418f8ca8a76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:21.982376 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882cb75-cf6f-4ca2-9fef-418f8ca8a76b admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:21.982653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882cb75-cf6f-4ca2-9fef-418f8ca8a76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:21.982919 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882cb75-cf6f-4ca2-9fef-418f8ca8a76b admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:21.983745 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882cb75-cf6f-4ca2-9fef-418f8ca8a76b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:23:21.983970 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882cb75-cf6f-4ca2-9fef-418f8ca8a76b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:21.986295 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882cb75-cf6f-4ca2-9fef-418f8ca8a76b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:22.003232 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1119/2250] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:23:22.003232 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882cb75-cf6f-4ca2-9fef-418f8ca8a76b admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:22.011872 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1132/2251] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:22.011872 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0293de-1a78-425d-b08c-01842bbb7f05 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:22.013517 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5882cb75-cf6f-4ca2-9fef-418f8ca8a76b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:22.024041 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0293de-1a78-425d-b08c-01842bbb7f05 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:22.031613 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1dae2-77b3-41c3-9c41-8e46980ab0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:22.032143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1dae2-77b3-41c3-9c41-8e46980ab0d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:22.032429 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1dae2-77b3-41c3-9c41-8e46980ab0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:22.032926 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1dae2-77b3-41c3-9c41-8e46980ab0d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:22.033630 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1dae2-77b3-41c3-9c41-8e46980ab0d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:22.035810 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1dae2-77b3-41c3-9c41-8e46980ab0d7 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:22.082404 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882cb75-cf6f-4ca2-9fef-418f8ca8a76b admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:22.086488 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967afdf-de41-43be-a1d2-df32a710e29e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:22.087138 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967afdf-de41-43be-a1d2-df32a710e29e service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:22.087619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967afdf-de41-43be-a1d2-df32a710e29e service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:22.087900 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967afdf-de41-43be-a1d2-df32a710e29e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:22.098043 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967afdf-de41-43be-a1d2-df32a710e29e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:22.099515 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967afdf-de41-43be-a1d2-df32a710e29e service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:22.110389 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1120/2252] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:23:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:22.111305 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967afdf-de41-43be-a1d2-df32a710e29e service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:22.114172 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8967afdf-de41-43be-a1d2-df32a710e29e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:22.120765 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1133/2253] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:23:22 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:22.122864 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1dae2-77b3-41c3-9c41-8e46980ab0d7 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:22.126255 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d8f1dae2-77b3-41c3-9c41-8e46980ab0d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:22.127681 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967afdf-de41-43be-a1d2-df32a710e29e service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:22.203230 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb825a7-64f3-415f-be39-416d2765db2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:22.204148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb825a7-64f3-415f-be39-416d2765db2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:22.204428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb825a7-64f3-415f-be39-416d2765db2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:22.204760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb825a7-64f3-415f-be39-416d2765db2d admin admin] PATH_INFO: `/v3/projects/31b254f0d5844ff2815af14795100636` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:22.206161 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb825a7-64f3-415f-be39-416d2765db2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=31b254f0d5844ff2815af14795100636)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:22.209411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb825a7-64f3-415f-be39-416d2765db2d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:22.213219 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1dae2-77b3-41c3-9c41-8e46980ab0d7 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:22.219040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de691c65-65ef-4445-8603-50c37524b8b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:22.220173 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de691c65-65ef-4445-8603-50c37524b8b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:22.225242 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de691c65-65ef-4445-8603-50c37524b8b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:22.225242 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de691c65-65ef-4445-8603-50c37524b8b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:22.296831 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de691c65-65ef-4445-8603-50c37524b8b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:22.298402 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de691c65-65ef-4445-8603-50c37524b8b2 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:22.308684 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1134/2254] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:23:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:22.309608 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de691c65-65ef-4445-8603-50c37524b8b2 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:22.320532 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de691c65-65ef-4445-8603-50c37524b8b2 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:22.325255 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba367458-dfad-43e1-94c4-5195092d0151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:22.326115 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba367458-dfad-43e1-94c4-5195092d0151 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:22.326490 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba367458-dfad-43e1-94c4-5195092d0151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:22.326834 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba367458-dfad-43e1-94c4-5195092d0151 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:22.327592 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba367458-dfad-43e1-94c4-5195092d0151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:22.329587 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba367458-dfad-43e1-94c4-5195092d0151 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:22.362930 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3fb825a7-64f3-415f-be39-416d2765db2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31b254f0d5844ff2815af14795100636', 'request_id': 'req-3fb825a7-64f3-415f-be39-416d2765db2d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:22.477536 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1135/2255] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:23:22 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:22.481758 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba367458-dfad-43e1-94c4-5195092d0151 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:22.494347 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba367458-dfad-43e1-94c4-5195092d0151 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:22.511500 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3fb825a7-64f3-415f-be39-416d2765db2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31b254f0d5844ff2815af14795100636', 'request_id': 'req-3fb825a7-64f3-415f-be39-416d2765db2d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:22.519661 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3fb825a7-64f3-415f-be39-416d2765db2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31b254f0d5844ff2815af14795100636', 'request_id': 'req-3fb825a7-64f3-415f-be39-416d2765db2d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:22.538360 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3fb825a7-64f3-415f-be39-416d2765db2d admin admin] The token cache is being invalidate because project 31b254f0d5844ff2815af14795100636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:22.538660 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3fb825a7-64f3-415f-be39-416d2765db2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:22.539554 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-3fb825a7-64f3-415f-be39-416d2765db2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:22.548589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1121/2256] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:23:22 2022] DELETE /identity/v3/projects/31b254f0d5844ff2815af14795100636 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:22.554567 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83861991-6539-45f7-a110-60c8ff404219 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:22.555205 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83861991-6539-45f7-a110-60c8ff404219 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:22.556805 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83861991-6539-45f7-a110-60c8ff404219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:22.587585 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-83861991-6539-45f7-a110-60c8ff404219 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:22.588766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedbf11-5d74-4042-bfd4-43030c287d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:22.589520 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedbf11-5d74-4042-bfd4-43030c287d96 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:22.590172 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedbf11-5d74-4042-bfd4-43030c287d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:22.590172 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedbf11-5d74-4042-bfd4-43030c287d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:22.591527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cedbf11-5d74-4042-bfd4-43030c287d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:22.592115 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-83861991-6539-45f7-a110-60c8ff404219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:22.593734 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cedbf11-5d74-4042-bfd4-43030c287d96 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:22.601146 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1122/2257] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:22.602080 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83861991-6539-45f7-a110-60c8ff404219 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:22.603606 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-83861991-6539-45f7-a110-60c8ff404219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:22.604063 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1136/2258] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:22.608260 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedbf11-5d74-4042-bfd4-43030c287d96 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:22.610037 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4cedbf11-5d74-4042-bfd4-43030c287d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:22.636720 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedbf11-5d74-4042-bfd4-43030c287d96 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:22.641888 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde68e6f-a759-4107-8b54-58e53a540f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:22.642580 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde68e6f-a759-4107-8b54-58e53a540f86 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:22.642864 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde68e6f-a759-4107-8b54-58e53a540f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:22.643142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde68e6f-a759-4107-8b54-58e53a540f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:22.643870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde68e6f-a759-4107-8b54-58e53a540f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:22.645523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde68e6f-a759-4107-8b54-58e53a540f86 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:22.661172 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1137/2259] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:23:22.661172 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09423d9-96ae-4ac9-93f9-32d594a8a22f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:22.661172 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09423d9-96ae-4ac9-93f9-32d594a8a22f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:22.661172 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09423d9-96ae-4ac9-93f9-32d594a8a22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:22.687736 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-d09423d9-96ae-4ac9-93f9-32d594a8a22f None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:22.689160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d09423d9-96ae-4ac9-93f9-32d594a8a22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:22.701547 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83861991-6539-45f7-a110-60c8ff404219 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:22.703741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1138/2260] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:22.704898 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09423d9-96ae-4ac9-93f9-32d594a8a22f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:22.713782 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60b0a2-e043-47fc-912b-ebd0efa7fced service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:22.714144 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60b0a2-e043-47fc-912b-ebd0efa7fced service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:22.714410 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60b0a2-e043-47fc-912b-ebd0efa7fced service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:22.714691 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60b0a2-e043-47fc-912b-ebd0efa7fced service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:22.715775 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09423d9-96ae-4ac9-93f9-32d594a8a22f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:22.716971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9b60b0a2-e043-47fc-912b-ebd0efa7fced service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:22.720797 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440940a8-f937-46d8-b4c9-a333bf9ed6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:22.721727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440940a8-f937-46d8-b4c9-a333bf9ed6f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:22.722009 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440940a8-f937-46d8-b4c9-a333bf9ed6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:22.722342 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440940a8-f937-46d8-b4c9-a333bf9ed6f6 admin admin] PATH_INFO: `/v3/projects/d77554fc1e9942d7a67496876d08ce07/users/60accc50958f4817a3a9aaebc77ce92d/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:22.739034 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440940a8-f937-46d8-b4c9-a333bf9ed6f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d77554fc1e9942d7a67496876d08ce07, user_id=60accc50958f4817a3a9aaebc77ce92d, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:22.741628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440940a8-f937-46d8-b4c9-a333bf9ed6f6 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:22.779809 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60b0a2-e043-47fc-912b-ebd0efa7fced service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:22.781269 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60b0a2-e043-47fc-912b-ebd0efa7fced service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:22.797873 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1123/2261] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:23:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:22.797873 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60b0a2-e043-47fc-912b-ebd0efa7fced service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:22.797873 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9b60b0a2-e043-47fc-912b-ebd0efa7fced service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:22.805926 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60b0a2-e043-47fc-912b-ebd0efa7fced service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:22.810553 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4b8f4-4624-4705-8024-ff672be1c82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:22.811405 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4b8f4-4624-4705-8024-ff672be1c82a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:22.811689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4b8f4-4624-4705-8024-ff672be1c82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:22.811994 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4b8f4-4624-4705-8024-ff672be1c82a admin admin] PATH_INFO: `/v3/projects/f8d12e1242594098b5b5ad9b8b00f938` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:22.813247 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4b8f4-4624-4705-8024-ff672be1c82a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8d12e1242594098b5b5ad9b8b00f938)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:22.815190 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4b8f4-4624-4705-8024-ff672be1c82a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:22.886056 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1139/2262] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:23:22 2022] PUT /identity/v3/projects/d77554fc1e9942d7a67496876d08ce07/users/60accc50958f4817a3a9aaebc77ce92d/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:22.887225 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440940a8-f937-46d8-b4c9-a333bf9ed6f6 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:22.947403 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440940a8-f937-46d8-b4c9-a333bf9ed6f6 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:22.952171 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7598f-d13c-4b1f-aba7-e5a163f47a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:22.952825 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7598f-d13c-4b1f-aba7-e5a163f47a6d admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:22.953111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7598f-d13c-4b1f-aba7-e5a163f47a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:22.953407 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7598f-d13c-4b1f-aba7-e5a163f47a6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:22.954274 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be7598f-d13c-4b1f-aba7-e5a163f47a6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:23:22.954613 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be7598f-d13c-4b1f-aba7-e5a163f47a6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:22.956217 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be7598f-d13c-4b1f-aba7-e5a163f47a6d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:22.972723 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1140/2263] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:23:22.972723 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b629f-1208-40f7-a539-88ad0bf742c3 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:22.972723 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b629f-1208-40f7-a539-88ad0bf742c3 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:22.972723 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b629f-1208-40f7-a539-88ad0bf742c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:22.998402 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-198b629f-1208-40f7-a539-88ad0bf742c3 None None] MFA Rules not processed for user `60accc50958f4817a3a9aaebc77ce92d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:22.999621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-198b629f-1208-40f7-a539-88ad0bf742c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:23.075594 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-68c4b8f4-4624-4705-8024-ff672be1c82a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8d12e1242594098b5b5ad9b8b00f938', 'request_id': 'req-68c4b8f4-4624-4705-8024-ff672be1c82a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:23.089332 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1141/2264] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:23.090821 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b629f-1208-40f7-a539-88ad0bf742c3 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:23.112401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b629f-1208-40f7-a539-88ad0bf742c3 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:23.165461 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-68c4b8f4-4624-4705-8024-ff672be1c82a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8d12e1242594098b5b5ad9b8b00f938', 'request_id': 'req-68c4b8f4-4624-4705-8024-ff672be1c82a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:23.172723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-68c4b8f4-4624-4705-8024-ff672be1c82a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8d12e1242594098b5b5ad9b8b00f938', 'request_id': 'req-68c4b8f4-4624-4705-8024-ff672be1c82a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:23.175236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27026635-188e-48e1-8235-4b0851972a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:23.175931 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27026635-188e-48e1-8235-4b0851972a25 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:23.176329 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27026635-188e-48e1-8235-4b0851972a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:23.176611 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27026635-188e-48e1-8235-4b0851972a25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:23.177300 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27026635-188e-48e1-8235-4b0851972a25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:23.179306 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27026635-188e-48e1-8235-4b0851972a25 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:23.183083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-68c4b8f4-4624-4705-8024-ff672be1c82a admin admin] The token cache is being invalidate because project f8d12e1242594098b5b5ad9b8b00f938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:23.183382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-68c4b8f4-4624-4705-8024-ff672be1c82a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:23.184018 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-68c4b8f4-4624-4705-8024-ff672be1c82a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:23.186417 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1124/2265] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:23:22 2022] DELETE /identity/v3/projects/f8d12e1242594098b5b5ad9b8b00f938 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:23.187065 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4b8f4-4624-4705-8024-ff672be1c82a admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:23.188346 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-68c4b8f4-4624-4705-8024-ff672be1c82a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:23.250773 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1142/2266] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:23:23 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:23.250773 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d093ba8-7d43-44b4-95ce-5d7de8a8369d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:23.250773 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d093ba8-7d43-44b4-95ce-5d7de8a8369d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:23.250773 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d093ba8-7d43-44b4-95ce-5d7de8a8369d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:23.251900 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4b8f4-4624-4705-8024-ff672be1c82a admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:23.271891 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-4d093ba8-7d43-44b4-95ce-5d7de8a8369d None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:23.273148 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4d093ba8-7d43-44b4-95ce-5d7de8a8369d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:23.306101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56484f21-a653-489d-8989-a23bf5946b3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:23.306781 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56484f21-a653-489d-8989-a23bf5946b3a service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:23.307061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56484f21-a653-489d-8989-a23bf5946b3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:23.307333 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56484f21-a653-489d-8989-a23bf5946b3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:23.309097 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-56484f21-a653-489d-8989-a23bf5946b3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:23.335494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1143/2267] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:23.339236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d093ba8-7d43-44b4-95ce-5d7de8a8369d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:23.340755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4d093ba8-7d43-44b4-95ce-5d7de8a8369d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:23.352874 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d093ba8-7d43-44b4-95ce-5d7de8a8369d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:23.358158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6d601-01b3-4982-b1f0-85f860c45700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:23.358920 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6d601-01b3-4982-b1f0-85f860c45700 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:23.359205 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6d601-01b3-4982-b1f0-85f860c45700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:23.359483 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6d601-01b3-4982-b1f0-85f860c45700 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:23.360178 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6d601-01b3-4982-b1f0-85f860c45700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:23.362171 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6d601-01b3-4982-b1f0-85f860c45700 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:23.369395 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56484f21-a653-489d-8989-a23bf5946b3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:23.369965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56484f21-a653-489d-8989-a23bf5946b3a service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:23.379943 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1125/2268] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:23:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:23.381381 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdecee-68c8-4aec-90a3-ad4b34d4cce0 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:23.381666 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdecee-68c8-4aec-90a3-ad4b34d4cce0 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:23.381943 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdecee-68c8-4aec-90a3-ad4b34d4cce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:23.400686 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d5bdecee-68c8-4aec-90a3-ad4b34d4cce0 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:23.401864 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d5bdecee-68c8-4aec-90a3-ad4b34d4cce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:23.409837 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1126/2269] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:23.410747 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdecee-68c8-4aec-90a3-ad4b34d4cce0 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:23.411975 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d5bdecee-68c8-4aec-90a3-ad4b34d4cce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:23.423695 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdecee-68c8-4aec-90a3-ad4b34d4cce0 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:23.428287 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7919444-3873-4e56-a36c-db5aac6d1ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:23.429117 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7919444-3873-4e56-a36c-db5aac6d1ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:23.429392 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7919444-3873-4e56-a36c-db5aac6d1ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:23.429663 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7919444-3873-4e56-a36c-db5aac6d1ce3 admin admin] PATH_INFO: `/v3/users/d2cb050ed41447e9bd9500416cc2a554` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:23.430847 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7919444-3873-4e56-a36c-db5aac6d1ce3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2cb050ed41447e9bd9500416cc2a554)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:23.432789 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7919444-3873-4e56-a36c-db5aac6d1ce3 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:23.466224 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1144/2270] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:23:23 2022] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:23.466224 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6d601-01b3-4982-b1f0-85f860c45700 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:23.466224 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0ba6d601-01b3-4982-b1f0-85f860c45700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:23.477129 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6d601-01b3-4982-b1f0-85f860c45700 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:23.482332 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8cb34-2806-41da-a45a-5843cb46b99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:23.483170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8cb34-2806-41da-a45a-5843cb46b99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:23.483449 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8cb34-2806-41da-a45a-5843cb46b99d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:23.483725 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8cb34-2806-41da-a45a-5843cb46b99d admin admin] PATH_INFO: `/v3/users/60accc50958f4817a3a9aaebc77ce92d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:23.484902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8cb34-2806-41da-a45a-5843cb46b99d admin admin] RBAC: Authorizing `identity:delete_user(user_id=60accc50958f4817a3a9aaebc77ce92d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:23.486861 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8cb34-2806-41da-a45a-5843cb46b99d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:23.659897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c7919444-3873-4e56-a36c-db5aac6d1ce3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2cb050ed41447e9bd9500416cc2a554'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:23.722702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-44e8cb34-2806-41da-a45a-5843cb46b99d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60accc50958f4817a3a9aaebc77ce92d'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:23.733464 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-44e8cb34-2806-41da-a45a-5843cb46b99d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60accc50958f4817a3a9aaebc77ce92d'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:23.734229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-44e8cb34-2806-41da-a45a-5843cb46b99d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60accc50958f4817a3a9aaebc77ce92d'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:23.734827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-44e8cb34-2806-41da-a45a-5843cb46b99d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60accc50958f4817a3a9aaebc77ce92d'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:23.741797 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-44e8cb34-2806-41da-a45a-5843cb46b99d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60accc50958f4817a3a9aaebc77ce92d'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:23.742522 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c7919444-3873-4e56-a36c-db5aac6d1ce3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2cb050ed41447e9bd9500416cc2a554'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:23.743167 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c7919444-3873-4e56-a36c-db5aac6d1ce3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2cb050ed41447e9bd9500416cc2a554'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:23.756826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c7919444-3873-4e56-a36c-db5aac6d1ce3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2cb050ed41447e9bd9500416cc2a554'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:23.757578 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c7919444-3873-4e56-a36c-db5aac6d1ce3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2cb050ed41447e9bd9500416cc2a554'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:23.770152 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1127/2271] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:23:23 2022] DELETE /identity/v3/users/d2cb050ed41447e9bd9500416cc2a554 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:23.770943 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7919444-3873-4e56-a36c-db5aac6d1ce3 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:23.772322 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c7919444-3873-4e56-a36c-db5aac6d1ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:23.834317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7919444-3873-4e56-a36c-db5aac6d1ce3 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:23.838994 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c53b25-90ce-4b58-9607-e6c43369cd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:23.839662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c53b25-90ce-4b58-9607-e6c43369cd14 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:23.839804 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1145/2272] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:23:23 2022] DELETE /identity/v3/users/60accc50958f4817a3a9aaebc77ce92d => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:23.839946 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c53b25-90ce-4b58-9607-e6c43369cd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:23.840227 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c53b25-90ce-4b58-9607-e6c43369cd14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:23.840670 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8cb34-2806-41da-a45a-5843cb46b99d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:23.841007 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c53b25-90ce-4b58-9607-e6c43369cd14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:23:23.841313 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c53b25-90ce-4b58-9607-e6c43369cd14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:23.843014 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c53b25-90ce-4b58-9607-e6c43369cd14 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:23.843870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-44e8cb34-2806-41da-a45a-5843cb46b99d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:23.861022 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1128/2273] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:23:23.863826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b7e39-83c4-4032-b6ad-c4aefbfb602d None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:23.864125 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b7e39-83c4-4032-b6ad-c4aefbfb602d None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:23.864413 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b7e39-83c4-4032-b6ad-c4aefbfb602d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:23.884257 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-135b7e39-83c4-4032-b6ad-c4aefbfb602d None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:23.885685 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-135b7e39-83c4-4032-b6ad-c4aefbfb602d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:23.922073 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8cb34-2806-41da-a45a-5843cb46b99d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:23.928221 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb6045-fccc-4dad-a7e8-dda8099d8b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:23.929042 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb6045-fccc-4dad-a7e8-dda8099d8b8e admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:23.929490 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb6045-fccc-4dad-a7e8-dda8099d8b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:23.929834 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb6045-fccc-4dad-a7e8-dda8099d8b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:23.930717 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb6045-fccc-4dad-a7e8-dda8099d8b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:23.932575 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb6045-fccc-4dad-a7e8-dda8099d8b8e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:23.949014 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1146/2274] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:23.950669 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4e831-45ee-4fe7-9eb4-b4fdbfe3ebe0 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:23.951024 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4e831-45ee-4fe7-9eb4-b4fdbfe3ebe0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:23.951510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4e831-45ee-4fe7-9eb4-b4fdbfe3ebe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:23.956185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1129/2275] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:23.957198 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b7e39-83c4-4032-b6ad-c4aefbfb602d None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:23.966956 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b7e39-83c4-4032-b6ad-c4aefbfb602d None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:23.970295 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a7e4e831-45ee-4fe7-9eb4-b4fdbfe3ebe0 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:23.971505 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a7e4e831-45ee-4fe7-9eb4-b4fdbfe3ebe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:23.972494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb52c0b-5e7d-4d2a-a340-9d6d4e01b0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:23.973224 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb52c0b-5e7d-4d2a-a340-9d6d4e01b0da admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:23.973444 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb52c0b-5e7d-4d2a-a340-9d6d4e01b0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:23.973728 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb52c0b-5e7d-4d2a-a340-9d6d4e01b0da admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:23.974505 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb52c0b-5e7d-4d2a-a340-9d6d4e01b0da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:23.976538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb52c0b-5e7d-4d2a-a340-9d6d4e01b0da admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:23.979877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1147/2276] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:23.980674 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4e831-45ee-4fe7-9eb4-b4fdbfe3ebe0 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:23.982744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a7e4e831-45ee-4fe7-9eb4-b4fdbfe3ebe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:23.995638 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4e831-45ee-4fe7-9eb4-b4fdbfe3ebe0 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:24.001328 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e6173-499f-427e-8406-242517a7b9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:24.001986 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e6173-499f-427e-8406-242517a7b9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:24.002325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e6173-499f-427e-8406-242517a7b9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:24.002604 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e6173-499f-427e-8406-242517a7b9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:24.003335 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e6173-499f-427e-8406-242517a7b9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:24.004933 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e6173-499f-427e-8406-242517a7b9a2 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:24.015129 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1148/2277] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:24.016125 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e6173-499f-427e-8406-242517a7b9a2 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:24.017773 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fb7e6173-499f-427e-8406-242517a7b9a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:24.073163 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e6173-499f-427e-8406-242517a7b9a2 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:24.076950 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278e069-bb0b-4e2a-aeb9-c6729d4d234f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:24.077584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278e069-bb0b-4e2a-aeb9-c6729d4d234f service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:24.077875 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278e069-bb0b-4e2a-aeb9-c6729d4d234f service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:24.078213 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278e069-bb0b-4e2a-aeb9-c6729d4d234f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:24.087419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0278e069-bb0b-4e2a-aeb9-c6729d4d234f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:24.088832 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0278e069-bb0b-4e2a-aeb9-c6729d4d234f service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:24.101292 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1130/2279] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:23:23 2022] POST /identity/v3/projects => generated 363 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:24.101485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1149/2279] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:23:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:24.101485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278e069-bb0b-4e2a-aeb9-c6729d4d234f service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:24.101657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb52c0b-5e7d-4d2a-a340-9d6d4e01b0da admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:24.108983 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278e069-bb0b-4e2a-aeb9-c6729d4d234f service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:24.186505 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c6bd6-4c25-43e5-96e1-666aaa535cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:24.187665 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c6bd6-4c25-43e5-96e1-666aaa535cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:24.187787 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c6bd6-4c25-43e5-96e1-666aaa535cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:24.188024 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c6bd6-4c25-43e5-96e1-666aaa535cf5 admin admin] PATH_INFO: `/v3/projects/2ae633e12e21401cbc53fb5370d337b8/users/3f006c4f4dc749d6aa46d140bb1daf26/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:24.195638 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb52c0b-5e7d-4d2a-a340-9d6d4e01b0da admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:24.200612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53b3ba-5f76-4086-871c-594b8435790f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:24.201477 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53b3ba-5f76-4086-871c-594b8435790f service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:24.201782 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53b3ba-5f76-4086-871c-594b8435790f service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:24.202298 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53b3ba-5f76-4086-871c-594b8435790f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:24.206395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c6bd6-4c25-43e5-96e1-666aaa535cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae633e12e21401cbc53fb5370d337b8, user_id=3f006c4f4dc749d6aa46d140bb1daf26, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:24.209177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c6bd6-4c25-43e5-96e1-666aaa535cf5 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:24.214061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53b3ba-5f76-4086-871c-594b8435790f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:24.215739 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53b3ba-5f76-4086-871c-594b8435790f service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:24.226768 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1131/2280] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:23:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:24.228117 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53b3ba-5f76-4086-871c-594b8435790f service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:24.238645 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53b3ba-5f76-4086-871c-594b8435790f service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:24.243778 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286947f5-0eb4-4299-b06f-bf932e534cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:24.247683 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286947f5-0eb4-4299-b06f-bf932e534cff admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:24.247683 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286947f5-0eb4-4299-b06f-bf932e534cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:24.247683 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286947f5-0eb4-4299-b06f-bf932e534cff admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:24.247683 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286947f5-0eb4-4299-b06f-bf932e534cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:24.249026 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286947f5-0eb4-4299-b06f-bf932e534cff admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:24.351153 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1150/2281] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:23:24 2022] PUT /identity/v3/projects/2ae633e12e21401cbc53fb5370d337b8/users/3f006c4f4dc749d6aa46d140bb1daf26/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:24.359171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1132/2282] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:23:24 2022] POST /identity/v3/users => generated 282 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:24.360838 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c6bd6-4c25-43e5-96e1-666aaa535cf5 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:24.367884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964395e-b862-44d3-a41b-dec735cd3925 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:24.369295 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964395e-b862-44d3-a41b-dec735cd3925 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:24.370116 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964395e-b862-44d3-a41b-dec735cd3925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:24.401972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0964395e-b862-44d3-a41b-dec735cd3925 None None] MFA Rules not processed for user `3f006c4f4dc749d6aa46d140bb1daf26`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:24.403971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0964395e-b862-44d3-a41b-dec735cd3925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:24.458712 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c6bd6-4c25-43e5-96e1-666aaa535cf5 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:24.463890 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ced67b-1074-4de7-a242-c6434b8cb460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:24.464639 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ced67b-1074-4de7-a242-c6434b8cb460 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:24.464997 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ced67b-1074-4de7-a242-c6434b8cb460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:24.466019 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ced67b-1074-4de7-a242-c6434b8cb460 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:24.466845 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ced67b-1074-4de7-a242-c6434b8cb460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:24.468527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ced67b-1074-4de7-a242-c6434b8cb460 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:24.477081 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1133/2283] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:24.479192 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1151/2284] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:24.483466 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964395e-b862-44d3-a41b-dec735cd3925 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:24.489983 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ced67b-1074-4de7-a242-c6434b8cb460 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:24.492458 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-91ced67b-1074-4de7-a242-c6434b8cb460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:24.495836 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964395e-b862-44d3-a41b-dec735cd3925 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:24.501669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d221d6c-7e47-4b4c-8bee-722d49b3915e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:24.502386 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d221d6c-7e47-4b4c-8bee-722d49b3915e admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:24.502668 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d221d6c-7e47-4b4c-8bee-722d49b3915e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:24.502944 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d221d6c-7e47-4b4c-8bee-722d49b3915e admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:24.503680 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d221d6c-7e47-4b4c-8bee-722d49b3915e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:24.505352 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d221d6c-7e47-4b4c-8bee-722d49b3915e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:24.515882 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1134/2285] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:23:24.520406 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d221d6c-7e47-4b4c-8bee-722d49b3915e admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:24.530374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d221d6c-7e47-4b4c-8bee-722d49b3915e admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:24.535983 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d599acc-a8ab-48aa-b7fa-287bb1af7dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:24.536943 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d599acc-a8ab-48aa-b7fa-287bb1af7dea admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:24.537301 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d599acc-a8ab-48aa-b7fa-287bb1af7dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:24.537835 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d599acc-a8ab-48aa-b7fa-287bb1af7dea admin admin] PATH_INFO: `/v3/projects/8ebc66658eab476fa02f568813e1d1d5/users/b7370eb42af64643be0fd7d24aa00acb/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:24.562167 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d599acc-a8ab-48aa-b7fa-287bb1af7dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ebc66658eab476fa02f568813e1d1d5, user_id=b7370eb42af64643be0fd7d24aa00acb, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:24.565645 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d599acc-a8ab-48aa-b7fa-287bb1af7dea admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:24.567300 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ced67b-1074-4de7-a242-c6434b8cb460 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:24.573142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03ee3e-b282-44d6-9b9e-36474ea2fc7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:24.573878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03ee3e-b282-44d6-9b9e-36474ea2fc7e service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:24.574305 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03ee3e-b282-44d6-9b9e-36474ea2fc7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:24.574765 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03ee3e-b282-44d6-9b9e-36474ea2fc7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:24.584561 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03ee3e-b282-44d6-9b9e-36474ea2fc7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:24.586355 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03ee3e-b282-44d6-9b9e-36474ea2fc7e service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:24.610196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1152/2286] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:23:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:23:24.632614 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03ee3e-b282-44d6-9b9e-36474ea2fc7e service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:24.634946 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7c03ee3e-b282-44d6-9b9e-36474ea2fc7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:24.659652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1135/2287] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:23:24 2022] PUT /identity/v3/projects/8ebc66658eab476fa02f568813e1d1d5/users/b7370eb42af64643be0fd7d24aa00acb/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:23:24.668427 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03ee3e-b282-44d6-9b9e-36474ea2fc7e service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:24.670982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a99508-7b7f-47ff-9ff5-934821b052fb None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:24.671675 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a99508-7b7f-47ff-9ff5-934821b052fb None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:24.671970 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a99508-7b7f-47ff-9ff5-934821b052fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:24.733783 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-24a99508-7b7f-47ff-9ff5-934821b052fb None None] MFA Rules not processed for user `b7370eb42af64643be0fd7d24aa00acb`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:24.740460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-24a99508-7b7f-47ff-9ff5-934821b052fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:24.776302 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232594d0-add0-431e-b189-1e559355e479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:24.777218 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232594d0-add0-431e-b189-1e559355e479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:24.777510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232594d0-add0-431e-b189-1e559355e479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:24.777864 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232594d0-add0-431e-b189-1e559355e479 admin admin] PATH_INFO: `/v3/projects/8b797c25170a4d5fab56de4669d2c318` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:24.779838 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232594d0-add0-431e-b189-1e559355e479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b797c25170a4d5fab56de4669d2c318)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:24.782233 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232594d0-add0-431e-b189-1e559355e479 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:24.831225 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1136/2288] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:24 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:23:24.848626 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a99508-7b7f-47ff-9ff5-934821b052fb None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:24.848626 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-24a99508-7b7f-47ff-9ff5-934821b052fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:24.920210 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a99508-7b7f-47ff-9ff5-934821b052fb None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:24.950947 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-232594d0-add0-431e-b189-1e559355e479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b797c25170a4d5fab56de4669d2c318', 'request_id': 'req-232594d0-add0-431e-b189-1e559355e479'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:24.959103 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-232594d0-add0-431e-b189-1e559355e479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b797c25170a4d5fab56de4669d2c318', 'request_id': 'req-232594d0-add0-431e-b189-1e559355e479'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:24.986356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a5175-c4ff-4165-9f58-7cdb45d9b922 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:24.989031 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a5175-c4ff-4165-9f58-7cdb45d9b922 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:24.989031 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a5175-c4ff-4165-9f58-7cdb45d9b922 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:24.989031 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a5175-c4ff-4165-9f58-7cdb45d9b922 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:25.048976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a5175-c4ff-4165-9f58-7cdb45d9b922 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:25.050653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a5175-c4ff-4165-9f58-7cdb45d9b922 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:25.059809 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1137/2289] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:23:24 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:25.060672 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a5175-c4ff-4165-9f58-7cdb45d9b922 service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:25.062060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8c8a5175-c4ff-4165-9f58-7cdb45d9b922 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:25.063258 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-232594d0-add0-431e-b189-1e559355e479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b797c25170a4d5fab56de4669d2c318', 'request_id': 'req-232594d0-add0-431e-b189-1e559355e479'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:25.080126 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-232594d0-add0-431e-b189-1e559355e479 admin admin] The token cache is being invalidate because project 8b797c25170a4d5fab56de4669d2c318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:25.080500 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-232594d0-add0-431e-b189-1e559355e479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:25.082593 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-232594d0-add0-431e-b189-1e559355e479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:25.085740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1153/2290] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:23:24 2022] DELETE /identity/v3/projects/8b797c25170a4d5fab56de4669d2c318 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:25.089287 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232594d0-add0-431e-b189-1e559355e479 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:25.095581 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-232594d0-add0-431e-b189-1e559355e479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:25.171844 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a5175-c4ff-4165-9f58-7cdb45d9b922 service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:25.179652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc16ce-f11d-411a-a56d-7eca7cdd9a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:25.181159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc16ce-f11d-411a-a56d-7eca7cdd9a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:25.181669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc16ce-f11d-411a-a56d-7eca7cdd9a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:25.182208 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc16ce-f11d-411a-a56d-7eca7cdd9a64 admin admin] PATH_INFO: `/v3/projects/d77554fc1e9942d7a67496876d08ce07` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:25.184938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc16ce-f11d-411a-a56d-7eca7cdd9a64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d77554fc1e9942d7a67496876d08ce07)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:25.186610 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc16ce-f11d-411a-a56d-7eca7cdd9a64 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:25.193438 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232594d0-add0-431e-b189-1e559355e479 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:25.198992 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767282f-bd60-4f14-9a4c-e71555f33ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:25.203614 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767282f-bd60-4f14-9a4c-e71555f33ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:25.203614 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767282f-bd60-4f14-9a4c-e71555f33ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:25.203614 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767282f-bd60-4f14-9a4c-e71555f33ff0 admin admin] PATH_INFO: `/v3/users/2d02fefb3e9c4c6783c1be2bc08e1b62` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:25.203614 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767282f-bd60-4f14-9a4c-e71555f33ff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d02fefb3e9c4c6783c1be2bc08e1b62)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:25.204510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767282f-bd60-4f14-9a4c-e71555f33ff0 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:25.355185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-edfc16ce-f11d-411a-a56d-7eca7cdd9a64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd77554fc1e9942d7a67496876d08ce07', 'request_id': 'req-edfc16ce-f11d-411a-a56d-7eca7cdd9a64'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:25.451588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-edfc16ce-f11d-411a-a56d-7eca7cdd9a64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd77554fc1e9942d7a67496876d08ce07', 'request_id': 'req-edfc16ce-f11d-411a-a56d-7eca7cdd9a64'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:25.458908 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-edfc16ce-f11d-411a-a56d-7eca7cdd9a64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd77554fc1e9942d7a67496876d08ce07', 'request_id': 'req-edfc16ce-f11d-411a-a56d-7eca7cdd9a64'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:25.469474 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-edfc16ce-f11d-411a-a56d-7eca7cdd9a64 admin admin] The token cache is being invalidate because project d77554fc1e9942d7a67496876d08ce07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:25.469822 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-edfc16ce-f11d-411a-a56d-7eca7cdd9a64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:25.470521 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-edfc16ce-f11d-411a-a56d-7eca7cdd9a64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:25.472090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1138/2291] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:23:25 2022] DELETE /identity/v3/projects/d77554fc1e9942d7a67496876d08ce07 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:25.476854 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e6aeb-228d-42b9-b643-6f1e9bd6e012 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:25.477142 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e6aeb-228d-42b9-b643-6f1e9bd6e012 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:25.477421 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e6aeb-228d-42b9-b643-6f1e9bd6e012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:25.510582 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d12e6aeb-228d-42b9-b643-6f1e9bd6e012 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:25.511850 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d12e6aeb-228d-42b9-b643-6f1e9bd6e012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:25.515240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4767282f-bd60-4f14-9a4c-e71555f33ff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d02fefb3e9c4c6783c1be2bc08e1b62'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:25.536024 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4767282f-bd60-4f14-9a4c-e71555f33ff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d02fefb3e9c4c6783c1be2bc08e1b62'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:25.536950 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4767282f-bd60-4f14-9a4c-e71555f33ff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d02fefb3e9c4c6783c1be2bc08e1b62'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:25.537931 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4767282f-bd60-4f14-9a4c-e71555f33ff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d02fefb3e9c4c6783c1be2bc08e1b62'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:25.555369 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4767282f-bd60-4f14-9a4c-e71555f33ff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d02fefb3e9c4c6783c1be2bc08e1b62'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:25.599795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1139/2292] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:23:25.614077 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e696514-f160-4ed5-beef-fe76616c9b03 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:25.614077 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e696514-f160-4ed5-beef-fe76616c9b03 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:25.614077 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e696514-f160-4ed5-beef-fe76616c9b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:25.629956 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-6e696514-f160-4ed5-beef-fe76616c9b03 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:25.631484 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6e696514-f160-4ed5-beef-fe76616c9b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:25.640452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1140/2293] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:23:25.644711 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e696514-f160-4ed5-beef-fe76616c9b03 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:25.653652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e696514-f160-4ed5-beef-fe76616c9b03 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:25.658267 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062785b-d9b5-484d-9786-95d09e9cd553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:25.658907 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062785b-d9b5-484d-9786-95d09e9cd553 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:25.659189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062785b-d9b5-484d-9786-95d09e9cd553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:25.659465 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062785b-d9b5-484d-9786-95d09e9cd553 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:25.660188 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062785b-d9b5-484d-9786-95d09e9cd553 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:23:25.660492 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062785b-d9b5-484d-9786-95d09e9cd553 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:25.662098 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062785b-d9b5-484d-9786-95d09e9cd553 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:25.669408 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1154/2294] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:23:25 2022] DELETE /identity/v3/users/2d02fefb3e9c4c6783c1be2bc08e1b62 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:25.674883 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1141/2295] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:23:25.679047 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767282f-bd60-4f14-9a4c-e71555f33ff0 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:25.754709 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767282f-bd60-4f14-9a4c-e71555f33ff0 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:25.760687 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6541e5-4413-4322-8420-52684bec4ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:25.761458 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6541e5-4413-4322-8420-52684bec4ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:25.761818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6541e5-4413-4322-8420-52684bec4ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:25.762228 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6541e5-4413-4322-8420-52684bec4ef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:25.763041 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6541e5-4413-4322-8420-52684bec4ef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:25.765114 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6541e5-4413-4322-8420-52684bec4ef6 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:25.905241 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1155/2296] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:23:25 2022] POST /identity/v3/projects => generated 385 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:25.909863 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062785b-d9b5-484d-9786-95d09e9cd553 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:25.921890 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062785b-d9b5-484d-9786-95d09e9cd553 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:25.991636 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66aa05c-3a32-4cc3-b784-39d548569592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:25.993070 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66aa05c-3a32-4cc3-b784-39d548569592 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:25.993233 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66aa05c-3a32-4cc3-b784-39d548569592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:25.993543 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66aa05c-3a32-4cc3-b784-39d548569592 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:25.994463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66aa05c-3a32-4cc3-b784-39d548569592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:25.996762 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66aa05c-3a32-4cc3-b784-39d548569592 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:26.092512 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1142/2297] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:23:25 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:26.101718 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6541e5-4413-4322-8420-52684bec4ef6 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:26.112781 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6541e5-4413-4322-8420-52684bec4ef6 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:26.117512 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77766f34-0b1c-4b33-adea-4c7bd159361e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:26.118299 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77766f34-0b1c-4b33-adea-4c7bd159361e admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:26.118636 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77766f34-0b1c-4b33-adea-4c7bd159361e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:26.118976 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77766f34-0b1c-4b33-adea-4c7bd159361e admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:26.119827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77766f34-0b1c-4b33-adea-4c7bd159361e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:26.121718 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77766f34-0b1c-4b33-adea-4c7bd159361e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:26.133196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1156/2298] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:23:26.137645 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66aa05c-3a32-4cc3-b784-39d548569592 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:26.148004 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66aa05c-3a32-4cc3-b784-39d548569592 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:26.153823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bac19d-4d27-4f60-8003-c0424da98eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:26.154500 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bac19d-4d27-4f60-8003-c0424da98eef admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:26.154856 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bac19d-4d27-4f60-8003-c0424da98eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:26.155200 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bac19d-4d27-4f60-8003-c0424da98eef admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:26.156030 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bac19d-4d27-4f60-8003-c0424da98eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:26.157713 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bac19d-4d27-4f60-8003-c0424da98eef admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:26.168495 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1143/2299] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:23:26.172855 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77766f34-0b1c-4b33-adea-4c7bd159361e admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:26.183623 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77766f34-0b1c-4b33-adea-4c7bd159361e admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:26.188995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de00a43-3d89-4481-93eb-f5f15883294e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:26.189873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de00a43-3d89-4481-93eb-f5f15883294e admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:26.191383 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de00a43-3d89-4481-93eb-f5f15883294e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:26.191383 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de00a43-3d89-4481-93eb-f5f15883294e admin admin] PATH_INFO: `/v3/projects/ad0ab5fe86554871b30455b6a659d7a4/users/b03f0aaf4ece4ae7baf991184d2db6f4/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:26.205326 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de00a43-3d89-4481-93eb-f5f15883294e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad0ab5fe86554871b30455b6a659d7a4, user_id=b03f0aaf4ece4ae7baf991184d2db6f4, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:26.208130 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de00a43-3d89-4481-93eb-f5f15883294e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:26.247686 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bac19d-4d27-4f60-8003-c0424da98eef admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:26.249598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f8bac19d-4d27-4f60-8003-c0424da98eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:26.268543 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bac19d-4d27-4f60-8003-c0424da98eef admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:26.273345 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b9aac-d039-450b-bed4-2beb5b40f051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:26.274231 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b9aac-d039-450b-bed4-2beb5b40f051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:26.274515 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b9aac-d039-450b-bed4-2beb5b40f051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:26.280365 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b9aac-d039-450b-bed4-2beb5b40f051 admin admin] PATH_INFO: `/v3/projects/6af0eab9c22f4d278e4e81cea1d623d7` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:26.280365 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b9aac-d039-450b-bed4-2beb5b40f051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6af0eab9c22f4d278e4e81cea1d623d7)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:26.280365 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b9aac-d039-450b-bed4-2beb5b40f051 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:26.314569 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1157/2300] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:23:26 2022] PUT /identity/v3/projects/ad0ab5fe86554871b30455b6a659d7a4/users/b03f0aaf4ece4ae7baf991184d2db6f4/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:23:26.325047 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878afe9-8a03-4839-b6f8-15e7cb8821be None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:26.325465 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878afe9-8a03-4839-b6f8-15e7cb8821be None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:26.325751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878afe9-8a03-4839-b6f8-15e7cb8821be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:26.351702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-5878afe9-8a03-4839-b6f8-15e7cb8821be None None] MFA Rules not processed for user `b03f0aaf4ece4ae7baf991184d2db6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:26.352903 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5878afe9-8a03-4839-b6f8-15e7cb8821be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:26.405756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d53b9aac-d039-450b-bed4-2beb5b40f051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af0eab9c22f4d278e4e81cea1d623d7', 'request_id': 'req-d53b9aac-d039-450b-bed4-2beb5b40f051'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:26.416871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1158/2301] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:23:26.429801 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878afe9-8a03-4839-b6f8-15e7cb8821be None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:26.431575 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5878afe9-8a03-4839-b6f8-15e7cb8821be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:26.486195 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878afe9-8a03-4839-b6f8-15e7cb8821be None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:26.491631 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d53b9aac-d039-450b-bed4-2beb5b40f051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af0eab9c22f4d278e4e81cea1d623d7', 'request_id': 'req-d53b9aac-d039-450b-bed4-2beb5b40f051'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:26.499357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d53b9aac-d039-450b-bed4-2beb5b40f051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af0eab9c22f4d278e4e81cea1d623d7', 'request_id': 'req-d53b9aac-d039-450b-bed4-2beb5b40f051'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:26.509997 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d53b9aac-d039-450b-bed4-2beb5b40f051 admin admin] The token cache is being invalidate because project 6af0eab9c22f4d278e4e81cea1d623d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:26.510335 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d53b9aac-d039-450b-bed4-2beb5b40f051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:26.511011 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d53b9aac-d039-450b-bed4-2beb5b40f051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:26.512618 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1144/2302] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:23:26 2022] DELETE /identity/v3/projects/6af0eab9c22f4d278e4e81cea1d623d7 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:23:26.518801 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec0733-4c52-40fe-95c4-8ad4b2900af4 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:26.519166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec0733-4c52-40fe-95c4-8ad4b2900af4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:26.519457 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec0733-4c52-40fe-95c4-8ad4b2900af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:26.538161 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-7eec0733-4c52-40fe-95c4-8ad4b2900af4 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:26.539381 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7eec0733-4c52-40fe-95c4-8ad4b2900af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:26.539836 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27823a7-0696-416f-a997-8e20df91553b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:26.540487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27823a7-0696-416f-a997-8e20df91553b service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:26.540802 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27823a7-0696-416f-a997-8e20df91553b service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:26.541038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27823a7-0696-416f-a997-8e20df91553b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:26.542945 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f27823a7-0696-416f-a997-8e20df91553b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:26.616247 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1145/2303] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:26.624943 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012db83-eab0-4fbc-86ad-c5f0ec62390e None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:26.625663 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012db83-eab0-4fbc-86ad-c5f0ec62390e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:26.627155 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012db83-eab0-4fbc-86ad-c5f0ec62390e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:26.633565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27823a7-0696-416f-a997-8e20df91553b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:26.635356 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27823a7-0696-416f-a997-8e20df91553b service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:26.650579 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-8012db83-eab0-4fbc-86ad-c5f0ec62390e None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:26.652027 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8012db83-eab0-4fbc-86ad-c5f0ec62390e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:26.655549 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1159/2304] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:23:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:23:26.665250 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1146/2305] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:26.670827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27823a7-0696-416f-a997-8e20df91553b service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:26.682198 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27823a7-0696-416f-a997-8e20df91553b service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:26.687494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388c682-fa0f-4071-b4ba-67b3b08ac165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:26.688629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388c682-fa0f-4071-b4ba-67b3b08ac165 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:26.688629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388c682-fa0f-4071-b4ba-67b3b08ac165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:26.688844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388c682-fa0f-4071-b4ba-67b3b08ac165 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:26.689495 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d388c682-fa0f-4071-b4ba-67b3b08ac165 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:23:26.689802 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d388c682-fa0f-4071-b4ba-67b3b08ac165 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:26.691567 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d388c682-fa0f-4071-b4ba-67b3b08ac165 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:26.704448 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1160/2306] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:23:26.708643 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012db83-eab0-4fbc-86ad-c5f0ec62390e None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:26.721890 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012db83-eab0-4fbc-86ad-c5f0ec62390e None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:26.727612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672374fa-d1e6-4a2d-b084-42064ced4d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:26.728371 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672374fa-d1e6-4a2d-b084-42064ced4d2a admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:26.728661 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672374fa-d1e6-4a2d-b084-42064ced4d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:26.728940 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672374fa-d1e6-4a2d-b084-42064ced4d2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:26.729639 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672374fa-d1e6-4a2d-b084-42064ced4d2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:26.732197 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672374fa-d1e6-4a2d-b084-42064ced4d2a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:26.841112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1147/2307] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:23:26 2022] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:26.842459 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388c682-fa0f-4071-b4ba-67b3b08ac165 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:26.853783 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388c682-fa0f-4071-b4ba-67b3b08ac165 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:26.922386 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a5639-8fef-4aa1-ae82-7b4a157b2b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:26.923046 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a5639-8fef-4aa1-ae82-7b4a157b2b09 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:26.923309 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a5639-8fef-4aa1-ae82-7b4a157b2b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:26.923588 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a5639-8fef-4aa1-ae82-7b4a157b2b09 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:26.924311 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a5639-8fef-4aa1-ae82-7b4a157b2b09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:26.926368 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a5639-8fef-4aa1-ae82-7b4a157b2b09 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:27.003231 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1161/2308] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:23:26 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:27.004521 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672374fa-d1e6-4a2d-b084-42064ced4d2a admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:27.015832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672374fa-d1e6-4a2d-b084-42064ced4d2a admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:27.020681 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61772694-b874-441e-bc38-73f1a10e02c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:27.021345 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61772694-b874-441e-bc38-73f1a10e02c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:27.022120 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61772694-b874-441e-bc38-73f1a10e02c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:27.022120 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61772694-b874-441e-bc38-73f1a10e02c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:27.022673 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61772694-b874-441e-bc38-73f1a10e02c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:27.024279 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61772694-b874-441e-bc38-73f1a10e02c7 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:27.035339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1148/2309] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:27.040564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a5639-8fef-4aa1-ae82-7b4a157b2b09 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:27.050762 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a5639-8fef-4aa1-ae82-7b4a157b2b09 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:27.055513 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231eb1d-efbe-4fd3-9988-668aace44359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:27.056064 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231eb1d-efbe-4fd3-9988-668aace44359 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:27.056343 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231eb1d-efbe-4fd3-9988-668aace44359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:27.056617 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231eb1d-efbe-4fd3-9988-668aace44359 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:27.057712 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231eb1d-efbe-4fd3-9988-668aace44359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:27.058999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231eb1d-efbe-4fd3-9988-668aace44359 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:27.069008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1162/2310] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:27.073153 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61772694-b874-441e-bc38-73f1a10e02c7 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:27.083504 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61772694-b874-441e-bc38-73f1a10e02c7 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:27.088424 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb34e2-04e1-4d1a-a7dc-e1b2e67b7241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:27.089349 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb34e2-04e1-4d1a-a7dc-e1b2e67b7241 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:27.089713 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb34e2-04e1-4d1a-a7dc-e1b2e67b7241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:27.090092 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb34e2-04e1-4d1a-a7dc-e1b2e67b7241 admin admin] PATH_INFO: `/v3/projects/b4d2c90c8cf1430baa5f70b93176aafa/users/22a49508f9944ec19ea90767ffdcf7f3/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:27.105474 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb34e2-04e1-4d1a-a7dc-e1b2e67b7241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4d2c90c8cf1430baa5f70b93176aafa, user_id=22a49508f9944ec19ea90767ffdcf7f3, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:27.108207 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb34e2-04e1-4d1a-a7dc-e1b2e67b7241 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:27.190923 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1149/2311] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:23:27 2022] PUT /identity/v3/projects/b4d2c90c8cf1430baa5f70b93176aafa/users/22a49508f9944ec19ea90767ffdcf7f3/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:27.202546 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9dcb0-b2aa-463b-b1f4-d0dc848aba07 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:27.202844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9dcb0-b2aa-463b-b1f4-d0dc848aba07 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:27.203128 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9dcb0-b2aa-463b-b1f4-d0dc848aba07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:27.234480 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f2f9dcb0-b2aa-463b-b1f4-d0dc848aba07 None None] MFA Rules not processed for user `22a49508f9944ec19ea90767ffdcf7f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:27.236494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f2f9dcb0-b2aa-463b-b1f4-d0dc848aba07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:27.319219 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1163/2312] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:27 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:27.331536 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb34e2-04e1-4d1a-a7dc-e1b2e67b7241 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:27.333734 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b6bb34e2-04e1-4d1a-a7dc-e1b2e67b7241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:27.413483 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb34e2-04e1-4d1a-a7dc-e1b2e67b7241 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:27.417436 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567556e-496e-430b-ae68-7c4761fe1144 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1e67aa4370453fafb5b6525ba13cd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:27.418087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567556e-496e-430b-ae68-7c4761fe1144 service glance] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:27.420162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567556e-496e-430b-ae68-7c4761fe1144 service glance] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:27.420162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567556e-496e-430b-ae68-7c4761fe1144 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:27.427705 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567556e-496e-430b-ae68-7c4761fe1144 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:27.429217 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567556e-496e-430b-ae68-7c4761fe1144 service glance] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:27.440041 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1150/2313] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:23:27 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:33.937291 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9dcb0-b2aa-463b-b1f4-d0dc848aba07 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:33.938805 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f2f9dcb0-b2aa-463b-b1f4-d0dc848aba07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:34.021876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9dcb0-b2aa-463b-b1f4-d0dc848aba07 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:34.026767 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236ef01-d406-4694-9236-c24a13b64d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:34.028070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236ef01-d406-4694-9236-c24a13b64d78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:34.029374 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236ef01-d406-4694-9236-c24a13b64d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:34.029998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236ef01-d406-4694-9236-c24a13b64d78 admin admin] PATH_INFO: `/v3/users/3f006c4f4dc749d6aa46d140bb1daf26` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:34.031524 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236ef01-d406-4694-9236-c24a13b64d78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f006c4f4dc749d6aa46d140bb1daf26)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:34.035239 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236ef01-d406-4694-9236-c24a13b64d78 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:34.305683 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e236ef01-d406-4694-9236-c24a13b64d78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f006c4f4dc749d6aa46d140bb1daf26'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:34.318083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e236ef01-d406-4694-9236-c24a13b64d78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f006c4f4dc749d6aa46d140bb1daf26'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:34.318842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e236ef01-d406-4694-9236-c24a13b64d78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f006c4f4dc749d6aa46d140bb1daf26'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:34.319448 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e236ef01-d406-4694-9236-c24a13b64d78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f006c4f4dc749d6aa46d140bb1daf26'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:34.326240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e236ef01-d406-4694-9236-c24a13b64d78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f006c4f4dc749d6aa46d140bb1daf26'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:34.428428 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1164/2314] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:23:33 2022] DELETE /identity/v3/users/3f006c4f4dc749d6aa46d140bb1daf26 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:34.432875 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a11cd-504b-4b9c-83e7-c45af0ad0078 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:34.433374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a11cd-504b-4b9c-83e7-c45af0ad0078 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:34.433491 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a11cd-504b-4b9c-83e7-c45af0ad0078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:34.454660 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a06a11cd-504b-4b9c-83e7-c45af0ad0078 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:34.456051 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a06a11cd-504b-4b9c-83e7-c45af0ad0078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:34.526259 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1151/2315] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:34.536623 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236ef01-d406-4694-9236-c24a13b64d78 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:34.538291 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e236ef01-d406-4694-9236-c24a13b64d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:34.603457 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236ef01-d406-4694-9236-c24a13b64d78 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:34.607508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2651f1-861c-46d4-940c-1400a13cc496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:34.608138 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2651f1-861c-46d4-940c-1400a13cc496 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:34.608422 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2651f1-861c-46d4-940c-1400a13cc496 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:34.608697 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2651f1-861c-46d4-940c-1400a13cc496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:34.619138 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2651f1-861c-46d4-940c-1400a13cc496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:34.620885 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2651f1-861c-46d4-940c-1400a13cc496 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:34.634333 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1165/2316] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:23:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:35.159582 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a11cd-504b-4b9c-83e7-c45af0ad0078 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:35.162572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a06a11cd-504b-4b9c-83e7-c45af0ad0078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:35.187102 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a11cd-504b-4b9c-83e7-c45af0ad0078 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:35.210048 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe64099-d700-4108-8dbe-d873d5afc185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:35.211005 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe64099-d700-4108-8dbe-d873d5afc185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:35.211254 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe64099-d700-4108-8dbe-d873d5afc185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:35.214740 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe64099-d700-4108-8dbe-d873d5afc185 admin admin] PATH_INFO: `/v3/projects/2ae633e12e21401cbc53fb5370d337b8` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:35.214740 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe64099-d700-4108-8dbe-d873d5afc185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ae633e12e21401cbc53fb5370d337b8)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:35.218398 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe64099-d700-4108-8dbe-d873d5afc185 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:35.440121 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ebe64099-d700-4108-8dbe-d873d5afc185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ae633e12e21401cbc53fb5370d337b8', 'request_id': 'req-ebe64099-d700-4108-8dbe-d873d5afc185'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:35.589096 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ebe64099-d700-4108-8dbe-d873d5afc185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ae633e12e21401cbc53fb5370d337b8', 'request_id': 'req-ebe64099-d700-4108-8dbe-d873d5afc185'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:35.597252 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ebe64099-d700-4108-8dbe-d873d5afc185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ae633e12e21401cbc53fb5370d337b8', 'request_id': 'req-ebe64099-d700-4108-8dbe-d873d5afc185'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:35.608729 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ebe64099-d700-4108-8dbe-d873d5afc185 admin admin] The token cache is being invalidate because project 2ae633e12e21401cbc53fb5370d337b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:35.609472 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ebe64099-d700-4108-8dbe-d873d5afc185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:35.611304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ebe64099-d700-4108-8dbe-d873d5afc185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:35.614738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1152/2317] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:23:35 2022] DELETE /identity/v3/projects/2ae633e12e21401cbc53fb5370d337b8 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:37.838415 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2651f1-861c-46d4-940c-1400a13cc496 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:37.844644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4d2651f1-861c-46d4-940c-1400a13cc496 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:37.857192 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eda0cc-57af-4dee-a593-211873f476cb None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:37.857725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eda0cc-57af-4dee-a593-211873f476cb None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:37.857818 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eda0cc-57af-4dee-a593-211873f476cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:37.862023 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2651f1-861c-46d4-940c-1400a13cc496 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:37.890798 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d5eda0cc-57af-4dee-a593-211873f476cb None None] MFA Rules not processed for user `1a7181297bf14a57b3bf1f3c8b178d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:37.892148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d5eda0cc-57af-4dee-a593-211873f476cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:37.925038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbeb5f3-357b-4acf-b807-9872acde351d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:37.926163 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbeb5f3-357b-4acf-b807-9872acde351d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:37.926452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbeb5f3-357b-4acf-b807-9872acde351d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:37.926730 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbeb5f3-357b-4acf-b807-9872acde351d admin admin] PATH_INFO: `/v3/users/b03f0aaf4ece4ae7baf991184d2db6f4` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:37.927956 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbeb5f3-357b-4acf-b807-9872acde351d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b03f0aaf4ece4ae7baf991184d2db6f4)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:37.929937 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbeb5f3-357b-4acf-b807-9872acde351d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:37.983327 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1153/2318] 10.222.0.76 () {58 vars in 1009 bytes} [Mon May 16 15:23:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:38.027291 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eda0cc-57af-4dee-a593-211873f476cb None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:38.030764 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d5eda0cc-57af-4dee-a593-211873f476cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:38.119473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eda0cc-57af-4dee-a593-211873f476cb None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:38.126119 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f51f4-19f7-4dc3-baf4-a64b87c73cad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33470e30760842ca9e96bb7f0cf9f07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:38.126899 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f51f4-19f7-4dc3-baf4-a64b87c73cad service swift] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:38.127256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f51f4-19f7-4dc3-baf4-a64b87c73cad service swift] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:38.127759 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f51f4-19f7-4dc3-baf4-a64b87c73cad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:38.136806 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f51f4-19f7-4dc3-baf4-a64b87c73cad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:38.138759 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f51f4-19f7-4dc3-baf4-a64b87c73cad service swift] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:38.147649 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1154/2319] 10.222.0.76 () {60 vars in 1384 bytes} [Mon May 16 15:23:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:23:38.185496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7fbeb5f3-357b-4acf-b807-9872acde351d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b03f0aaf4ece4ae7baf991184d2db6f4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:38.198263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7fbeb5f3-357b-4acf-b807-9872acde351d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b03f0aaf4ece4ae7baf991184d2db6f4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:38.198972 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7fbeb5f3-357b-4acf-b807-9872acde351d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b03f0aaf4ece4ae7baf991184d2db6f4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:38.199630 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7fbeb5f3-357b-4acf-b807-9872acde351d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b03f0aaf4ece4ae7baf991184d2db6f4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:38.206677 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7fbeb5f3-357b-4acf-b807-9872acde351d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b03f0aaf4ece4ae7baf991184d2db6f4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:38.365862 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1166/2320] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:23:37 2022] DELETE /identity/v3/users/b03f0aaf4ece4ae7baf991184d2db6f4 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:38.370588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b1b63-42bc-4d4b-b948-f2b949570406 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:38.371366 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b1b63-42bc-4d4b-b948-f2b949570406 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:38.371861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b1b63-42bc-4d4b-b948-f2b949570406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:38.390427 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-2b6b1b63-42bc-4d4b-b948-f2b949570406 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:38.391815 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2b6b1b63-42bc-4d4b-b948-f2b949570406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:38.452584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1155/2321] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:38.462255 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbeb5f3-357b-4acf-b807-9872acde351d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:38.463702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7fbeb5f3-357b-4acf-b807-9872acde351d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:38.544804 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbeb5f3-357b-4acf-b807-9872acde351d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:38.548828 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb8502-363a-49bb-9987-83c757484de0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:38.549574 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb8502-363a-49bb-9987-83c757484de0 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:38.549949 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb8502-363a-49bb-9987-83c757484de0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:38.550349 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb8502-363a-49bb-9987-83c757484de0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:38.563810 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb8502-363a-49bb-9987-83c757484de0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:38.565382 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb8502-363a-49bb-9987-83c757484de0 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:38.576639 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1167/2322] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:23:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:39.064624 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b1b63-42bc-4d4b-b948-f2b949570406 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:39.066203 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2b6b1b63-42bc-4d4b-b948-f2b949570406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:39.079428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b1b63-42bc-4d4b-b948-f2b949570406 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:39.084473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef1245-fb23-4f49-937b-4836f0f557d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:39.085738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef1245-fb23-4f49-937b-4836f0f557d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:39.086023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef1245-fb23-4f49-937b-4836f0f557d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:39.089761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef1245-fb23-4f49-937b-4836f0f557d6 admin admin] PATH_INFO: `/v3/projects/ad0ab5fe86554871b30455b6a659d7a4` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:39.090306 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef1245-fb23-4f49-937b-4836f0f557d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad0ab5fe86554871b30455b6a659d7a4)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:39.092834 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef1245-fb23-4f49-937b-4836f0f557d6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:39.126603 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5446917-e9cd-4270-958c-65af6224eeb2 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:39.127113 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5446917-e9cd-4270-958c-65af6224eeb2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:39.127222 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5446917-e9cd-4270-958c-65af6224eeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:39.145413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f5446917-e9cd-4270-958c-65af6224eeb2 None None] MFA Rules not processed for user `1a7181297bf14a57b3bf1f3c8b178d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:39.146670 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f5446917-e9cd-4270-958c-65af6224eeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:39.202677 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1168/2323] 10.222.0.76 () {58 vars in 967 bytes} [Mon May 16 15:23:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:23:39.217052 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5446917-e9cd-4270-958c-65af6224eeb2 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:39.218529 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f5446917-e9cd-4270-958c-65af6224eeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:39.238231 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b3ef1245-fb23-4f49-937b-4836f0f557d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad0ab5fe86554871b30455b6a659d7a4', 'request_id': 'req-b3ef1245-fb23-4f49-937b-4836f0f557d6'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:39.297983 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5446917-e9cd-4270-958c-65af6224eeb2 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:39.342473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b3ef1245-fb23-4f49-937b-4836f0f557d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad0ab5fe86554871b30455b6a659d7a4', 'request_id': 'req-b3ef1245-fb23-4f49-937b-4836f0f557d6'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:39.359031 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b3ef1245-fb23-4f49-937b-4836f0f557d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad0ab5fe86554871b30455b6a659d7a4', 'request_id': 'req-b3ef1245-fb23-4f49-937b-4836f0f557d6'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:39.374835 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b3ef1245-fb23-4f49-937b-4836f0f557d6 admin admin] The token cache is being invalidate because project ad0ab5fe86554871b30455b6a659d7a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:39.375505 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b3ef1245-fb23-4f49-937b-4836f0f557d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:39.376394 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b3ef1245-fb23-4f49-937b-4836f0f557d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:39.378506 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1156/2324] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:23:39 2022] DELETE /identity/v3/projects/ad0ab5fe86554871b30455b6a659d7a4 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:39.391904 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f0350-1289-4ea8-8d43-c95444f3ae8e None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:39.392311 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebae1fd-2e96-4029-be97-e663b9ce8783 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33470e30760842ca9e96bb7f0cf9f07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:39.392467 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f0350-1289-4ea8-8d43-c95444f3ae8e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:39.392639 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f0350-1289-4ea8-8d43-c95444f3ae8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:39.392971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebae1fd-2e96-4029-be97-e663b9ce8783 service swift] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:39.393254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebae1fd-2e96-4029-be97-e663b9ce8783 service swift] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:39.393529 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebae1fd-2e96-4029-be97-e663b9ce8783 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:39.395562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7ebae1fd-2e96-4029-be97-e663b9ce8783 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:39.412049 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-7e4f0350-1289-4ea8-8d43-c95444f3ae8e None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:39.413240 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7e4f0350-1289-4ea8-8d43-c95444f3ae8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:39.457812 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebae1fd-2e96-4029-be97-e663b9ce8783 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:39.459481 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebae1fd-2e96-4029-be97-e663b9ce8783 service swift] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:39.468858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1169/2325] 10.222.0.76 () {60 vars in 1384 bytes} [Mon May 16 15:23:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 15:23:39.474760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1157/2326] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:39.482523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77376f06-b350-4140-9be8-f7d9bc0237e0 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:39.482825 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77376f06-b350-4140-9be8-f7d9bc0237e0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:39.483142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77376f06-b350-4140-9be8-f7d9bc0237e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:39.505502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-77376f06-b350-4140-9be8-f7d9bc0237e0 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:39.506744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-77376f06-b350-4140-9be8-f7d9bc0237e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:39.515434 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1170/2327] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:23:39.520081 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f0350-1289-4ea8-8d43-c95444f3ae8e None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:39.529850 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f0350-1289-4ea8-8d43-c95444f3ae8e None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:39.534500 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46fec7-8897-4ddb-89fa-2b04d6b06005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:39.535161 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46fec7-8897-4ddb-89fa-2b04d6b06005 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:39.535440 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46fec7-8897-4ddb-89fa-2b04d6b06005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:39.535716 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46fec7-8897-4ddb-89fa-2b04d6b06005 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:39.536455 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46fec7-8897-4ddb-89fa-2b04d6b06005 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:23:39.536758 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46fec7-8897-4ddb-89fa-2b04d6b06005 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:39.538404 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46fec7-8897-4ddb-89fa-2b04d6b06005 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:39.552622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1158/2328] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:23:39.556828 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77376f06-b350-4140-9be8-f7d9bc0237e0 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:39.567220 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77376f06-b350-4140-9be8-f7d9bc0237e0 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:39.572474 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c04d0-10ee-4523-be99-dd34a73b04fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:39.573314 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c04d0-10ee-4523-be99-dd34a73b04fa admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:39.573605 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c04d0-10ee-4523-be99-dd34a73b04fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:39.573890 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c04d0-10ee-4523-be99-dd34a73b04fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:39.575505 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c04d0-10ee-4523-be99-dd34a73b04fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:39.579606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c04d0-10ee-4523-be99-dd34a73b04fa admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:39.673497 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1171/2329] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:23:39 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:39.675033 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46fec7-8897-4ddb-89fa-2b04d6b06005 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:39.689560 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46fec7-8897-4ddb-89fa-2b04d6b06005 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:39.757260 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c7971-c2d6-4f18-afee-eeae36a6ce14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:39.758102 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c7971-c2d6-4f18-afee-eeae36a6ce14 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:39.758571 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c7971-c2d6-4f18-afee-eeae36a6ce14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:39.758939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c7971-c2d6-4f18-afee-eeae36a6ce14 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:39.759734 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c7971-c2d6-4f18-afee-eeae36a6ce14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:39.761896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c7971-c2d6-4f18-afee-eeae36a6ce14 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:39.888825 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1159/2330] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:23:39 2022] POST /identity/v3/users => generated 294 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:39.890354 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c04d0-10ee-4523-be99-dd34a73b04fa admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:39.902512 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c04d0-10ee-4523-be99-dd34a73b04fa admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:39.918112 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81655c-d38a-4945-a304-7905449beedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:39.918850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81655c-d38a-4945-a304-7905449beedb admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:39.919135 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81655c-d38a-4945-a304-7905449beedb admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:39.919410 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81655c-d38a-4945-a304-7905449beedb admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:39.920158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81655c-d38a-4945-a304-7905449beedb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:39.921765 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81655c-d38a-4945-a304-7905449beedb admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:39.932422 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1172/2331] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:39.936645 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c7971-c2d6-4f18-afee-eeae36a6ce14 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:39.947454 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c7971-c2d6-4f18-afee-eeae36a6ce14 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:39.953141 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29384038-81af-48bb-a5c4-bc6bbc072a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:39.953827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29384038-81af-48bb-a5c4-bc6bbc072a38 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:39.954111 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29384038-81af-48bb-a5c4-bc6bbc072a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:39.954419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29384038-81af-48bb-a5c4-bc6bbc072a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:39.955191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29384038-81af-48bb-a5c4-bc6bbc072a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:39.956963 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29384038-81af-48bb-a5c4-bc6bbc072a38 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:39.969752 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1160/2332] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:23:39.974650 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81655c-d38a-4945-a304-7905449beedb admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:39.985008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81655c-d38a-4945-a304-7905449beedb admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:40.235140 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e60359-0199-4586-93c1-48526e679697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:40.235140 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e60359-0199-4586-93c1-48526e679697 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:40.235140 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e60359-0199-4586-93c1-48526e679697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:40.235140 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e60359-0199-4586-93c1-48526e679697 admin admin] PATH_INFO: `/v3/projects/769e22e843384edeac5e1db1563399a2/users/d4b285db8725400aa3a11af3278397f4/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:40.236592 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e60359-0199-4586-93c1-48526e679697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=769e22e843384edeac5e1db1563399a2, user_id=d4b285db8725400aa3a11af3278397f4, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:40.236592 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e60359-0199-4586-93c1-48526e679697 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:40.720870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1173/2333] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:23:39 2022] PUT /identity/v3/projects/769e22e843384edeac5e1db1563399a2/users/d4b285db8725400aa3a11af3278397f4/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:40.733956 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747444d-e6ff-488d-8c79-d8462f1f1240 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:40.734553 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747444d-e6ff-488d-8c79-d8462f1f1240 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:40.734553 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747444d-e6ff-488d-8c79-d8462f1f1240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:40.763070 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a747444d-e6ff-488d-8c79-d8462f1f1240 None None] MFA Rules not processed for user `d4b285db8725400aa3a11af3278397f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:40.764821 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a747444d-e6ff-488d-8c79-d8462f1f1240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:40.831860 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1161/2334] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:40.843419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e60359-0199-4586-93c1-48526e679697 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:40.845105 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-99e60359-0199-4586-93c1-48526e679697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:40.879610 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc68be8-73b4-4fd1-9203-6533b9db7cfb None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:40.879900 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc68be8-73b4-4fd1-9203-6533b9db7cfb None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:40.880177 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc68be8-73b4-4fd1-9203-6533b9db7cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:40.899142 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-6dc68be8-73b4-4fd1-9203-6533b9db7cfb None None] MFA Rules not processed for user `1a7181297bf14a57b3bf1f3c8b178d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:40.900651 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6dc68be8-73b4-4fd1-9203-6533b9db7cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:40.944126 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e60359-0199-4586-93c1-48526e679697 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:40.948494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139007f-3716-4643-a0cb-d9a06b1be878 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:40.949150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139007f-3716-4643-a0cb-d9a06b1be878 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:40.949438 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139007f-3716-4643-a0cb-d9a06b1be878 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:40.949739 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139007f-3716-4643-a0cb-d9a06b1be878 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:40.959850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139007f-3716-4643-a0cb-d9a06b1be878 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:40.961604 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139007f-3716-4643-a0cb-d9a06b1be878 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:40.968605 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1162/2335] 10.222.0.76 () {58 vars in 1009 bytes} [Mon May 16 15:23:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:23:40.975566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1174/2336] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:23:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:40.983853 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc68be8-73b4-4fd1-9203-6533b9db7cfb None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:40.985435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6dc68be8-73b4-4fd1-9203-6533b9db7cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:41.080034 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc68be8-73b4-4fd1-9203-6533b9db7cfb None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:41.086822 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6debd-173d-435f-9068-9e4e07054f4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33470e30760842ca9e96bb7f0cf9f07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:41.087501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6debd-173d-435f-9068-9e4e07054f4a service swift] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:41.087858 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6debd-173d-435f-9068-9e4e07054f4a service swift] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:41.088136 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6debd-173d-435f-9068-9e4e07054f4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:41.099681 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6debd-173d-435f-9068-9e4e07054f4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:41.101269 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6debd-173d-435f-9068-9e4e07054f4a service swift] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:41.110861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1163/2337] 10.222.0.76 () {60 vars in 1384 bytes} [Mon May 16 15:23:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:23:41.927670 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3ff5f-2bc8-437e-ad8b-4ead3c0c4cf1 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:41.928179 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3ff5f-2bc8-437e-ad8b-4ead3c0c4cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:41.928291 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3ff5f-2bc8-437e-ad8b-4ead3c0c4cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:41.947624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-11f3ff5f-2bc8-437e-ad8b-4ead3c0c4cf1 None None] MFA Rules not processed for user `1a7181297bf14a57b3bf1f3c8b178d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:41.948947 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-11f3ff5f-2bc8-437e-ad8b-4ead3c0c4cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:41.957554 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1175/2338] 10.222.0.76 () {58 vars in 967 bytes} [Mon May 16 15:23:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:41.971368 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6debd-173d-435f-9068-9e4e07054f4a service swift] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:41.983264 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6debd-173d-435f-9068-9e4e07054f4a service swift] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:41.989145 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33ea76-9371-4df4-920a-8c3d6a25fb79 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33470e30760842ca9e96bb7f0cf9f07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:41.989789 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33ea76-9371-4df4-920a-8c3d6a25fb79 service swift] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:41.990175 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33ea76-9371-4df4-920a-8c3d6a25fb79 service swift] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:41.990460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33ea76-9371-4df4-920a-8c3d6a25fb79 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:41.999991 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33ea76-9371-4df4-920a-8c3d6a25fb79 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:42.001756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33ea76-9371-4df4-920a-8c3d6a25fb79 service swift] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:42.010682 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1164/2339] 10.222.0.76 () {60 vars in 1384 bytes} [Mon May 16 15:23:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:23:48.216961 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3ff5f-2bc8-437e-ad8b-4ead3c0c4cf1 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:48.219531 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-11f3ff5f-2bc8-437e-ad8b-4ead3c0c4cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:48.350959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3ff5f-2bc8-437e-ad8b-4ead3c0c4cf1 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:48.356450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8da4ae-39c3-4e9b-a16f-99a5d19486b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:48.357725 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8da4ae-39c3-4e9b-a16f-99a5d19486b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:48.358292 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8da4ae-39c3-4e9b-a16f-99a5d19486b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:48.358762 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8da4ae-39c3-4e9b-a16f-99a5d19486b8 admin admin] PATH_INFO: `/v3/users/5d7434af378b4247aefbe0783cd128c0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:48.360217 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8da4ae-39c3-4e9b-a16f-99a5d19486b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d7434af378b4247aefbe0783cd128c0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:48.362536 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8da4ae-39c3-4e9b-a16f-99a5d19486b8 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:48.693003 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7b8da4ae-39c3-4e9b-a16f-99a5d19486b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d7434af378b4247aefbe0783cd128c0'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:48.706077 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7b8da4ae-39c3-4e9b-a16f-99a5d19486b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d7434af378b4247aefbe0783cd128c0'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:48.707089 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7b8da4ae-39c3-4e9b-a16f-99a5d19486b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d7434af378b4247aefbe0783cd128c0'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:48.707946 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7b8da4ae-39c3-4e9b-a16f-99a5d19486b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d7434af378b4247aefbe0783cd128c0'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:48.715181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7b8da4ae-39c3-4e9b-a16f-99a5d19486b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d7434af378b4247aefbe0783cd128c0'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:49.008596 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1176/2340] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:23:48 2022] DELETE /identity/v3/users/5d7434af378b4247aefbe0783cd128c0 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:49.017441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc59cd9-5a42-49ab-9eb6-162f8cbefdd4 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:49.017931 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc59cd9-5a42-49ab-9eb6-162f8cbefdd4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:49.018054 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc59cd9-5a42-49ab-9eb6-162f8cbefdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:49.036911 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-3cc59cd9-5a42-49ab-9eb6-162f8cbefdd4 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:49.038329 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3cc59cd9-5a42-49ab-9eb6-162f8cbefdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:49.096207 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1165/2341] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:49.106445 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8da4ae-39c3-4e9b-a16f-99a5d19486b8 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:49.107862 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7b8da4ae-39c3-4e9b-a16f-99a5d19486b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:49.163666 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8da4ae-39c3-4e9b-a16f-99a5d19486b8 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:49.167516 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168cc99-3e7e-41a0-9500-1f85be2dbaed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:49.168155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168cc99-3e7e-41a0-9500-1f85be2dbaed service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:49.169117 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168cc99-3e7e-41a0-9500-1f85be2dbaed service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:49.169523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168cc99-3e7e-41a0-9500-1f85be2dbaed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:49.178946 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168cc99-3e7e-41a0-9500-1f85be2dbaed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:49.180435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168cc99-3e7e-41a0-9500-1f85be2dbaed service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:49.190808 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1177/2342] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:23:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:49.675507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc59cd9-5a42-49ab-9eb6-162f8cbefdd4 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:49.677089 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-3cc59cd9-5a42-49ab-9eb6-162f8cbefdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:49.691900 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc59cd9-5a42-49ab-9eb6-162f8cbefdd4 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:49.697944 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9be21c-9cde-4a82-a8d1-e865cc054167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:49.699252 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9be21c-9cde-4a82-a8d1-e865cc054167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:49.700337 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9be21c-9cde-4a82-a8d1-e865cc054167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:49.700770 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9be21c-9cde-4a82-a8d1-e865cc054167 admin admin] PATH_INFO: `/v3/projects/fa49f4881c1041528d8071d3cc64a5b0` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:49.702348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9be21c-9cde-4a82-a8d1-e865cc054167 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa49f4881c1041528d8071d3cc64a5b0)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:49.704724 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9be21c-9cde-4a82-a8d1-e865cc054167 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:49.825290 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5a9be21c-9cde-4a82-a8d1-e865cc054167 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa49f4881c1041528d8071d3cc64a5b0', 'request_id': 'req-5a9be21c-9cde-4a82-a8d1-e865cc054167'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:49.936418 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5a9be21c-9cde-4a82-a8d1-e865cc054167 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa49f4881c1041528d8071d3cc64a5b0', 'request_id': 'req-5a9be21c-9cde-4a82-a8d1-e865cc054167'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:49.943510 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5a9be21c-9cde-4a82-a8d1-e865cc054167 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa49f4881c1041528d8071d3cc64a5b0', 'request_id': 'req-5a9be21c-9cde-4a82-a8d1-e865cc054167'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:49.955775 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5a9be21c-9cde-4a82-a8d1-e865cc054167 admin admin] The token cache is being invalidate because project fa49f4881c1041528d8071d3cc64a5b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:49.956068 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5a9be21c-9cde-4a82-a8d1-e865cc054167 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:49.956819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5a9be21c-9cde-4a82-a8d1-e865cc054167 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:49.958513 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1166/2343] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:23:49 2022] DELETE /identity/v3/projects/fa49f4881c1041528d8071d3cc64a5b0 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:49.964825 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84beb4e9-1b9f-4a2a-9c61-9eb36fee870d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:49.966727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84beb4e9-1b9f-4a2a-9c61-9eb36fee870d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:49.968347 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84beb4e9-1b9f-4a2a-9c61-9eb36fee870d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:49.995174 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-84beb4e9-1b9f-4a2a-9c61-9eb36fee870d None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:49.996837 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-84beb4e9-1b9f-4a2a-9c61-9eb36fee870d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:50.060887 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1178/2344] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:50.127081 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c8abc-d562-4957-ab9a-30e0a3e84c76 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:50.127736 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c8abc-d562-4957-ab9a-30e0a3e84c76 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:50.127736 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c8abc-d562-4957-ab9a-30e0a3e84c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:50.148768 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d78c8abc-d562-4957-ab9a-30e0a3e84c76 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:50.150093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d78c8abc-d562-4957-ab9a-30e0a3e84c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:50.159654 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1167/2345] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:50.164773 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84beb4e9-1b9f-4a2a-9c61-9eb36fee870d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:50.182217 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84beb4e9-1b9f-4a2a-9c61-9eb36fee870d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:50.189926 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a6713-d29d-4614-b83d-a5cf106b6b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:50.191149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a6713-d29d-4614-b83d-a5cf106b6b85 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:50.191653 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a6713-d29d-4614-b83d-a5cf106b6b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:50.192161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a6713-d29d-4614-b83d-a5cf106b6b85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:50.193543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a6713-d29d-4614-b83d-a5cf106b6b85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:23:50.194103 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a6713-d29d-4614-b83d-a5cf106b6b85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:50.197233 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a6713-d29d-4614-b83d-a5cf106b6b85 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:50.224330 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1179/2346] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:23:50.226188 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c8abc-d562-4957-ab9a-30e0a3e84c76 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:50.235918 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c8abc-d562-4957-ab9a-30e0a3e84c76 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:50.247256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a7873-4992-478f-8352-2ccafb2c219a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:50.247256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a7873-4992-478f-8352-2ccafb2c219a admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:50.247256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a7873-4992-478f-8352-2ccafb2c219a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:50.247256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a7873-4992-478f-8352-2ccafb2c219a admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:50.247904 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a7873-4992-478f-8352-2ccafb2c219a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:50.247904 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a7873-4992-478f-8352-2ccafb2c219a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:50.355218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1168/2347] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:23:50 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:50.359369 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a6713-d29d-4614-b83d-a5cf106b6b85 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:50.369299 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a6713-d29d-4614-b83d-a5cf106b6b85 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:50.427810 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ba742-df8e-47ea-ad43-1da628e80ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:50.428550 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ba742-df8e-47ea-ad43-1da628e80ecc admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:50.428775 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ba742-df8e-47ea-ad43-1da628e80ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:50.429053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ba742-df8e-47ea-ad43-1da628e80ecc admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:50.429757 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ba742-df8e-47ea-ad43-1da628e80ecc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:50.431752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ba742-df8e-47ea-ad43-1da628e80ecc admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:50.539796 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1180/2348] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:23:50 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:50.540872 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a7873-4992-478f-8352-2ccafb2c219a admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:50.551327 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a7873-4992-478f-8352-2ccafb2c219a admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:50.556432 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3980285-8aa4-4784-be32-f3692cf11a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:50.557360 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3980285-8aa4-4784-be32-f3692cf11a0f admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:50.557707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3980285-8aa4-4784-be32-f3692cf11a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:50.558046 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3980285-8aa4-4784-be32-f3692cf11a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:50.559435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3980285-8aa4-4784-be32-f3692cf11a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:50.561105 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3980285-8aa4-4784-be32-f3692cf11a0f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:50.597100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1169/2349] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:23:50.600923 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ba742-df8e-47ea-ad43-1da628e80ecc admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:50.611905 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ba742-df8e-47ea-ad43-1da628e80ecc admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:50.625895 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a956db9-72a3-467d-8aa5-f3249123beb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:50.626144 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a956db9-72a3-467d-8aa5-f3249123beb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:50.626366 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a956db9-72a3-467d-8aa5-f3249123beb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:50.626913 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a956db9-72a3-467d-8aa5-f3249123beb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:50.627338 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a956db9-72a3-467d-8aa5-f3249123beb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:50.629483 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a956db9-72a3-467d-8aa5-f3249123beb7 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:50.646191 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1181/2350] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:50.648051 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3980285-8aa4-4784-be32-f3692cf11a0f admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:50.661010 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3980285-8aa4-4784-be32-f3692cf11a0f admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:50.666617 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde0328-35d3-499d-8f19-c48c116a6ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:50.667502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde0328-35d3-499d-8f19-c48c116a6ff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:50.667781 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde0328-35d3-499d-8f19-c48c116a6ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:50.668083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde0328-35d3-499d-8f19-c48c116a6ff4 admin admin] PATH_INFO: `/v3/projects/be817fd143aa4f3b87f6cfd77666cdb7/users/5035b142903440768a5cf79d47fc0d91/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:50.684269 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde0328-35d3-499d-8f19-c48c116a6ff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be817fd143aa4f3b87f6cfd77666cdb7, user_id=5035b142903440768a5cf79d47fc0d91, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:50.686990 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde0328-35d3-499d-8f19-c48c116a6ff4 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:50.748697 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1170/2351] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:23:50 2022] PUT /identity/v3/projects/be817fd143aa4f3b87f6cfd77666cdb7/users/5035b142903440768a5cf79d47fc0d91/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:50.753664 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb162c12-6f3e-4983-add1-31e612ce8e04 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:50.759222 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb162c12-6f3e-4983-add1-31e612ce8e04 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:50.759222 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb162c12-6f3e-4983-add1-31e612ce8e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:50.774548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-cb162c12-6f3e-4983-add1-31e612ce8e04 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:50.775953 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cb162c12-6f3e-4983-add1-31e612ce8e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:50.844013 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1182/2352] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:50.854088 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde0328-35d3-499d-8f19-c48c116a6ff4 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:50.856479 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ecde0328-35d3-499d-8f19-c48c116a6ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:50.915154 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde0328-35d3-499d-8f19-c48c116a6ff4 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:50.918906 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa5c20-41e2-4a70-94d2-95bcf641cba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:50.919618 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa5c20-41e2-4a70-94d2-95bcf641cba9 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:50.919909 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa5c20-41e2-4a70-94d2-95bcf641cba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:50.920184 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa5c20-41e2-4a70-94d2-95bcf641cba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:50.929657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa5c20-41e2-4a70-94d2-95bcf641cba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:50.930992 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa5c20-41e2-4a70-94d2-95bcf641cba9 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:50.941414 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1171/2353] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:51.782999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c1f4f-e5bb-4c06-a76b-17bbf988bddc None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:51.783454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c1f4f-e5bb-4c06-a76b-17bbf988bddc None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:51.783557 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c1f4f-e5bb-4c06-a76b-17bbf988bddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:51.803222 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-619c1f4f-e5bb-4c06-a76b-17bbf988bddc None None] MFA Rules not processed for user `6c6b9438bb4245b3908664bfece4ef22`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:51.803612 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-619c1f4f-e5bb-4c06-a76b-17bbf988bddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:51.860633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1183/2354] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:58.226319 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa17de2-0f1f-4e7c-939d-c1f8439ff64f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:58.227486 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa17de2-0f1f-4e7c-939d-c1f8439ff64f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:58.227979 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa17de2-0f1f-4e7c-939d-c1f8439ff64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:58.280020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-caa17de2-0f1f-4e7c-939d-c1f8439ff64f None None] MFA Rules not processed for user `5035b142903440768a5cf79d47fc0d91`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:58.288821 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-caa17de2-0f1f-4e7c-939d-c1f8439ff64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:58.466249 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1172/2355] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:23:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:58.467176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c1f4f-e5bb-4c06-a76b-17bbf988bddc None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:58.489677 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c1f4f-e5bb-4c06-a76b-17bbf988bddc None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:58.497017 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf905ec1-06e5-4757-afde-47631d5e2861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:58.497974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf905ec1-06e5-4757-afde-47631d5e2861 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:58.498448 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf905ec1-06e5-4757-afde-47631d5e2861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:58.498913 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf905ec1-06e5-4757-afde-47631d5e2861 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:58.499815 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf905ec1-06e5-4757-afde-47631d5e2861 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:58.502773 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf905ec1-06e5-4757-afde-47631d5e2861 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:58.691501 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1184/2356] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:23:58 2022] POST /identity/v3/projects => generated 371 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:23:58.695553 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa17de2-0f1f-4e7c-939d-c1f8439ff64f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:58.710183 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa17de2-0f1f-4e7c-939d-c1f8439ff64f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:58.830938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c46bf8-d409-464f-ad5e-57d8bea21f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:58.831947 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c46bf8-d409-464f-ad5e-57d8bea21f9f admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:58.832406 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c46bf8-d409-464f-ad5e-57d8bea21f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:58.833129 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c46bf8-d409-464f-ad5e-57d8bea21f9f admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:58.834220 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c46bf8-d409-464f-ad5e-57d8bea21f9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:58.837058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c46bf8-d409-464f-ad5e-57d8bea21f9f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:59.002868 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1173/2357] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:23:58 2022] POST /identity/v3/users => generated 292 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:59.006364 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf905ec1-06e5-4757-afde-47631d5e2861 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:59.022222 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf905ec1-06e5-4757-afde-47631d5e2861 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:59.028685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96f131-6174-411e-8485-b960efabbc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:59.029798 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96f131-6174-411e-8485-b960efabbc59 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:59.030087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96f131-6174-411e-8485-b960efabbc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:59.030509 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96f131-6174-411e-8485-b960efabbc59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:59.031396 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96f131-6174-411e-8485-b960efabbc59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:59.033616 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96f131-6174-411e-8485-b960efabbc59 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:59.050236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1185/2358] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:59.054631 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c46bf8-d409-464f-ad5e-57d8bea21f9f admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:59.068646 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c46bf8-d409-464f-ad5e-57d8bea21f9f admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:59.074784 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdf3a9-fca4-4250-a62c-b2756c4f9620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:59.075931 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdf3a9-fca4-4250-a62c-b2756c4f9620 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:59.076387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdf3a9-fca4-4250-a62c-b2756c4f9620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:59.076812 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdf3a9-fca4-4250-a62c-b2756c4f9620 admin admin] PATH_INFO: `/v3/projects/a4ffac2f990d4965aeeedf414b25e35f/users/47e6b562b9124745bc836403db4ce945/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:59.100952 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cdf3a9-fca4-4250-a62c-b2756c4f9620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ffac2f990d4965aeeedf414b25e35f, user_id=47e6b562b9124745bc836403db4ce945, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:59.103970 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cdf3a9-fca4-4250-a62c-b2756c4f9620 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:59.256460 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1174/2359] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:23:59 2022] PUT /identity/v3/projects/a4ffac2f990d4965aeeedf414b25e35f/users/47e6b562b9124745bc836403db4ce945/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:23:59.260675 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96f131-6174-411e-8485-b960efabbc59 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:59.273098 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96f131-6174-411e-8485-b960efabbc59 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:59.373101 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6f1a5-158a-4113-abb8-e57ed2751b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:59.374065 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6f1a5-158a-4113-abb8-e57ed2751b8a admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:59.375046 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6f1a5-158a-4113-abb8-e57ed2751b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:59.375534 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6f1a5-158a-4113-abb8-e57ed2751b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:59.376606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6f1a5-158a-4113-abb8-e57ed2751b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:59.380535 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6f1a5-158a-4113-abb8-e57ed2751b8a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:59.400993 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1186/2360] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:59.406338 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdf3a9-fca4-4250-a62c-b2756c4f9620 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:59.419847 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdf3a9-fca4-4250-a62c-b2756c4f9620 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:59.454159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bebf3-35d1-4f1e-8b17-cec00df64ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:59.455220 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bebf3-35d1-4f1e-8b17-cec00df64ed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:59.455749 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bebf3-35d1-4f1e-8b17-cec00df64ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:59.456030 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bebf3-35d1-4f1e-8b17-cec00df64ed6 admin admin] PATH_INFO: `/v3/projects/a4ffac2f990d4965aeeedf414b25e35f/users/47e6b562b9124745bc836403db4ce945/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:59.461859 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bebf3-35d1-4f1e-8b17-cec00df64ed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ffac2f990d4965aeeedf414b25e35f, user_id=47e6b562b9124745bc836403db4ce945, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:59.467374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bebf3-35d1-4f1e-8b17-cec00df64ed6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:59.483375 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1175/2361] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:23:59 2022] PUT /identity/v3/projects/a4ffac2f990d4965aeeedf414b25e35f/users/47e6b562b9124745bc836403db4ce945/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:24:06.071259 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6f1a5-158a-4113-abb8-e57ed2751b8a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:06.073562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c7c6f1a5-158a-4113-abb8-e57ed2751b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:06.091863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6f1a5-158a-4113-abb8-e57ed2751b8a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:06.194767 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e3c7a-4258-4d0c-bded-e6cdfecb8fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:06.195935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e3c7a-4258-4d0c-bded-e6cdfecb8fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:06.196400 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e3c7a-4258-4d0c-bded-e6cdfecb8fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:06.196835 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e3c7a-4258-4d0c-bded-e6cdfecb8fa5 admin admin] PATH_INFO: `/v3/users/d4b285db8725400aa3a11af3278397f4` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:06.198454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e3c7a-4258-4d0c-bded-e6cdfecb8fa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4b285db8725400aa3a11af3278397f4)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:06.201242 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e3c7a-4258-4d0c-bded-e6cdfecb8fa5 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:06.459167 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-471e3c7a-4258-4d0c-bded-e6cdfecb8fa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b285db8725400aa3a11af3278397f4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:06.500970 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-471e3c7a-4258-4d0c-bded-e6cdfecb8fa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b285db8725400aa3a11af3278397f4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:06.508026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-471e3c7a-4258-4d0c-bded-e6cdfecb8fa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b285db8725400aa3a11af3278397f4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:06.509901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-471e3c7a-4258-4d0c-bded-e6cdfecb8fa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b285db8725400aa3a11af3278397f4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:06.530748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-471e3c7a-4258-4d0c-bded-e6cdfecb8fa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b285db8725400aa3a11af3278397f4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:06.610083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d0e16-a815-4bbc-bdb3-dddfe3568a64 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:06.610935 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d0e16-a815-4bbc-bdb3-dddfe3568a64 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:06.611231 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d0e16-a815-4bbc-bdb3-dddfe3568a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:06.634497 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1187/2362] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:24:06 2022] DELETE /identity/v3/users/d4b285db8725400aa3a11af3278397f4 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:24:06.642993 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f6b19-6022-4b9d-887e-ece5fd451ee6 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:06.642993 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f6b19-6022-4b9d-887e-ece5fd451ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:06.642993 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f6b19-6022-4b9d-887e-ece5fd451ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:06.668829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e51f6b19-6022-4b9d-887e-ece5fd451ee6 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:06.674645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e51f6b19-6022-4b9d-887e-ece5fd451ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:06.735875 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-f58d0e16-a815-4bbc-bdb3-dddfe3568a64 None None] MFA Rules not processed for user `1a7181297bf14a57b3bf1f3c8b178d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:06.741752 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f58d0e16-a815-4bbc-bdb3-dddfe3568a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:06.799200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1188/2363] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:06.842549 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f6b19-6022-4b9d-887e-ece5fd451ee6 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:06.844337 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e51f6b19-6022-4b9d-887e-ece5fd451ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:06.856734 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1176/2364] 10.222.0.76 () {58 vars in 1009 bytes} [Mon May 16 15:24:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:24:06.870310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d0e16-a815-4bbc-bdb3-dddfe3568a64 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:06.872329 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f58d0e16-a815-4bbc-bdb3-dddfe3568a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:06.946738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f6b19-6022-4b9d-887e-ece5fd451ee6 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:06.951664 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8994c-af31-4aa2-ab8e-b512c3cfcc09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:06.952548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8994c-af31-4aa2-ab8e-b512c3cfcc09 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:06.952962 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8994c-af31-4aa2-ab8e-b512c3cfcc09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:06.953249 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8994c-af31-4aa2-ab8e-b512c3cfcc09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:06.970894 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8994c-af31-4aa2-ab8e-b512c3cfcc09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:06.970894 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8994c-af31-4aa2-ab8e-b512c3cfcc09 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:06.988117 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1189/2365] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:24:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:24:07.060051 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d0e16-a815-4bbc-bdb3-dddfe3568a64 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:07.066294 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d93ed-ec50-449a-b7e5-06d7647c41a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33470e30760842ca9e96bb7f0cf9f07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:07.067608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d93ed-ec50-449a-b7e5-06d7647c41a0 service swift] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:07.067961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d93ed-ec50-449a-b7e5-06d7647c41a0 service swift] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:07.068312 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d93ed-ec50-449a-b7e5-06d7647c41a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:07.078758 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d93ed-ec50-449a-b7e5-06d7647c41a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:07.080376 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d93ed-ec50-449a-b7e5-06d7647c41a0 service swift] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:07.097347 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1177/2366] 10.222.0.76 () {60 vars in 1384 bytes} [Mon May 16 15:24:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 15:24:07.294679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab02461-b913-44ba-8b2b-085d393590a0 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:07.295165 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab02461-b913-44ba-8b2b-085d393590a0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:07.296079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab02461-b913-44ba-8b2b-085d393590a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:07.369454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-0ab02461-b913-44ba-8b2b-085d393590a0 None None] MFA Rules not processed for user `47e6b562b9124745bc836403db4ce945`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:07.369454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0ab02461-b913-44ba-8b2b-085d393590a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:07.601273 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1190/2367] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:24:07 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:24:07.751768 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d93ed-ec50-449a-b7e5-06d7647c41a0 service swift] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:07.754793 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-083d93ed-ec50-449a-b7e5-06d7647c41a0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:07.934915 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d93ed-ec50-449a-b7e5-06d7647c41a0 service swift] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:07.951172 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6cc14-d368-4d1f-9f44-a2fed2af1a92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:07.951944 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6cc14-d368-4d1f-9f44-a2fed2af1a92 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:07.952230 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6cc14-d368-4d1f-9f44-a2fed2af1a92 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:07.952505 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6cc14-d368-4d1f-9f44-a2fed2af1a92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:07.954608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1ca6cc14-d368-4d1f-9f44-a2fed2af1a92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:08.047853 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6cc14-d368-4d1f-9f44-a2fed2af1a92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:08.050663 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6cc14-d368-4d1f-9f44-a2fed2af1a92 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:08.073721 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1178/2368] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:24:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:24:08.123886 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab02461-b913-44ba-8b2b-085d393590a0 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:08.126496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0ab02461-b913-44ba-8b2b-085d393590a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:08.169435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab02461-b913-44ba-8b2b-085d393590a0 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:08.226493 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92408a81-5f1b-4183-8fed-976a73d616d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:08.226493 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92408a81-5f1b-4183-8fed-976a73d616d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:08.226493 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92408a81-5f1b-4183-8fed-976a73d616d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:08.226493 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92408a81-5f1b-4183-8fed-976a73d616d7 admin admin] PATH_INFO: `/v3/projects/769e22e843384edeac5e1db1563399a2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:08.228065 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92408a81-5f1b-4183-8fed-976a73d616d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=769e22e843384edeac5e1db1563399a2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:08.228065 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92408a81-5f1b-4183-8fed-976a73d616d7 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:08.503463 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-92408a81-5f1b-4183-8fed-976a73d616d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '769e22e843384edeac5e1db1563399a2', 'request_id': 'req-92408a81-5f1b-4183-8fed-976a73d616d7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:08.513674 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-92408a81-5f1b-4183-8fed-976a73d616d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '769e22e843384edeac5e1db1563399a2', 'request_id': 'req-92408a81-5f1b-4183-8fed-976a73d616d7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:08.522350 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6cc14-d368-4d1f-9f44-a2fed2af1a92 service nova] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:08.523878 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1ca6cc14-d368-4d1f-9f44-a2fed2af1a92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:08.542626 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6cc14-d368-4d1f-9f44-a2fed2af1a92 service nova] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:08.646994 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8950ac-be88-4ba9-b3c9-d701f817e67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:08.648230 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8950ac-be88-4ba9-b3c9-d701f817e67f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:08.648825 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8950ac-be88-4ba9-b3c9-d701f817e67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:08.648825 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8950ac-be88-4ba9-b3c9-d701f817e67f admin admin] PATH_INFO: `/v3/users/22a49508f9944ec19ea90767ffdcf7f3` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:08.650332 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8950ac-be88-4ba9-b3c9-d701f817e67f admin admin] RBAC: Authorizing `identity:delete_user(user_id=22a49508f9944ec19ea90767ffdcf7f3)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:08.652843 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8950ac-be88-4ba9-b3c9-d701f817e67f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:08.821588 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-92408a81-5f1b-4183-8fed-976a73d616d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '769e22e843384edeac5e1db1563399a2', 'request_id': 'req-92408a81-5f1b-4183-8fed-976a73d616d7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:08.836348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-92408a81-5f1b-4183-8fed-976a73d616d7 admin admin] The token cache is being invalidate because project 769e22e843384edeac5e1db1563399a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:24:08.836645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-92408a81-5f1b-4183-8fed-976a73d616d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:08.837341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-92408a81-5f1b-4183-8fed-976a73d616d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:08.839262 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1191/2369] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:24:08 2022] DELETE /identity/v3/projects/769e22e843384edeac5e1db1563399a2 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:24:09.045397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1a8950ac-be88-4ba9-b3c9-d701f817e67f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22a49508f9944ec19ea90767ffdcf7f3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:09.187294 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1a8950ac-be88-4ba9-b3c9-d701f817e67f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22a49508f9944ec19ea90767ffdcf7f3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:09.193614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1a8950ac-be88-4ba9-b3c9-d701f817e67f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22a49508f9944ec19ea90767ffdcf7f3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:09.223389 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1a8950ac-be88-4ba9-b3c9-d701f817e67f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22a49508f9944ec19ea90767ffdcf7f3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:09.226242 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1a8950ac-be88-4ba9-b3c9-d701f817e67f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22a49508f9944ec19ea90767ffdcf7f3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:09.254270 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1179/2370] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:24:08 2022] DELETE /identity/v3/users/22a49508f9944ec19ea90767ffdcf7f3 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:24:09.267523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8c5e6-74af-4804-b034-a4fa2b9f1ad4 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:09.267967 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8c5e6-74af-4804-b034-a4fa2b9f1ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:09.268265 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8c5e6-74af-4804-b034-a4fa2b9f1ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:09.303607 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ead8c5e6-74af-4804-b034-a4fa2b9f1ad4 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:09.305526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ead8c5e6-74af-4804-b034-a4fa2b9f1ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:09.474249 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1192/2371] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:09.486374 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8950ac-be88-4ba9-b3c9-d701f817e67f admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:09.487837 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1a8950ac-be88-4ba9-b3c9-d701f817e67f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:09.619254 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8950ac-be88-4ba9-b3c9-d701f817e67f admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:09.628141 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac72662-1409-42bf-a8df-df36f37e7c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:09.628899 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac72662-1409-42bf-a8df-df36f37e7c9a service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:09.629251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac72662-1409-42bf-a8df-df36f37e7c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:09.630504 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac72662-1409-42bf-a8df-df36f37e7c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:09.654366 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac72662-1409-42bf-a8df-df36f37e7c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:09.656425 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac72662-1409-42bf-a8df-df36f37e7c9a service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:09.670534 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1180/2372] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:24:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:24:10.277683 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8c5e6-74af-4804-b034-a4fa2b9f1ad4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:10.279502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ead8c5e6-74af-4804-b034-a4fa2b9f1ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:10.298712 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8c5e6-74af-4804-b034-a4fa2b9f1ad4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:10.304890 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd093e4-69db-4b8e-b0bb-efb601399341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:10.306675 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd093e4-69db-4b8e-b0bb-efb601399341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:10.307309 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd093e4-69db-4b8e-b0bb-efb601399341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:10.307745 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd093e4-69db-4b8e-b0bb-efb601399341 admin admin] PATH_INFO: `/v3/projects/b4d2c90c8cf1430baa5f70b93176aafa` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:10.309327 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd093e4-69db-4b8e-b0bb-efb601399341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4d2c90c8cf1430baa5f70b93176aafa)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:10.311656 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd093e4-69db-4b8e-b0bb-efb601399341 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:10.501261 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5cd093e4-69db-4b8e-b0bb-efb601399341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4d2c90c8cf1430baa5f70b93176aafa', 'request_id': 'req-5cd093e4-69db-4b8e-b0bb-efb601399341'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:10.512964 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5cd093e4-69db-4b8e-b0bb-efb601399341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4d2c90c8cf1430baa5f70b93176aafa', 'request_id': 'req-5cd093e4-69db-4b8e-b0bb-efb601399341'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:10.650512 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5cd093e4-69db-4b8e-b0bb-efb601399341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4d2c90c8cf1430baa5f70b93176aafa', 'request_id': 'req-5cd093e4-69db-4b8e-b0bb-efb601399341'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:10.670611 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5cd093e4-69db-4b8e-b0bb-efb601399341 admin admin] The token cache is being invalidate because project b4d2c90c8cf1430baa5f70b93176aafa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:24:10.670910 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5cd093e4-69db-4b8e-b0bb-efb601399341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:10.671650 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5cd093e4-69db-4b8e-b0bb-efb601399341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:10.673453 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1193/2373] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:24:10 2022] DELETE /identity/v3/projects/b4d2c90c8cf1430baa5f70b93176aafa => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:24:10.678833 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b55e12-d669-4acf-aa0c-9050f06616cd None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:10.679875 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b55e12-d669-4acf-aa0c-9050f06616cd None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:10.680452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b55e12-d669-4acf-aa0c-9050f06616cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:10.703168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-74b55e12-d669-4acf-aa0c-9050f06616cd None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:10.704721 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-74b55e12-d669-4acf-aa0c-9050f06616cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:10.783095 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1181/2374] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:10.792018 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a788aea-0183-45a8-bde4-bbcf26f1c018 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:10.792295 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a788aea-0183-45a8-bde4-bbcf26f1c018 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:10.792574 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a788aea-0183-45a8-bde4-bbcf26f1c018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:10.828876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7a788aea-0183-45a8-bde4-bbcf26f1c018 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:10.830529 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7a788aea-0183-45a8-bde4-bbcf26f1c018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:10.839667 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1194/2375] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:10.843544 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b55e12-d669-4acf-aa0c-9050f06616cd None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:10.854079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b55e12-d669-4acf-aa0c-9050f06616cd None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:10.866063 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda712b5-7fff-405b-9573-ce32699fd498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:10.866893 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda712b5-7fff-405b-9573-ce32699fd498 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:10.867281 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda712b5-7fff-405b-9573-ce32699fd498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:10.868005 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda712b5-7fff-405b-9573-ce32699fd498 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:10.868529 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda712b5-7fff-405b-9573-ce32699fd498 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:24:10.869324 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda712b5-7fff-405b-9573-ce32699fd498 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:10.871662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda712b5-7fff-405b-9573-ce32699fd498 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:10.893360 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1182/2376] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:24:10.894784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a788aea-0183-45a8-bde4-bbcf26f1c018 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:10.909428 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a788aea-0183-45a8-bde4-bbcf26f1c018 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:10.928327 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e9dea-ca2e-41c3-afb4-1ff717703d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:10.929725 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e9dea-ca2e-41c3-afb4-1ff717703d69 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:10.930207 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e9dea-ca2e-41c3-afb4-1ff717703d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:10.930650 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e9dea-ca2e-41c3-afb4-1ff717703d69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:10.931516 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e9dea-ca2e-41c3-afb4-1ff717703d69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:10.937211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e9dea-ca2e-41c3-afb4-1ff717703d69 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:11.119197 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1195/2377] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:24:10 2022] POST /identity/v3/projects => generated 385 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:24:11.124249 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda712b5-7fff-405b-9573-ce32699fd498 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:11.137301 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda712b5-7fff-405b-9573-ce32699fd498 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:11.258959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993675bc-61cf-4ec7-a8e5-e66b69e500d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:11.260722 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993675bc-61cf-4ec7-a8e5-e66b69e500d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:11.261866 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993675bc-61cf-4ec7-a8e5-e66b69e500d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:11.262473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993675bc-61cf-4ec7-a8e5-e66b69e500d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:11.263417 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993675bc-61cf-4ec7-a8e5-e66b69e500d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:11.265642 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993675bc-61cf-4ec7-a8e5-e66b69e500d1 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:11.451343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1183/2378] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:24:11 2022] POST /identity/v3/users => generated 293 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:24:11.451500 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e9dea-ca2e-41c3-afb4-1ff717703d69 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:11.465638 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e9dea-ca2e-41c3-afb4-1ff717703d69 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:11.478538 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e28f4-a62b-4f96-b413-6961fdaea4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:11.479492 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e28f4-a62b-4f96-b413-6961fdaea4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:11.479984 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e28f4-a62b-4f96-b413-6961fdaea4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:11.482666 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e28f4-a62b-4f96-b413-6961fdaea4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:11.487271 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e28f4-a62b-4f96-b413-6961fdaea4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:11.487271 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e28f4-a62b-4f96-b413-6961fdaea4f5 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:11.516184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1196/2379] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:24:11.520779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993675bc-61cf-4ec7-a8e5-e66b69e500d1 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:11.554506 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993675bc-61cf-4ec7-a8e5-e66b69e500d1 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:11.581463 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9931ace-bd1c-419c-9c34-9499d0bb3c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:11.671788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9931ace-bd1c-419c-9c34-9499d0bb3c26 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:11.672077 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9931ace-bd1c-419c-9c34-9499d0bb3c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:11.672357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9931ace-bd1c-419c-9c34-9499d0bb3c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:11.679062 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9931ace-bd1c-419c-9c34-9499d0bb3c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:11.687888 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9931ace-bd1c-419c-9c34-9499d0bb3c26 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:11.744359 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1184/2380] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:24:11.751762 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e28f4-a62b-4f96-b413-6961fdaea4f5 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:11.773633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e28f4-a62b-4f96-b413-6961fdaea4f5 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:11.799546 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760e806-dc46-4a55-8df3-a80fc8fdac34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:11.800971 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760e806-dc46-4a55-8df3-a80fc8fdac34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:11.801471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760e806-dc46-4a55-8df3-a80fc8fdac34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:11.802104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760e806-dc46-4a55-8df3-a80fc8fdac34 admin admin] PATH_INFO: `/v3/projects/65e5f9f015814278b1062e2d7d681cc5/users/816ac740698548b1b25826fe5168a62a/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:11.862275 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760e806-dc46-4a55-8df3-a80fc8fdac34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e5f9f015814278b1062e2d7d681cc5, user_id=816ac740698548b1b25826fe5168a62a, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:11.862275 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760e806-dc46-4a55-8df3-a80fc8fdac34 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:12.319197 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1197/2381] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:24:11 2022] PUT /identity/v3/projects/65e5f9f015814278b1062e2d7d681cc5/users/816ac740698548b1b25826fe5168a62a/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:24:12.324883 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b863712-8558-47c3-8b4a-7baa393d0ff1 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:12.325502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b863712-8558-47c3-8b4a-7baa393d0ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:12.325996 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b863712-8558-47c3-8b4a-7baa393d0ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:12.347759 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5b863712-8558-47c3-8b4a-7baa393d0ff1 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:12.349735 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5b863712-8558-47c3-8b4a-7baa393d0ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:12.430934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1185/2382] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:12.442551 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760e806-dc46-4a55-8df3-a80fc8fdac34 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:12.444606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5760e806-dc46-4a55-8df3-a80fc8fdac34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:12.592760 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760e806-dc46-4a55-8df3-a80fc8fdac34 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:12.607108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf02e3d-7cea-4a80-8a10-4087151bb834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:12.608269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf02e3d-7cea-4a80-8a10-4087151bb834 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:12.616288 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf02e3d-7cea-4a80-8a10-4087151bb834 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:12.616848 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf02e3d-7cea-4a80-8a10-4087151bb834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:12.634272 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf02e3d-7cea-4a80-8a10-4087151bb834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:12.636046 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf02e3d-7cea-4a80-8a10-4087151bb834 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:12.654521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1198/2383] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:24:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:24:12.868823 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f571f09-fcb6-44b3-b708-ac60732736e6 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:12.869363 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f571f09-fcb6-44b3-b708-ac60732736e6 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:12.869363 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f571f09-fcb6-44b3-b708-ac60732736e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:12.910709 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5f571f09-fcb6-44b3-b708-ac60732736e6 None None] MFA Rules not processed for user `5035b142903440768a5cf79d47fc0d91`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:12.911923 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5f571f09-fcb6-44b3-b708-ac60732736e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:13.016018 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1186/2384] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:24:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:21.945267 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c3eb5-3bd8-4d15-b801-57a329934d32 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:21.945838 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c3eb5-3bd8-4d15-b801-57a329934d32 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:21.946035 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c3eb5-3bd8-4d15-b801-57a329934d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:22.033513 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-740c3eb5-3bd8-4d15-b801-57a329934d32 None None] MFA Rules not processed for user `816ac740698548b1b25826fe5168a62a`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:22.033513 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-740c3eb5-3bd8-4d15-b801-57a329934d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:22.033696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f571f09-fcb6-44b3-b708-ac60732736e6 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:22.033696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5f571f09-fcb6-44b3-b708-ac60732736e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:22.067827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f571f09-fcb6-44b3-b708-ac60732736e6 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:22.067827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385c087-beee-491a-b14f-8867e865279f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:22.067827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385c087-beee-491a-b14f-8867e865279f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:22.067827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385c087-beee-491a-b14f-8867e865279f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:22.068189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385c087-beee-491a-b14f-8867e865279f admin admin] PATH_INFO: `/v3/users/b7370eb42af64643be0fd7d24aa00acb` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:22.068189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385c087-beee-491a-b14f-8867e865279f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7370eb42af64643be0fd7d24aa00acb)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:22.068189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385c087-beee-491a-b14f-8867e865279f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:22.068438 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1199/2385] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:24:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:22.072836 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c3eb5-3bd8-4d15-b801-57a329934d32 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:22.085855 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c3eb5-3bd8-4d15-b801-57a329934d32 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:22.093527 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272508e-93c2-4ef1-90e3-5ba9aabf142a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:22.094246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272508e-93c2-4ef1-90e3-5ba9aabf142a admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:22.094533 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272508e-93c2-4ef1-90e3-5ba9aabf142a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:22.094808 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272508e-93c2-4ef1-90e3-5ba9aabf142a admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:22.095522 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272508e-93c2-4ef1-90e3-5ba9aabf142a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:22.097448 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272508e-93c2-4ef1-90e3-5ba9aabf142a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:22.679616 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1200/2386] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:24:22 2022] POST /identity/v3/projects => generated 385 bytes in 609 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:24:22.684270 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272508e-93c2-4ef1-90e3-5ba9aabf142a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:22.751012 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272508e-93c2-4ef1-90e3-5ba9aabf142a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:22.756492 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45373215-4929-41d8-a806-9c87452f3927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:22.757266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45373215-4929-41d8-a806-9c87452f3927 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:22.757465 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45373215-4929-41d8-a806-9c87452f3927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:22.757741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45373215-4929-41d8-a806-9c87452f3927 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:22.758484 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45373215-4929-41d8-a806-9c87452f3927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:22.761259 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45373215-4929-41d8-a806-9c87452f3927 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:22.773306 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0385c087-beee-491a-b14f-8867e865279f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7370eb42af64643be0fd7d24aa00acb'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:22.877634 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0385c087-beee-491a-b14f-8867e865279f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7370eb42af64643be0fd7d24aa00acb'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:22.878559 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0385c087-beee-491a-b14f-8867e865279f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7370eb42af64643be0fd7d24aa00acb'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:22.903616 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0385c087-beee-491a-b14f-8867e865279f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7370eb42af64643be0fd7d24aa00acb'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:22.904465 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-0385c087-beee-491a-b14f-8867e865279f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7370eb42af64643be0fd7d24aa00acb'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:22.921907 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1187/2387] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:24:22 2022] DELETE /identity/v3/users/b7370eb42af64643be0fd7d24aa00acb => generated 0 bytes in 903 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:24:22.922503 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1201/2388] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:24:22 2022] POST /identity/v3/users => generated 299 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:24:22.923747 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45373215-4929-41d8-a806-9c87452f3927 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:22.924150 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc38be-f3a8-4239-b995-2dd8614ecf93 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:22.924584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc38be-f3a8-4239-b995-2dd8614ecf93 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:22.924939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc38be-f3a8-4239-b995-2dd8614ecf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:22.925667 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-45373215-4929-41d8-a806-9c87452f3927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:22.940759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45373215-4929-41d8-a806-9c87452f3927 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:22.947133 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a7fc38be-f3a8-4239-b995-2dd8614ecf93 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:22.950906 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a7fc38be-f3a8-4239-b995-2dd8614ecf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:23.013232 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dae04e-9b15-495c-a13f-16772c5fb697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:23.014016 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dae04e-9b15-495c-a13f-16772c5fb697 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:23.014408 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dae04e-9b15-495c-a13f-16772c5fb697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:23.014758 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dae04e-9b15-495c-a13f-16772c5fb697 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:23.015718 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dae04e-9b15-495c-a13f-16772c5fb697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:23.017784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dae04e-9b15-495c-a13f-16772c5fb697 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:23.038200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1202/2389] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:24:23.043540 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1188/2390] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:23.051655 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dae04e-9b15-495c-a13f-16772c5fb697 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:23.054056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc38be-f3a8-4239-b995-2dd8614ecf93 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:23.056644 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a7fc38be-f3a8-4239-b995-2dd8614ecf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:23.065585 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dae04e-9b15-495c-a13f-16772c5fb697 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:23.070977 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4570c3-ec3f-4303-9fe9-b2d7ea627904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:23.071875 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4570c3-ec3f-4303-9fe9-b2d7ea627904 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:23.072152 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4570c3-ec3f-4303-9fe9-b2d7ea627904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:23.072422 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4570c3-ec3f-4303-9fe9-b2d7ea627904 admin admin] PATH_INFO: `/v3/projects/4d86728a09154cb2917f313ed9bf8478/users/13195494ed564e0594dbffebf6b81d46/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:23.099099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4570c3-ec3f-4303-9fe9-b2d7ea627904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d86728a09154cb2917f313ed9bf8478, user_id=13195494ed564e0594dbffebf6b81d46, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:23.102008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4570c3-ec3f-4303-9fe9-b2d7ea627904 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:23.141683 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc38be-f3a8-4239-b995-2dd8614ecf93 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:23.145879 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd87130-9114-41fc-9767-ff37ee5bf30f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:23.146582 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd87130-9114-41fc-9767-ff37ee5bf30f service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:23.146868 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd87130-9114-41fc-9767-ff37ee5bf30f service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:23.147180 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd87130-9114-41fc-9767-ff37ee5bf30f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:23.160682 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd87130-9114-41fc-9767-ff37ee5bf30f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:23.162780 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd87130-9114-41fc-9767-ff37ee5bf30f service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:23.174515 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1189/2391] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:24:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:24:23.190192 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1203/2392] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:24:23 2022] PUT /identity/v3/projects/4d86728a09154cb2917f313ed9bf8478/users/13195494ed564e0594dbffebf6b81d46/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:24:23.193176 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd87130-9114-41fc-9767-ff37ee5bf30f service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:23.206643 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd87130-9114-41fc-9767-ff37ee5bf30f service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:23.310747 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d01ae-ef48-4478-ab79-0ae7515be2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:23.311428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d01ae-ef48-4478-ab79-0ae7515be2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:23.311708 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d01ae-ef48-4478-ab79-0ae7515be2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:23.312009 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d01ae-ef48-4478-ab79-0ae7515be2a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:23.312835 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d01ae-ef48-4478-ab79-0ae7515be2a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:23.323616 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d01ae-ef48-4478-ab79-0ae7515be2a4 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:23.330213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1190/2393] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:24:23.333803 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4570c3-ec3f-4303-9fe9-b2d7ea627904 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:23.345029 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4570c3-ec3f-4303-9fe9-b2d7ea627904 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:23.369259 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081eb815-8b18-4c7e-b011-17039d9d1eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:23.370673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081eb815-8b18-4c7e-b011-17039d9d1eae admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:23.370827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081eb815-8b18-4c7e-b011-17039d9d1eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:23.371105 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081eb815-8b18-4c7e-b011-17039d9d1eae admin admin] PATH_INFO: `/v3/projects/4d86728a09154cb2917f313ed9bf8478/users/13195494ed564e0594dbffebf6b81d46/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:23.375953 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081eb815-8b18-4c7e-b011-17039d9d1eae admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d86728a09154cb2917f313ed9bf8478, user_id=13195494ed564e0594dbffebf6b81d46, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:23.379049 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081eb815-8b18-4c7e-b011-17039d9d1eae admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:23.393074 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1204/2394] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:24:23 2022] PUT /identity/v3/projects/4d86728a09154cb2917f313ed9bf8478/users/13195494ed564e0594dbffebf6b81d46/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:24:23.845666 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d01ae-ef48-4478-ab79-0ae7515be2a4 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:23.848103 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-377d01ae-ef48-4478-ab79-0ae7515be2a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:23.864418 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d01ae-ef48-4478-ab79-0ae7515be2a4 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:23.976537 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c0bee-e46e-4c5b-8117-51ca7fc9edac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:23.978218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c0bee-e46e-4c5b-8117-51ca7fc9edac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:23.978512 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c0bee-e46e-4c5b-8117-51ca7fc9edac admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:23.978794 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c0bee-e46e-4c5b-8117-51ca7fc9edac admin admin] PATH_INFO: `/v3/projects/8ebc66658eab476fa02f568813e1d1d5` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:23.980684 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c0bee-e46e-4c5b-8117-51ca7fc9edac admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ebc66658eab476fa02f568813e1d1d5)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:23.982671 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c0bee-e46e-4c5b-8117-51ca7fc9edac admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:24.167920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-da8c0bee-e46e-4c5b-8117-51ca7fc9edac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ebc66658eab476fa02f568813e1d1d5', 'request_id': 'req-da8c0bee-e46e-4c5b-8117-51ca7fc9edac'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:24.284227 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-da8c0bee-e46e-4c5b-8117-51ca7fc9edac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ebc66658eab476fa02f568813e1d1d5', 'request_id': 'req-da8c0bee-e46e-4c5b-8117-51ca7fc9edac'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:24.291458 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-da8c0bee-e46e-4c5b-8117-51ca7fc9edac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ebc66658eab476fa02f568813e1d1d5', 'request_id': 'req-da8c0bee-e46e-4c5b-8117-51ca7fc9edac'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:24.301683 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-da8c0bee-e46e-4c5b-8117-51ca7fc9edac admin admin] The token cache is being invalidate because project 8ebc66658eab476fa02f568813e1d1d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:24:24.301973 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-da8c0bee-e46e-4c5b-8117-51ca7fc9edac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:24.302645 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-da8c0bee-e46e-4c5b-8117-51ca7fc9edac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:24.304313 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1191/2395] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:24:23 2022] DELETE /identity/v3/projects/8ebc66658eab476fa02f568813e1d1d5 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:24:24.309568 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909d83d-a8c6-4608-a5ab-c347891e7896 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:24.310033 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909d83d-a8c6-4608-a5ab-c347891e7896 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:24.310205 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909d83d-a8c6-4608-a5ab-c347891e7896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:24.329219 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-3909d83d-a8c6-4608-a5ab-c347891e7896 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:24.330730 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3909d83d-a8c6-4608-a5ab-c347891e7896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:24.406767 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1205/2396] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:24.415091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630009c-6719-4c07-ad41-a7079a8856a8 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:24.415688 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630009c-6719-4c07-ad41-a7079a8856a8 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:24.416208 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630009c-6719-4c07-ad41-a7079a8856a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:24.436516 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-4630009c-6719-4c07-ad41-a7079a8856a8 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:24.438017 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4630009c-6719-4c07-ad41-a7079a8856a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:24.446495 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1192/2397] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:24.451353 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909d83d-a8c6-4608-a5ab-c347891e7896 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:24.461604 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909d83d-a8c6-4608-a5ab-c347891e7896 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:24.467140 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaeb04b-e5c0-4022-972e-2b709ae2e440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:24.467885 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaeb04b-e5c0-4022-972e-2b709ae2e440 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:24.468175 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaeb04b-e5c0-4022-972e-2b709ae2e440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:24.468454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaeb04b-e5c0-4022-972e-2b709ae2e440 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:24.469265 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaeb04b-e5c0-4022-972e-2b709ae2e440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:24:24.469577 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaeb04b-e5c0-4022-972e-2b709ae2e440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:24.471611 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaeb04b-e5c0-4022-972e-2b709ae2e440 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:24.485083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1206/2398] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:24:24.489210 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630009c-6719-4c07-ad41-a7079a8856a8 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:24.502204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630009c-6719-4c07-ad41-a7079a8856a8 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:24.507169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c0175-8bb2-4d48-9906-91e5e18af6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:24.508060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c0175-8bb2-4d48-9906-91e5e18af6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:24.509853 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c0175-8bb2-4d48-9906-91e5e18af6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:24.509853 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c0175-8bb2-4d48-9906-91e5e18af6a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:24.509853 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c0175-8bb2-4d48-9906-91e5e18af6a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:24.511719 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c0175-8bb2-4d48-9906-91e5e18af6a2 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:24.647347 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1193/2399] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:24:24 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:24:24.651902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaeb04b-e5c0-4022-972e-2b709ae2e440 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:24.662559 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaeb04b-e5c0-4022-972e-2b709ae2e440 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:24.737028 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae96dc-1ef8-48c1-9e23-721074176e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:24.737890 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae96dc-1ef8-48c1-9e23-721074176e62 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:24.738317 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae96dc-1ef8-48c1-9e23-721074176e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:24.738609 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae96dc-1ef8-48c1-9e23-721074176e62 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:24.739739 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae96dc-1ef8-48c1-9e23-721074176e62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:24.741912 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae96dc-1ef8-48c1-9e23-721074176e62 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:24.862325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1207/2400] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:24:24 2022] POST /identity/v3/users => generated 286 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:24:24.866524 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c0175-8bb2-4d48-9906-91e5e18af6a2 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:24.878078 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c0175-8bb2-4d48-9906-91e5e18af6a2 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:24.890608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a5c63-bb62-4de8-a7f5-a7d5d2f17b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:24.891307 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a5c63-bb62-4de8-a7f5-a7d5d2f17b92 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:24.891589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a5c63-bb62-4de8-a7f5-a7d5d2f17b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:24.892022 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a5c63-bb62-4de8-a7f5-a7d5d2f17b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:24.892851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a5c63-bb62-4de8-a7f5-a7d5d2f17b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:24.894501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a5c63-bb62-4de8-a7f5-a7d5d2f17b92 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:24.913450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1194/2401] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:24:24.914574 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae96dc-1ef8-48c1-9e23-721074176e62 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:24.928905 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae96dc-1ef8-48c1-9e23-721074176e62 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:24.934176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591212d-4dc2-41b8-af5b-b6b9b1d75e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:24.934859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591212d-4dc2-41b8-af5b-b6b9b1d75e7b admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:24.935144 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591212d-4dc2-41b8-af5b-b6b9b1d75e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:24.935425 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591212d-4dc2-41b8-af5b-b6b9b1d75e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:24.936169 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591212d-4dc2-41b8-af5b-b6b9b1d75e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:24.937824 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591212d-4dc2-41b8-af5b-b6b9b1d75e7b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:24.959099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1208/2402] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:24:24.962004 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a5c63-bb62-4de8-a7f5-a7d5d2f17b92 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:24.984120 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a5c63-bb62-4de8-a7f5-a7d5d2f17b92 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:24.988963 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fa686-1999-44c5-a040-bbb3f61f2214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:24.990030 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fa686-1999-44c5-a040-bbb3f61f2214 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:24.990357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fa686-1999-44c5-a040-bbb3f61f2214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:24.990646 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fa686-1999-44c5-a040-bbb3f61f2214 admin admin] PATH_INFO: `/v3/projects/cb6f25e39df54ea3aa6bbe4cc95ac235/users/16f2d6848cb74f02be2ba312cf456770/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:25.016336 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fa686-1999-44c5-a040-bbb3f61f2214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb6f25e39df54ea3aa6bbe4cc95ac235, user_id=16f2d6848cb74f02be2ba312cf456770, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:25.025189 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fa686-1999-44c5-a040-bbb3f61f2214 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:25.132039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1195/2403] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:24:24 2022] PUT /identity/v3/projects/cb6f25e39df54ea3aa6bbe4cc95ac235/users/16f2d6848cb74f02be2ba312cf456770/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:24:25.143035 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbdee0-b031-4280-acb3-b9c52f5864fc None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:25.149112 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbdee0-b031-4280-acb3-b9c52f5864fc None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:25.149112 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbdee0-b031-4280-acb3-b9c52f5864fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:25.199148 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-90dbdee0-b031-4280-acb3-b9c52f5864fc None None] MFA Rules not processed for user `16f2d6848cb74f02be2ba312cf456770`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:25.200331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-90dbdee0-b031-4280-acb3-b9c52f5864fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:25.313723 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1209/2404] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:24:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:25.326380 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fa686-1999-44c5-a040-bbb3f61f2214 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:25.328191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-957fa686-1999-44c5-a040-bbb3f61f2214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:25.413050 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fa686-1999-44c5-a040-bbb3f61f2214 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:25.417401 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67262ef-0ef4-4ad6-9532-1e9350b25a70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:25.417964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67262ef-0ef4-4ad6-9532-1e9350b25a70 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:25.418281 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67262ef-0ef4-4ad6-9532-1e9350b25a70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:25.418564 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67262ef-0ef4-4ad6-9532-1e9350b25a70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:25.427094 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67262ef-0ef4-4ad6-9532-1e9350b25a70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:25.428630 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67262ef-0ef4-4ad6-9532-1e9350b25a70 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:25.446264 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1196/2405] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:24:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:24:25.463905 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbdee0-b031-4280-acb3-b9c52f5864fc None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:25.529647 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbdee0-b031-4280-acb3-b9c52f5864fc None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:25.534278 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50bd8d-b5c9-4796-a4dd-bc49095a1f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:25.535146 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50bd8d-b5c9-4796-a4dd-bc49095a1f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:25.535425 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50bd8d-b5c9-4796-a4dd-bc49095a1f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:25.535695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50bd8d-b5c9-4796-a4dd-bc49095a1f4d admin admin] PATH_INFO: `/v3/users/16f2d6848cb74f02be2ba312cf456770` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:25.536916 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50bd8d-b5c9-4796-a4dd-bc49095a1f4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=16f2d6848cb74f02be2ba312cf456770)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:25.539140 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50bd8d-b5c9-4796-a4dd-bc49095a1f4d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:25.824712 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7f50bd8d-b5c9-4796-a4dd-bc49095a1f4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16f2d6848cb74f02be2ba312cf456770'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:25.839923 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7f50bd8d-b5c9-4796-a4dd-bc49095a1f4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16f2d6848cb74f02be2ba312cf456770'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:25.840749 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7f50bd8d-b5c9-4796-a4dd-bc49095a1f4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16f2d6848cb74f02be2ba312cf456770'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:25.841422 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7f50bd8d-b5c9-4796-a4dd-bc49095a1f4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16f2d6848cb74f02be2ba312cf456770'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:25.849474 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7f50bd8d-b5c9-4796-a4dd-bc49095a1f4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16f2d6848cb74f02be2ba312cf456770'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:25.986708 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd8f6e-17f1-4160-94f7-a858ff988ee0 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:25.987001 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd8f6e-17f1-4160-94f7-a858ff988ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:25.987281 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd8f6e-17f1-4160-94f7-a858ff988ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:25.990937 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1210/2406] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:24:25 2022] DELETE /identity/v3/users/16f2d6848cb74f02be2ba312cf456770 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:24:26.024925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-42bd8f6e-17f1-4160-94f7-a858ff988ee0 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:26.031881 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-42bd8f6e-17f1-4160-94f7-a858ff988ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:26.193284 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1197/2407] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:26.206818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50bd8d-b5c9-4796-a4dd-bc49095a1f4d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:26.208432 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7f50bd8d-b5c9-4796-a4dd-bc49095a1f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:26.321776 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50bd8d-b5c9-4796-a4dd-bc49095a1f4d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:26.335043 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7f18f-2139-41d0-8596-e4346b154519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:26.336171 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7f18f-2139-41d0-8596-e4346b154519 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:26.337186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7f18f-2139-41d0-8596-e4346b154519 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:26.337692 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7f18f-2139-41d0-8596-e4346b154519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:26.351266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7f18f-2139-41d0-8596-e4346b154519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:26.353373 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7f18f-2139-41d0-8596-e4346b154519 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:26.371432 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1211/2408] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:24:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:24:26.910929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd8f6e-17f1-4160-94f7-a858ff988ee0 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:26.919884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-42bd8f6e-17f1-4160-94f7-a858ff988ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:26.937777 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd8f6e-17f1-4160-94f7-a858ff988ee0 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:26.950706 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d71364-9d83-4ed2-b432-d6ae89051f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:26.951615 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d71364-9d83-4ed2-b432-d6ae89051f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:26.956581 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d71364-9d83-4ed2-b432-d6ae89051f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:26.956581 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d71364-9d83-4ed2-b432-d6ae89051f70 admin admin] PATH_INFO: `/v3/projects/cb6f25e39df54ea3aa6bbe4cc95ac235` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:26.956581 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d71364-9d83-4ed2-b432-d6ae89051f70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb6f25e39df54ea3aa6bbe4cc95ac235)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:26.956581 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d71364-9d83-4ed2-b432-d6ae89051f70 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:27.082441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a6d71364-9d83-4ed2-b432-d6ae89051f70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb6f25e39df54ea3aa6bbe4cc95ac235', 'request_id': 'req-a6d71364-9d83-4ed2-b432-d6ae89051f70'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:27.170083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a6d71364-9d83-4ed2-b432-d6ae89051f70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb6f25e39df54ea3aa6bbe4cc95ac235', 'request_id': 'req-a6d71364-9d83-4ed2-b432-d6ae89051f70'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:27.177391 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a6d71364-9d83-4ed2-b432-d6ae89051f70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb6f25e39df54ea3aa6bbe4cc95ac235', 'request_id': 'req-a6d71364-9d83-4ed2-b432-d6ae89051f70'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:27.190274 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a6d71364-9d83-4ed2-b432-d6ae89051f70 admin admin] The token cache is being invalidate because project cb6f25e39df54ea3aa6bbe4cc95ac235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:24:27.190647 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a6d71364-9d83-4ed2-b432-d6ae89051f70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:27.193125 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a6d71364-9d83-4ed2-b432-d6ae89051f70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:27.195314 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1198/2409] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:24:26 2022] DELETE /identity/v3/projects/cb6f25e39df54ea3aa6bbe4cc95ac235 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:24:27.201430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad846f50-2aae-4c54-a001-2936cbcc5a0b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:27.201891 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad846f50-2aae-4c54-a001-2936cbcc5a0b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:27.202340 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad846f50-2aae-4c54-a001-2936cbcc5a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:27.231652 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ad846f50-2aae-4c54-a001-2936cbcc5a0b None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:27.232889 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ad846f50-2aae-4c54-a001-2936cbcc5a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:27.296803 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d71364-9d83-4ed2-b432-d6ae89051f70 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:27.298238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a6d71364-9d83-4ed2-b432-d6ae89051f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:27.305445 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1212/2410] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:27.313606 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a9604-c875-4444-b75b-9d3af543ec5a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:27.314553 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a9604-c875-4444-b75b-9d3af543ec5a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:27.314948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a9604-c875-4444-b75b-9d3af543ec5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:27.336456 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-326a9604-c875-4444-b75b-9d3af543ec5a None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:27.471007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-326a9604-c875-4444-b75b-9d3af543ec5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:27.471007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1213/2411] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:24:27.471007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a9604-c875-4444-b75b-9d3af543ec5a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:27.471007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a9604-c875-4444-b75b-9d3af543ec5a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:27.472929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791169c-e19c-4f90-8f73-5d5051bfbf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:27.472929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791169c-e19c-4f90-8f73-5d5051bfbf20 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:27.472929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791169c-e19c-4f90-8f73-5d5051bfbf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:27.472929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791169c-e19c-4f90-8f73-5d5051bfbf20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:27.473764 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791169c-e19c-4f90-8f73-5d5051bfbf20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:24:27.473764 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791169c-e19c-4f90-8f73-5d5051bfbf20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:27.473764 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791169c-e19c-4f90-8f73-5d5051bfbf20 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:27.473764 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1214/2412] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:24:27.473764 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791169c-e19c-4f90-8f73-5d5051bfbf20 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:27.473764 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791169c-e19c-4f90-8f73-5d5051bfbf20 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:27.474422 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff65e4-fb27-41aa-a290-466f9993ca25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:27.474422 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff65e4-fb27-41aa-a290-466f9993ca25 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:27.474422 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff65e4-fb27-41aa-a290-466f9993ca25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:27.474422 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff65e4-fb27-41aa-a290-466f9993ca25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:27.475024 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff65e4-fb27-41aa-a290-466f9993ca25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:27.475024 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff65e4-fb27-41aa-a290-466f9993ca25 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:27.475481 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d71364-9d83-4ed2-b432-d6ae89051f70 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:27.482873 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaabdb5-2e7b-4567-ad64-7280b72f886d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f231aa78ac84054b06a2126e1a11f31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:27.488316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaabdb5-2e7b-4567-ad64-7280b72f886d service placement] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:27.488316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaabdb5-2e7b-4567-ad64-7280b72f886d service placement] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:27.488316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaabdb5-2e7b-4567-ad64-7280b72f886d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:27.488316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-fdaabdb5-2e7b-4567-ad64-7280b72f886d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:27.499906 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaabdb5-2e7b-4567-ad64-7280b72f886d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:27.501547 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaabdb5-2e7b-4567-ad64-7280b72f886d service placement] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:27.520543 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1199/2413] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:24:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:24:27.550826 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1215/2414] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:24:27 2022] POST /identity/v3/projects => generated 379 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:24:27.554444 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaabdb5-2e7b-4567-ad64-7280b72f886d service placement] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:27.565845 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaabdb5-2e7b-4567-ad64-7280b72f886d service placement] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:27.651834 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4ce69-f192-4fc5-ba08-0f01c2094872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:27.653911 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4ce69-f192-4fc5-ba08-0f01c2094872 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:27.654361 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4ce69-f192-4fc5-ba08-0f01c2094872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:27.659518 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4ce69-f192-4fc5-ba08-0f01c2094872 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:27.659518 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e4ce69-f192-4fc5-ba08-0f01c2094872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:27.659518 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e4ce69-f192-4fc5-ba08-0f01c2094872 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:27.747671 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1200/2415] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:24:27 2022] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:24:27.751983 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff65e4-fb27-41aa-a290-466f9993ca25 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:27.763059 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff65e4-fb27-41aa-a290-466f9993ca25 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:27.770899 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598cc2e-74dd-4fe8-bb59-dda7513ce270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:27.772155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598cc2e-74dd-4fe8-bb59-dda7513ce270 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:27.772704 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598cc2e-74dd-4fe8-bb59-dda7513ce270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:27.773174 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598cc2e-74dd-4fe8-bb59-dda7513ce270 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:27.774465 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598cc2e-74dd-4fe8-bb59-dda7513ce270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:27.790631 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598cc2e-74dd-4fe8-bb59-dda7513ce270 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:27.793032 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1216/2416] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:24:27.797061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4ce69-f192-4fc5-ba08-0f01c2094872 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:27.811662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4ce69-f192-4fc5-ba08-0f01c2094872 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:27.817096 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05475f08-4b4c-4ca7-bc77-0bcc5795e66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:27.819114 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05475f08-4b4c-4ca7-bc77-0bcc5795e66c admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:27.819114 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05475f08-4b4c-4ca7-bc77-0bcc5795e66c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:27.819114 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05475f08-4b4c-4ca7-bc77-0bcc5795e66c admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:27.819572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05475f08-4b4c-4ca7-bc77-0bcc5795e66c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:27.821313 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05475f08-4b4c-4ca7-bc77-0bcc5795e66c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:27.836967 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1201/2417] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:24:27.837902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598cc2e-74dd-4fe8-bb59-dda7513ce270 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:27.850016 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598cc2e-74dd-4fe8-bb59-dda7513ce270 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:27.864026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9ed51-bf9d-4c1a-a4b8-713a2521b385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:27.865066 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9ed51-bf9d-4c1a-a4b8-713a2521b385 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:27.865354 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9ed51-bf9d-4c1a-a4b8-713a2521b385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:27.865635 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9ed51-bf9d-4c1a-a4b8-713a2521b385 admin admin] PATH_INFO: `/v3/projects/66e1e9277cbb4651901cbb84564ef9bd/users/0f4f36f69496486ab361b2c308826430/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:27.912742 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b9ed51-bf9d-4c1a-a4b8-713a2521b385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e1e9277cbb4651901cbb84564ef9bd, user_id=0f4f36f69496486ab361b2c308826430, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:27.917291 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b9ed51-bf9d-4c1a-a4b8-713a2521b385 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:28.053504 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee692af-f984-4e49-a262-27ff2e731cf4 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:28.053504 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee692af-f984-4e49-a262-27ff2e731cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:28.053504 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee692af-f984-4e49-a262-27ff2e731cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:28.055587 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1217/2418] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:24:27 2022] PUT /identity/v3/projects/66e1e9277cbb4651901cbb84564ef9bd/users/0f4f36f69496486ab361b2c308826430/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:24:28.104726 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0ee692af-f984-4e49-a262-27ff2e731cf4 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:28.105986 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0ee692af-f984-4e49-a262-27ff2e731cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:28.247760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1202/2419] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:28.257182 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9ed51-bf9d-4c1a-a4b8-713a2521b385 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:28.259641 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c4b9ed51-bf9d-4c1a-a4b8-713a2521b385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:28.369208 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9ed51-bf9d-4c1a-a4b8-713a2521b385 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:28.374834 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12a118-e424-4ae8-a4fd-cae6886715b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:28.376413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12a118-e424-4ae8-a4fd-cae6886715b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:28.376872 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12a118-e424-4ae8-a4fd-cae6886715b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:28.377154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12a118-e424-4ae8-a4fd-cae6886715b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:28.395055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12a118-e424-4ae8-a4fd-cae6886715b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:28.397321 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12a118-e424-4ae8-a4fd-cae6886715b2 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:28.422801 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1218/2420] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:24:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:24:30.475173 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982793e8-bc58-4f28-93f8-36cb0553d69e None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:30.477704 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982793e8-bc58-4f28-93f8-36cb0553d69e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:30.478889 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982793e8-bc58-4f28-93f8-36cb0553d69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:30.516177 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-982793e8-bc58-4f28-93f8-36cb0553d69e None None] MFA Rules not processed for user `0f4f36f69496486ab361b2c308826430`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:30.521627 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-982793e8-bc58-4f28-93f8-36cb0553d69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:30.589985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c769381-8ca3-4670-b888-1cd0b7ae803f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:30.589985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c769381-8ca3-4670-b888-1cd0b7ae803f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:30.589985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c769381-8ca3-4670-b888-1cd0b7ae803f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:30.624052 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-3c769381-8ca3-4670-b888-1cd0b7ae803f None None] MFA Rules not processed for user `13195494ed564e0594dbffebf6b81d46`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:30.624875 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3c769381-8ca3-4670-b888-1cd0b7ae803f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:30.668709 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1203/2421] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:24:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:30.674389 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982793e8-bc58-4f28-93f8-36cb0553d69e None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:30.675926 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-982793e8-bc58-4f28-93f8-36cb0553d69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:30.732638 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1219/2422] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:24:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:24:30.746234 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c769381-8ca3-4670-b888-1cd0b7ae803f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:30.748346 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3c769381-8ca3-4670-b888-1cd0b7ae803f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:30.755551 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982793e8-bc58-4f28-93f8-36cb0553d69e None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:30.761096 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110efcd5-3778-4509-a317-b3351fcfce8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:30.761784 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110efcd5-3778-4509-a317-b3351fcfce8e service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:30.762062 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110efcd5-3778-4509-a317-b3351fcfce8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:30.766318 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110efcd5-3778-4509-a317-b3351fcfce8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:30.776721 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110efcd5-3778-4509-a317-b3351fcfce8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:30.779320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110efcd5-3778-4509-a317-b3351fcfce8e service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:30.789271 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1204/2423] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:24:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:24:30.848140 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c769381-8ca3-4670-b888-1cd0b7ae803f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:30.852999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ddb46-e4b3-4e00-b261-495fa328b933 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1e67aa4370453fafb5b6525ba13cd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:30.853654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ddb46-e4b3-4e00-b261-495fa328b933 service glance] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:30.854490 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ddb46-e4b3-4e00-b261-495fa328b933 service glance] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:30.854761 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ddb46-e4b3-4e00-b261-495fa328b933 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:30.857207 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ea0ddb46-e4b3-4e00-b261-495fa328b933 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:30.929708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ddb46-e4b3-4e00-b261-495fa328b933 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:30.931355 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ddb46-e4b3-4e00-b261-495fa328b933 service glance] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:30.944852 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1220/2424] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:24:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:24:31.246507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23a550-a283-4857-bf9b-42bed66bda5e None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:31.246796 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23a550-a283-4857-bf9b-42bed66bda5e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:31.247076 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23a550-a283-4857-bf9b-42bed66bda5e None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:31.248556 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1205/2425] 10.222.0.76 () {54 vars in 921 bytes} [Mon May 16 15:24:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:24:31.254525 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98caaf0d-299c-4959-b5da-3f5df117ebff None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:31.254815 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98caaf0d-299c-4959-b5da-3f5df117ebff None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:31.255098 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98caaf0d-299c-4959-b5da-3f5df117ebff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:31.302333 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043eca1e-2d70-4a09-b3d3-78ca7f143079 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:31.302834 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043eca1e-2d70-4a09-b3d3-78ca7f143079 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:31.303115 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043eca1e-2d70-4a09-b3d3-78ca7f143079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:31.313252 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-98caaf0d-299c-4959-b5da-3f5df117ebff None None] MFA Rules not processed for user `9d85024f010c40129d79543b3ec4cfae`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:31.314748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-98caaf0d-299c-4959-b5da-3f5df117ebff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:31.322404 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-043eca1e-2d70-4a09-b3d3-78ca7f143079 None None] MFA Rules not processed for user `1a7181297bf14a57b3bf1f3c8b178d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:31.323639 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-043eca1e-2d70-4a09-b3d3-78ca7f143079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:31.382821 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1206/2426] 10.222.0.76 () {58 vars in 1009 bytes} [Mon May 16 15:24:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:24:31.391794 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1221/2427] 10.222.0.76 () {58 vars in 1018 bytes} [Mon May 16 15:24:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:31.397415 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043eca1e-2d70-4a09-b3d3-78ca7f143079 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:31.404008 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-043eca1e-2d70-4a09-b3d3-78ca7f143079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:31.405065 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98caaf0d-299c-4959-b5da-3f5df117ebff None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:31.419322 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98caaf0d-299c-4959-b5da-3f5df117ebff None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:31.423287 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b24fce-fb49-4a07-8785-9385c751bfea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1e67aa4370453fafb5b6525ba13cd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:31.424157 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b24fce-fb49-4a07-8785-9385c751bfea service glance] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:31.424465 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b24fce-fb49-4a07-8785-9385c751bfea service glance] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:31.424741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b24fce-fb49-4a07-8785-9385c751bfea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:31.443950 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b24fce-fb49-4a07-8785-9385c751bfea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:31.446768 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b24fce-fb49-4a07-8785-9385c751bfea service glance] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:31.468207 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1222/2428] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:24:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:24:31.524200 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043eca1e-2d70-4a09-b3d3-78ca7f143079 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:31.537918 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5da4da-80a6-436c-b41e-b109fc4fbadd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33470e30760842ca9e96bb7f0cf9f07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:31.539056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5da4da-80a6-436c-b41e-b109fc4fbadd service swift] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:31.539525 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5da4da-80a6-436c-b41e-b109fc4fbadd service swift] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:31.539967 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5da4da-80a6-436c-b41e-b109fc4fbadd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:31.555354 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5da4da-80a6-436c-b41e-b109fc4fbadd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:31.557488 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5da4da-80a6-436c-b41e-b109fc4fbadd service swift] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:31.602275 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1207/2429] 10.222.0.76 () {60 vars in 1384 bytes} [Mon May 16 15:24:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:24:31.817153 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3439cf-63e1-44e0-b79c-6b91b7d4cffc None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:31.821470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3439cf-63e1-44e0-b79c-6b91b7d4cffc None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:31.821470 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3439cf-63e1-44e0-b79c-6b91b7d4cffc None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:31.822097 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1223/2430] 10.222.0.76 () {54 vars in 921 bytes} [Mon May 16 15:24:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:24:31.827743 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791dd23-1779-46d5-af1e-780a53ef4e33 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:31.828139 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791dd23-1779-46d5-af1e-780a53ef4e33 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:31.828506 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791dd23-1779-46d5-af1e-780a53ef4e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:31.863020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-e791dd23-1779-46d5-af1e-780a53ef4e33 None None] MFA Rules not processed for user `15ff90527ece4406be62f449bdf71d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:31.864024 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e791dd23-1779-46d5-af1e-780a53ef4e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:31.878471 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1208/2431] 10.222.0.76 () {58 vars in 1018 bytes} [Mon May 16 15:24:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:24:31.891412 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3439cf-63e1-44e0-b79c-6b91b7d4cffc None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:31.906953 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3439cf-63e1-44e0-b79c-6b91b7d4cffc None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:31.918553 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b0134-5c40-4463-842f-f388c59a1e18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:31.921673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b0134-5c40-4463-842f-f388c59a1e18 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:31.921673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b0134-5c40-4463-842f-f388c59a1e18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:31.921673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b0134-5c40-4463-842f-f388c59a1e18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:31.932611 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b0134-5c40-4463-842f-f388c59a1e18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:31.934215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b0134-5c40-4463-842f-f388c59a1e18 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:31.945911 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1224/2432] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:24:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:24:32.080265 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa5415-09e7-4c11-aeee-22c97737a658 None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:32.080603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa5415-09e7-4c11-aeee-22c97737a658 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:32.080881 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa5415-09e7-4c11-aeee-22c97737a658 None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:32.082584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1209/2433] 10.222.0.76 () {54 vars in 921 bytes} [Mon May 16 15:24:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:24:32.089482 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a4486-0052-4116-994b-112c1578140f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:32.089768 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a4486-0052-4116-994b-112c1578140f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:32.090047 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a4486-0052-4116-994b-112c1578140f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:32.119776 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-bb2a4486-0052-4116-994b-112c1578140f None None] MFA Rules not processed for user `9d85024f010c40129d79543b3ec4cfae`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:32.121455 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bb2a4486-0052-4116-994b-112c1578140f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:32.132687 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1225/2434] 10.222.0.76 () {58 vars in 1018 bytes} [Mon May 16 15:24:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:24:32.145877 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa5415-09e7-4c11-aeee-22c97737a658 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:32.147630 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6ffa5415-09e7-4c11-aeee-22c97737a658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:32.166772 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa5415-09e7-4c11-aeee-22c97737a658 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:32.172373 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5e539-1a9a-4a2c-8ed7-584ecc6d6fd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:32.173135 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5e539-1a9a-4a2c-8ed7-584ecc6d6fd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:32.173686 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5e539-1a9a-4a2c-8ed7-584ecc6d6fd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:32.173969 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5e539-1a9a-4a2c-8ed7-584ecc6d6fd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:32.188567 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5e539-1a9a-4a2c-8ed7-584ecc6d6fd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:32.192518 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5e539-1a9a-4a2c-8ed7-584ecc6d6fd7 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:32.208094 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1210/2435] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:24:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:24:32.700587 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbbbd8-8e18-42fe-919a-0ed97a6549ab None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:32.700880 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbbbd8-8e18-42fe-919a-0ed97a6549ab None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:32.701197 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbbbd8-8e18-42fe-919a-0ed97a6549ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:32.724558 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-2abbbbd8-8e18-42fe-919a-0ed97a6549ab None None] MFA Rules not processed for user `0f4f36f69496486ab361b2c308826430`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:32.725998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2abbbbd8-8e18-42fe-919a-0ed97a6549ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:32.740996 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1226/2436] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:24:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:24:39.132332 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522adf3f-361c-4ada-9c73-92bd57b38ba9 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:39.133820 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522adf3f-361c-4ada-9c73-92bd57b38ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:39.134293 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522adf3f-361c-4ada-9c73-92bd57b38ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:39.171841 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-522adf3f-361c-4ada-9c73-92bd57b38ba9 None None] MFA Rules not processed for user `1a7181297bf14a57b3bf1f3c8b178d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:39.173405 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-522adf3f-361c-4ada-9c73-92bd57b38ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:39.192965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1211/2437] 10.222.0.76 () {58 vars in 1009 bytes} [Mon May 16 15:24:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:39.251345 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbbbd8-8e18-42fe-919a-0ed97a6549ab None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:39.268496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbbbd8-8e18-42fe-919a-0ed97a6549ab None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:39.296164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd6278-0cb3-4c8c-a7ab-7fb4c0d9745c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33470e30760842ca9e96bb7f0cf9f07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:39.296164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd6278-0cb3-4c8c-a7ab-7fb4c0d9745c service swift] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:39.296164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd6278-0cb3-4c8c-a7ab-7fb4c0d9745c service swift] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:39.296164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd6278-0cb3-4c8c-a7ab-7fb4c0d9745c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:39.304782 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd6278-0cb3-4c8c-a7ab-7fb4c0d9745c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:39.307173 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd6278-0cb3-4c8c-a7ab-7fb4c0d9745c service swift] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:39.341682 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1227/2438] 10.222.0.76 () {60 vars in 1384 bytes} [Mon May 16 15:24:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:24:46.662442 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32319c23-4a6b-4d1c-a314-6afd823e8b0a None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:46.663046 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32319c23-4a6b-4d1c-a314-6afd823e8b0a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:46.663153 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32319c23-4a6b-4d1c-a314-6afd823e8b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:46.680656 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-32319c23-4a6b-4d1c-a314-6afd823e8b0a None None] MFA Rules not processed for user `816ac740698548b1b25826fe5168a62a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:46.681963 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-32319c23-4a6b-4d1c-a314-6afd823e8b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:46.689300 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1212/2439] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:24:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:55.708230 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88e9fd-5070-4b6b-8fdb-2f559a8e9a4d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:55.708814 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88e9fd-5070-4b6b-8fdb-2f559a8e9a4d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:55.708814 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88e9fd-5070-4b6b-8fdb-2f559a8e9a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:55.732656 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-2c88e9fd-5070-4b6b-8fdb-2f559a8e9a4d None None] MFA Rules not processed for user `1a7181297bf14a57b3bf1f3c8b178d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:55.734058 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2c88e9fd-5070-4b6b-8fdb-2f559a8e9a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:55.741961 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1228/2440] 10.222.0.76 () {58 vars in 1009 bytes} [Mon May 16 15:24:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:55.755396 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32319c23-4a6b-4d1c-a314-6afd823e8b0a None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:55.767482 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32319c23-4a6b-4d1c-a314-6afd823e8b0a None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:55.773069 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac79b86-af63-4d1b-b8dd-936187f997f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33470e30760842ca9e96bb7f0cf9f07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:55.773722 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac79b86-af63-4d1b-b8dd-936187f997f3 service swift] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:55.774004 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac79b86-af63-4d1b-b8dd-936187f997f3 service swift] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:55.775045 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac79b86-af63-4d1b-b8dd-936187f997f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:55.783689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac79b86-af63-4d1b-b8dd-936187f997f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:55.785923 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac79b86-af63-4d1b-b8dd-936187f997f3 service swift] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:55.796924 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1213/2441] 10.222.0.76 () {60 vars in 1384 bytes} [Mon May 16 15:24:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 15:25:16.014873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88e9fd-5070-4b6b-8fdb-2f559a8e9a4d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:25:16.024391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88e9fd-5070-4b6b-8fdb-2f559a8e9a4d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:25:16.028093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bec87-8ab1-4a95-9c46-5af4c59e34d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:25:16.028728 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bec87-8ab1-4a95-9c46-5af4c59e34d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:25:16.029010 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bec87-8ab1-4a95-9c46-5af4c59e34d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:25:16.029320 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bec87-8ab1-4a95-9c46-5af4c59e34d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:25:16.031140 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6a8bec87-8ab1-4a95-9c46-5af4c59e34d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:25:16.093436 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bec87-8ab1-4a95-9c46-5af4c59e34d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:25:16.094834 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bec87-8ab1-4a95-9c46-5af4c59e34d2 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:25:16.105043 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1229/2442] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:25:16 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:25:18.114054 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac950fd-0238-4d53-9c42-baeb7e46d191 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:25:18.114734 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac950fd-0238-4d53-9c42-baeb7e46d191 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:25:18.114734 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac950fd-0238-4d53-9c42-baeb7e46d191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:25:18.141050 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0ac950fd-0238-4d53-9c42-baeb7e46d191 None None] MFA Rules not processed for user `1a7181297bf14a57b3bf1f3c8b178d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:25:18.142359 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0ac950fd-0238-4d53-9c42-baeb7e46d191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:25:18.150053 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1214/2443] 10.222.0.76 () {58 vars in 967 bytes} [Mon May 16 15:25:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:25:18.163639 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bec87-8ab1-4a95-9c46-5af4c59e34d2 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:25:18.175942 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bec87-8ab1-4a95-9c46-5af4c59e34d2 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:25:18.181503 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4c7a3-1e99-4ea5-867f-4dad1a92f9cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33470e30760842ca9e96bb7f0cf9f07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:25:18.182162 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4c7a3-1e99-4ea5-867f-4dad1a92f9cb service swift] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:25:18.182478 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4c7a3-1e99-4ea5-867f-4dad1a92f9cb service swift] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:25:18.182753 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4c7a3-1e99-4ea5-867f-4dad1a92f9cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:25:18.191427 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4c7a3-1e99-4ea5-867f-4dad1a92f9cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:25:18.193015 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4c7a3-1e99-4ea5-867f-4dad1a92f9cb service swift] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:25:18.201446 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1230/2444] 10.222.0.76 () {60 vars in 1384 bytes} [Mon May 16 15:25:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:25:35.684722 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac950fd-0238-4d53-9c42-baeb7e46d191 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:25:35.694371 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac950fd-0238-4d53-9c42-baeb7e46d191 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:25:35.697959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44e3fc-355a-4a8c-ad9c-afe1c7bb3301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:25:35.698622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44e3fc-355a-4a8c-ad9c-afe1c7bb3301 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:25:35.698903 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44e3fc-355a-4a8c-ad9c-afe1c7bb3301 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:25:35.699179 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44e3fc-355a-4a8c-ad9c-afe1c7bb3301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:25:35.708444 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44e3fc-355a-4a8c-ad9c-afe1c7bb3301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:25:35.709906 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44e3fc-355a-4a8c-ad9c-afe1c7bb3301 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:25:35.719322 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1215/2445] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:25:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:25:50.617334 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0583d-b1e1-4f62-8926-e7fb7d35a278 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:25:50.617866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0583d-b1e1-4f62-8926-e7fb7d35a278 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:25:50.617969 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0583d-b1e1-4f62-8926-e7fb7d35a278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:25:50.636022 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-dcf0583d-b1e1-4f62-8926-e7fb7d35a278 None None] MFA Rules not processed for user `6c6b9438bb4245b3908664bfece4ef22`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:25:50.637211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-dcf0583d-b1e1-4f62-8926-e7fb7d35a278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:25:50.688978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1231/2446] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:25:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:26:01.811873 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fb1ca-24de-4fd8-8afa-d8264fbfc974 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:26:01.812411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fb1ca-24de-4fd8-8afa-d8264fbfc974 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:26:01.812411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fb1ca-24de-4fd8-8afa-d8264fbfc974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:26:01.829768 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-d63fb1ca-24de-4fd8-8afa-d8264fbfc974 None None] MFA Rules not processed for user `0f4f36f69496486ab361b2c308826430`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:26:01.830974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d63fb1ca-24de-4fd8-8afa-d8264fbfc974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:26:01.838616 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1216/2447] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:26:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:26:10.867023 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0583d-b1e1-4f62-8926-e7fb7d35a278 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:26:10.876482 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0583d-b1e1-4f62-8926-e7fb7d35a278 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:26:10.879985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fec66f-6ff0-4710-a3c5-6d5e46ffef41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:26:10.880645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fec66f-6ff0-4710-a3c5-6d5e46ffef41 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:26:10.880924 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fec66f-6ff0-4710-a3c5-6d5e46ffef41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:26:10.881193 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fec66f-6ff0-4710-a3c5-6d5e46ffef41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:26:10.882939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c1fec66f-6ff0-4710-a3c5-6d5e46ffef41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:26:10.896252 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fec66f-6ff0-4710-a3c5-6d5e46ffef41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:26:10.897702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fec66f-6ff0-4710-a3c5-6d5e46ffef41 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:26:10.909204 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1232/2448] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:26:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:26:11.591291 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fb1ca-24de-4fd8-8afa-d8264fbfc974 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:26:11.600893 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fb1ca-24de-4fd8-8afa-d8264fbfc974 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:26:11.604770 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f7b36-9c8d-4300-ae06-76cd148e57e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:26:11.605425 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f7b36-9c8d-4300-ae06-76cd148e57e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:26:11.605739 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f7b36-9c8d-4300-ae06-76cd148e57e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:26:11.606018 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f7b36-9c8d-4300-ae06-76cd148e57e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:26:11.607842 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-bb0f7b36-9c8d-4300-ae06-76cd148e57e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:26:11.621620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f7b36-9c8d-4300-ae06-76cd148e57e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:26:11.623046 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f7b36-9c8d-4300-ae06-76cd148e57e2 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:26:11.634502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1217/2449] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:26:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:26:20.337684 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a86af7-e269-4b8b-b65f-99f47f63bcd8 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:26:20.338287 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a86af7-e269-4b8b-b65f-99f47f63bcd8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:26:20.338287 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a86af7-e269-4b8b-b65f-99f47f63bcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:26:20.358305 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a4a86af7-e269-4b8b-b65f-99f47f63bcd8 None None] MFA Rules not processed for user `6b16118d74774a9ea673d6e0532b8772`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:26:20.359512 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a4a86af7-e269-4b8b-b65f-99f47f63bcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:26:20.424599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1233/2450] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:26:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:26:21.151387 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f7b36-9c8d-4300-ae06-76cd148e57e2 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:26:21.255186 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f7b36-9c8d-4300-ae06-76cd148e57e2 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:26:21.260698 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6e565-900d-45fb-93c5-d444ea582649 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f231aa78ac84054b06a2126e1a11f31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:26:21.261464 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6e565-900d-45fb-93c5-d444ea582649 service placement] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:26:21.262588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6e565-900d-45fb-93c5-d444ea582649 service placement] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:26:21.262872 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6e565-900d-45fb-93c5-d444ea582649 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:26:21.264882 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-64d6e565-900d-45fb-93c5-d444ea582649 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:26:21.279654 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6e565-900d-45fb-93c5-d444ea582649 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:26:21.281428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6e565-900d-45fb-93c5-d444ea582649 service placement] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:26:21.292049 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1218/2451] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:26:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:26:25.745623 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66b91e-6692-42cb-9a55-94f54d68c0e6 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:26:25.746111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66b91e-6692-42cb-9a55-94f54d68c0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:26:25.746243 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66b91e-6692-42cb-9a55-94f54d68c0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:26:25.765654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ee66b91e-6692-42cb-9a55-94f54d68c0e6 None None] MFA Rules not processed for user `d3492cec550a46598e09c48474a4c6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:26:25.766935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ee66b91e-6692-42cb-9a55-94f54d68c0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:26:25.829005 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1234/2452] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:26:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:26:26.140781 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6e565-900d-45fb-93c5-d444ea582649 service placement] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:26:26.150846 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6e565-900d-45fb-93c5-d444ea582649 service placement] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:26:26.155304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d869c8-2e5c-47b4-b388-5d92c15b3893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:26:26.156182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d869c8-2e5c-47b4-b388-5d92c15b3893 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:26:26.156465 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d869c8-2e5c-47b4-b388-5d92c15b3893 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:26:26.156766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d869c8-2e5c-47b4-b388-5d92c15b3893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:26:26.158772 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c4d869c8-2e5c-47b4-b388-5d92c15b3893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:26:26.169733 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d869c8-2e5c-47b4-b388-5d92c15b3893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:26:26.171261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d869c8-2e5c-47b4-b388-5d92c15b3893 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:26:26.180126 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1219/2453] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:26:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:26:27.001077 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66b91e-6692-42cb-9a55-94f54d68c0e6 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:26:27.002868 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ee66b91e-6692-42cb-9a55-94f54d68c0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:26:27.018884 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66b91e-6692-42cb-9a55-94f54d68c0e6 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:26:27.024389 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7afca2-aaab-4e45-945e-6055ffd94de5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:26:27.025062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7afca2-aaab-4e45-945e-6055ffd94de5 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:26:27.025340 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7afca2-aaab-4e45-945e-6055ffd94de5 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:26:27.025611 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7afca2-aaab-4e45-945e-6055ffd94de5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:26:27.027391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-dc7afca2-aaab-4e45-945e-6055ffd94de5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:26:27.038361 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7afca2-aaab-4e45-945e-6055ffd94de5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:26:27.039927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7afca2-aaab-4e45-945e-6055ffd94de5 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:26:27.049381 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1235/2454] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:26:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:26:29.816396 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d869c8-2e5c-47b4-b388-5d92c15b3893 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:26:29.817799 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c4d869c8-2e5c-47b4-b388-5d92c15b3893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:26:29.833317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d869c8-2e5c-47b4-b388-5d92c15b3893 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:26:29.838788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea342882-1a84-4661-b03c-60d5e22b82ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:26:29.839383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea342882-1a84-4661-b03c-60d5e22b82ae service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:26:29.839646 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea342882-1a84-4661-b03c-60d5e22b82ae service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:26:29.839918 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea342882-1a84-4661-b03c-60d5e22b82ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:26:29.841594 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ea342882-1a84-4661-b03c-60d5e22b82ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:26:29.851938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea342882-1a84-4661-b03c-60d5e22b82ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:26:29.853516 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea342882-1a84-4661-b03c-60d5e22b82ae service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:26:29.862935 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1220/2455] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:26:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:26:35.177001 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7afca2-aaab-4e45-945e-6055ffd94de5 service nova] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:26:35.187371 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7afca2-aaab-4e45-945e-6055ffd94de5 service nova] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:26:35.191695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79060d49-c1f8-484c-8738-9089cb414aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:26:35.192364 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79060d49-c1f8-484c-8738-9089cb414aef service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:26:35.192650 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79060d49-c1f8-484c-8738-9089cb414aef service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:26:35.192930 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79060d49-c1f8-484c-8738-9089cb414aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:26:35.194748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-79060d49-c1f8-484c-8738-9089cb414aef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:26:35.205122 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79060d49-c1f8-484c-8738-9089cb414aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:26:35.206618 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79060d49-c1f8-484c-8738-9089cb414aef service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:26:35.214777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1236/2456] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:26:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:26:36.389429 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea342882-1a84-4661-b03c-60d5e22b82ae service nova] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:26:36.413730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea342882-1a84-4661-b03c-60d5e22b82ae service nova] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:26:36.425798 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a39013-7f4f-4d24-9e5f-652aa4b507ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:26:36.427684 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a39013-7f4f-4d24-9e5f-652aa4b507ac service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:26:36.428095 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a39013-7f4f-4d24-9e5f-652aa4b507ac service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:26:36.429764 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a39013-7f4f-4d24-9e5f-652aa4b507ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:26:36.432585 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d8a39013-7f4f-4d24-9e5f-652aa4b507ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:26:36.459288 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a39013-7f4f-4d24-9e5f-652aa4b507ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:26:36.461982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a39013-7f4f-4d24-9e5f-652aa4b507ac service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:26:36.481590 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1221/2457] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:26:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:26:46.937855 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79060d49-c1f8-484c-8738-9089cb414aef service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:26:46.939960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-79060d49-c1f8-484c-8738-9089cb414aef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:26:46.951010 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79060d49-c1f8-484c-8738-9089cb414aef service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:26:46.954630 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40c62d-5e20-4a88-b2f8-7427722e3d36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:26:46.955258 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40c62d-5e20-4a88-b2f8-7427722e3d36 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:26:46.955541 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40c62d-5e20-4a88-b2f8-7427722e3d36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:26:46.955820 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40c62d-5e20-4a88-b2f8-7427722e3d36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:26:46.957567 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0b40c62d-5e20-4a88-b2f8-7427722e3d36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:26:46.968388 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40c62d-5e20-4a88-b2f8-7427722e3d36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:26:46.969857 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40c62d-5e20-4a88-b2f8-7427722e3d36 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:26:46.978869 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1237/2458] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:26:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:11.530710 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a39013-7f4f-4d24-9e5f-652aa4b507ac service nova] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:11.540723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a39013-7f4f-4d24-9e5f-652aa4b507ac service nova] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:11.544533 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d366ed-7321-4ea2-84b1-e393ccfb0810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:11.545217 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d366ed-7321-4ea2-84b1-e393ccfb0810 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:11.545502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d366ed-7321-4ea2-84b1-e393ccfb0810 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:11.545781 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d366ed-7321-4ea2-84b1-e393ccfb0810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:11.547617 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c0d366ed-7321-4ea2-84b1-e393ccfb0810 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:11.559606 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d366ed-7321-4ea2-84b1-e393ccfb0810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:11.561069 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d366ed-7321-4ea2-84b1-e393ccfb0810 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:11.571282 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1222/2459] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:27:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:12.662201 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40c62d-5e20-4a88-b2f8-7427722e3d36 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:12.674106 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40c62d-5e20-4a88-b2f8-7427722e3d36 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:12.679481 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf697b3-d116-4169-8186-06b9ea599712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:12.681443 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf697b3-d116-4169-8186-06b9ea599712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:12.681902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf697b3-d116-4169-8186-06b9ea599712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:12.682209 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf697b3-d116-4169-8186-06b9ea599712 admin admin] PATH_INFO: `/v3/users/0f4f36f69496486ab361b2c308826430` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:12.683836 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf697b3-d116-4169-8186-06b9ea599712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f4f36f69496486ab361b2c308826430)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:12.686475 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf697b3-d116-4169-8186-06b9ea599712 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:12.871357 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ccf697b3-d116-4169-8186-06b9ea599712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f4f36f69496486ab361b2c308826430'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:12.885950 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ccf697b3-d116-4169-8186-06b9ea599712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f4f36f69496486ab361b2c308826430'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:12.886976 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ccf697b3-d116-4169-8186-06b9ea599712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f4f36f69496486ab361b2c308826430'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:12.887627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ccf697b3-d116-4169-8186-06b9ea599712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f4f36f69496486ab361b2c308826430'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:12.895018 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ccf697b3-d116-4169-8186-06b9ea599712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f4f36f69496486ab361b2c308826430'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:12.955681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1238/2460] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:27:12 2022] DELETE /identity/v3/users/0f4f36f69496486ab361b2c308826430 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:13.193938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d366ed-7321-4ea2-84b1-e393ccfb0810 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:13.212328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d366ed-7321-4ea2-84b1-e393ccfb0810 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:13.269658 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933c1f9-205e-4383-b337-c13750c33117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:13.270543 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933c1f9-205e-4383-b337-c13750c33117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:13.270824 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933c1f9-205e-4383-b337-c13750c33117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:13.271095 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933c1f9-205e-4383-b337-c13750c33117 admin admin] PATH_INFO: `/v3/projects/66e1e9277cbb4651901cbb84564ef9bd` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:13.272269 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933c1f9-205e-4383-b337-c13750c33117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66e1e9277cbb4651901cbb84564ef9bd)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:13.274878 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933c1f9-205e-4383-b337-c13750c33117 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:13.390255 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d933c1f9-205e-4383-b337-c13750c33117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66e1e9277cbb4651901cbb84564ef9bd', 'request_id': 'req-d933c1f9-205e-4383-b337-c13750c33117'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:13.454806 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d933c1f9-205e-4383-b337-c13750c33117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66e1e9277cbb4651901cbb84564ef9bd', 'request_id': 'req-d933c1f9-205e-4383-b337-c13750c33117'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:13.466206 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d933c1f9-205e-4383-b337-c13750c33117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66e1e9277cbb4651901cbb84564ef9bd', 'request_id': 'req-d933c1f9-205e-4383-b337-c13750c33117'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:13.488737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d933c1f9-205e-4383-b337-c13750c33117 admin admin] The token cache is being invalidate because project 66e1e9277cbb4651901cbb84564ef9bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:27:13.489550 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d933c1f9-205e-4383-b337-c13750c33117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:13.490572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d933c1f9-205e-4383-b337-c13750c33117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:13.501536 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1223/2461] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:27:13 2022] DELETE /identity/v3/projects/66e1e9277cbb4651901cbb84564ef9bd => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:14.913475 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf697b3-d116-4169-8186-06b9ea599712 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:14.915002 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ccf697b3-d116-4169-8186-06b9ea599712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:15.079108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf697b3-d116-4169-8186-06b9ea599712 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:15.151039 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864b21e-8d7e-4b95-ad4d-74fb8278bcca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:15.151984 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864b21e-8d7e-4b95-ad4d-74fb8278bcca service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:15.152427 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864b21e-8d7e-4b95-ad4d-74fb8278bcca service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:15.152868 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864b21e-8d7e-4b95-ad4d-74fb8278bcca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:15.154906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9864b21e-8d7e-4b95-ad4d-74fb8278bcca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:15.173263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864b21e-8d7e-4b95-ad4d-74fb8278bcca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:15.174952 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864b21e-8d7e-4b95-ad4d-74fb8278bcca service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:15.186594 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1239/2462] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:27:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:16.266750 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933c1f9-205e-4383-b337-c13750c33117 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:16.269031 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d933c1f9-205e-4383-b337-c13750c33117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:16.352813 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933c1f9-205e-4383-b337-c13750c33117 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:16.357712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247f296-6df4-4370-adcf-2b73735f0ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:16.362290 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247f296-6df4-4370-adcf-2b73735f0ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:16.362739 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247f296-6df4-4370-adcf-2b73735f0ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:16.363126 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247f296-6df4-4370-adcf-2b73735f0ed4 admin admin] PATH_INFO: `/v3/users/6c6b9438bb4245b3908664bfece4ef22` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:16.364634 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247f296-6df4-4370-adcf-2b73735f0ed4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c6b9438bb4245b3908664bfece4ef22)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:16.367255 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247f296-6df4-4370-adcf-2b73735f0ed4 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:16.592103 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f247f296-6df4-4370-adcf-2b73735f0ed4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c6b9438bb4245b3908664bfece4ef22'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:16.661016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f247f296-6df4-4370-adcf-2b73735f0ed4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c6b9438bb4245b3908664bfece4ef22'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:16.661655 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f247f296-6df4-4370-adcf-2b73735f0ed4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c6b9438bb4245b3908664bfece4ef22'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:16.676511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f247f296-6df4-4370-adcf-2b73735f0ed4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c6b9438bb4245b3908664bfece4ef22'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:16.681529 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-f247f296-6df4-4370-adcf-2b73735f0ed4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c6b9438bb4245b3908664bfece4ef22'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:16.694712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1224/2463] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:27:16 2022] DELETE /identity/v3/users/6c6b9438bb4245b3908664bfece4ef22 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:16.939521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864b21e-8d7e-4b95-ad4d-74fb8278bcca service nova] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:16.955293 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864b21e-8d7e-4b95-ad4d-74fb8278bcca service nova] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:17.015289 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f5e52-3723-4c81-b6c2-f53c6be877fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:17.016069 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f5e52-3723-4c81-b6c2-f53c6be877fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:17.016350 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f5e52-3723-4c81-b6c2-f53c6be877fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:17.016630 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f5e52-3723-4c81-b6c2-f53c6be877fa admin admin] PATH_INFO: `/v3/projects/c3c3d75e638a4871b548ba689eeddeda` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:17.017805 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f5e52-3723-4c81-b6c2-f53c6be877fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c3d75e638a4871b548ba689eeddeda)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:17.020221 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f5e52-3723-4c81-b6c2-f53c6be877fa admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:17.127285 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e51f5e52-3723-4c81-b6c2-f53c6be877fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c3d75e638a4871b548ba689eeddeda', 'request_id': 'req-e51f5e52-3723-4c81-b6c2-f53c6be877fa'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:17.134283 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e51f5e52-3723-4c81-b6c2-f53c6be877fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c3d75e638a4871b548ba689eeddeda', 'request_id': 'req-e51f5e52-3723-4c81-b6c2-f53c6be877fa'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:17.211787 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e51f5e52-3723-4c81-b6c2-f53c6be877fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c3d75e638a4871b548ba689eeddeda', 'request_id': 'req-e51f5e52-3723-4c81-b6c2-f53c6be877fa'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:17.223078 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e51f5e52-3723-4c81-b6c2-f53c6be877fa admin admin] The token cache is being invalidate because project c3c3d75e638a4871b548ba689eeddeda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:27:17.223367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e51f5e52-3723-4c81-b6c2-f53c6be877fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:17.223998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e51f5e52-3723-4c81-b6c2-f53c6be877fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:17.226295 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1240/2464] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:27:16 2022] DELETE /identity/v3/projects/c3c3d75e638a4871b548ba689eeddeda => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:17.231869 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bf363-fbf5-4b55-a9cb-ebba5193f82c None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:17.232141 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bf363-fbf5-4b55-a9cb-ebba5193f82c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:17.232421 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bf363-fbf5-4b55-a9cb-ebba5193f82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:17.253671 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-6a3bf363-fbf5-4b55-a9cb-ebba5193f82c None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:17.254914 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6a3bf363-fbf5-4b55-a9cb-ebba5193f82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:17.323166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1225/2465] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:27:17.331185 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575481a-e7dc-4e56-ac22-eaa66bd85f62 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:17.331530 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575481a-e7dc-4e56-ac22-eaa66bd85f62 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:17.331794 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575481a-e7dc-4e56-ac22-eaa66bd85f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:17.357621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a575481a-e7dc-4e56-ac22-eaa66bd85f62 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:17.359201 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a575481a-e7dc-4e56-ac22-eaa66bd85f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:17.367900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1241/2466] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:17.372436 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bf363-fbf5-4b55-a9cb-ebba5193f82c None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:17.383481 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bf363-fbf5-4b55-a9cb-ebba5193f82c None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:17.388572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff334cb5-546d-4454-a7d7-36bb35f66e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:17.389686 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff334cb5-546d-4454-a7d7-36bb35f66e8c admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:17.389974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff334cb5-546d-4454-a7d7-36bb35f66e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:17.390300 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff334cb5-546d-4454-a7d7-36bb35f66e8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:17.391053 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff334cb5-546d-4454-a7d7-36bb35f66e8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:27:17.391365 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff334cb5-546d-4454-a7d7-36bb35f66e8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:17.393018 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff334cb5-546d-4454-a7d7-36bb35f66e8c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:17.408496 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1226/2467] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:27:17.411303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575481a-e7dc-4e56-ac22-eaa66bd85f62 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:17.421317 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575481a-e7dc-4e56-ac22-eaa66bd85f62 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:17.425925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b7195-7190-4863-8ae2-f365201bf3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:17.426617 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b7195-7190-4863-8ae2-f365201bf3c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:17.426902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b7195-7190-4863-8ae2-f365201bf3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:17.427169 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b7195-7190-4863-8ae2-f365201bf3c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:17.427871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b7195-7190-4863-8ae2-f365201bf3c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:17.429780 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b7195-7190-4863-8ae2-f365201bf3c9 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:17.537496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1242/2468] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:27:17 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:17.538702 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff334cb5-546d-4454-a7d7-36bb35f66e8c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:17.551124 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff334cb5-546d-4454-a7d7-36bb35f66e8c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:17.612502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09923e5c-8d6e-421b-84d1-dfcb4e997891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:17.613185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09923e5c-8d6e-421b-84d1-dfcb4e997891 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:17.613468 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09923e5c-8d6e-421b-84d1-dfcb4e997891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:17.613748 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09923e5c-8d6e-421b-84d1-dfcb4e997891 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:17.620603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09923e5c-8d6e-421b-84d1-dfcb4e997891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:17.620603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09923e5c-8d6e-421b-84d1-dfcb4e997891 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:17.763199 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1227/2469] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:27:17 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:27:17.774743 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b7195-7190-4863-8ae2-f365201bf3c9 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:17.785256 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b7195-7190-4863-8ae2-f365201bf3c9 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:17.790461 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0dc0ab-bb65-491f-adfa-d3c6f8a2588b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:17.791002 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0dc0ab-bb65-491f-adfa-d3c6f8a2588b admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:17.791319 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0dc0ab-bb65-491f-adfa-d3c6f8a2588b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:17.791595 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0dc0ab-bb65-491f-adfa-d3c6f8a2588b admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:17.792362 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0dc0ab-bb65-491f-adfa-d3c6f8a2588b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:17.794032 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0dc0ab-bb65-491f-adfa-d3c6f8a2588b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:17.805071 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1243/2470] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:17.809106 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09923e5c-8d6e-421b-84d1-dfcb4e997891 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:17.819039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09923e5c-8d6e-421b-84d1-dfcb4e997891 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:17.824709 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b33383-6871-4860-81cb-f932fad7c38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:17.825389 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b33383-6871-4860-81cb-f932fad7c38f admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:17.825663 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b33383-6871-4860-81cb-f932fad7c38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:17.825932 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b33383-6871-4860-81cb-f932fad7c38f admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:17.826713 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b33383-6871-4860-81cb-f932fad7c38f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:17.828322 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b33383-6871-4860-81cb-f932fad7c38f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:17.840255 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1228/2471] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:17.844125 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0dc0ab-bb65-491f-adfa-d3c6f8a2588b admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:17.854498 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0dc0ab-bb65-491f-adfa-d3c6f8a2588b admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:17.859256 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04687d-2f5b-495f-9dca-65567efb690e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:17.860125 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04687d-2f5b-495f-9dca-65567efb690e admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:17.860405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04687d-2f5b-495f-9dca-65567efb690e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:17.860677 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04687d-2f5b-495f-9dca-65567efb690e admin admin] PATH_INFO: `/v3/projects/10ec56d48dd54e36b1607f30ff55edca/users/cdf7dc6769bb49ae9491c31cf289c90a/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:17.875130 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04687d-2f5b-495f-9dca-65567efb690e admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ec56d48dd54e36b1607f30ff55edca, user_id=cdf7dc6769bb49ae9491c31cf289c90a, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:17.877755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04687d-2f5b-495f-9dca-65567efb690e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:17.993001 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1244/2472] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:27:17 2022] PUT /identity/v3/projects/10ec56d48dd54e36b1607f30ff55edca/users/cdf7dc6769bb49ae9491c31cf289c90a/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:18.003291 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4c3e7-db9a-40ac-8216-be3b4b9d9410 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:18.003579 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4c3e7-db9a-40ac-8216-be3b4b9d9410 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:18.003861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4c3e7-db9a-40ac-8216-be3b4b9d9410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:18.034449 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a9e4c3e7-db9a-40ac-8216-be3b4b9d9410 None None] MFA Rules not processed for user `cdf7dc6769bb49ae9491c31cf289c90a`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:18.034449 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a9e4c3e7-db9a-40ac-8216-be3b4b9d9410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:18.096666 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1229/2473] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:18.107633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04687d-2f5b-495f-9dca-65567efb690e admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:18.109340 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ee04687d-2f5b-495f-9dca-65567efb690e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:18.180861 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04687d-2f5b-495f-9dca-65567efb690e admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:18.186429 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39797396-bfb2-4037-8c08-a5d140198cd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:18.187062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39797396-bfb2-4037-8c08-a5d140198cd2 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:18.187347 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39797396-bfb2-4037-8c08-a5d140198cd2 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:18.187627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39797396-bfb2-4037-8c08-a5d140198cd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:18.195210 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39797396-bfb2-4037-8c08-a5d140198cd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:18.197363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39797396-bfb2-4037-8c08-a5d140198cd2 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:18.205988 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1245/2474] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:27:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:27:18.413565 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4c3e7-db9a-40ac-8216-be3b4b9d9410 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:18.473533 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4c3e7-db9a-40ac-8216-be3b4b9d9410 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:18.478596 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5c48b-d449-4bff-bc8a-8beb5ed85b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:18.479451 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5c48b-d449-4bff-bc8a-8beb5ed85b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:18.479732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5c48b-d449-4bff-bc8a-8beb5ed85b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:18.479999 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5c48b-d449-4bff-bc8a-8beb5ed85b4d admin admin] PATH_INFO: `/v3/users/cdf7dc6769bb49ae9491c31cf289c90a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:18.481169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5c48b-d449-4bff-bc8a-8beb5ed85b4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdf7dc6769bb49ae9491c31cf289c90a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:18.483136 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5c48b-d449-4bff-bc8a-8beb5ed85b4d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:18.704881 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2ab5c48b-d449-4bff-bc8a-8beb5ed85b4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdf7dc6769bb49ae9491c31cf289c90a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:18.754305 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2ab5c48b-d449-4bff-bc8a-8beb5ed85b4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdf7dc6769bb49ae9491c31cf289c90a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:18.754977 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2ab5c48b-d449-4bff-bc8a-8beb5ed85b4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdf7dc6769bb49ae9491c31cf289c90a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:18.767139 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2ab5c48b-d449-4bff-bc8a-8beb5ed85b4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdf7dc6769bb49ae9491c31cf289c90a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:18.767785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2ab5c48b-d449-4bff-bc8a-8beb5ed85b4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdf7dc6769bb49ae9491c31cf289c90a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:18.780069 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1230/2475] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:27:18 2022] DELETE /identity/v3/users/cdf7dc6769bb49ae9491c31cf289c90a => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:18.784923 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab147ef5-6d1e-4223-8206-732d6915092a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:18.785224 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab147ef5-6d1e-4223-8206-732d6915092a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:18.785508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab147ef5-6d1e-4223-8206-732d6915092a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:18.802975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ab147ef5-6d1e-4223-8206-732d6915092a None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:18.804210 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ab147ef5-6d1e-4223-8206-732d6915092a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:18.863674 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1246/2476] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:18.873309 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5c48b-d449-4bff-bc8a-8beb5ed85b4d admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:18.874708 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2ab5c48b-d449-4bff-bc8a-8beb5ed85b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:18.937135 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5c48b-d449-4bff-bc8a-8beb5ed85b4d admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:18.940974 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dbf9c6-574b-480b-84cc-4515b7cdec60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:18.941614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbf9c6-574b-480b-84cc-4515b7cdec60 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:18.941894 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbf9c6-574b-480b-84cc-4515b7cdec60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:18.942199 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbf9c6-574b-480b-84cc-4515b7cdec60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:18.953083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dbf9c6-574b-480b-84cc-4515b7cdec60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:18.954593 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dbf9c6-574b-480b-84cc-4515b7cdec60 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:18.965093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1231/2477] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:27:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:19.396697 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab147ef5-6d1e-4223-8206-732d6915092a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:19.396697 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ab147ef5-6d1e-4223-8206-732d6915092a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:19.407832 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab147ef5-6d1e-4223-8206-732d6915092a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:19.412419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f09da2-edd7-4e9f-b582-2ebb8341013a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:19.413282 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f09da2-edd7-4e9f-b582-2ebb8341013a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:19.413560 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f09da2-edd7-4e9f-b582-2ebb8341013a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:19.413822 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f09da2-edd7-4e9f-b582-2ebb8341013a admin admin] PATH_INFO: `/v3/projects/10ec56d48dd54e36b1607f30ff55edca` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:19.415112 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f09da2-edd7-4e9f-b582-2ebb8341013a admin admin] RBAC: Authorizing `identity:delete_project(project_id=10ec56d48dd54e36b1607f30ff55edca)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:19.417028 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f09da2-edd7-4e9f-b582-2ebb8341013a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:19.554433 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-49f09da2-edd7-4e9f-b582-2ebb8341013a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10ec56d48dd54e36b1607f30ff55edca', 'request_id': 'req-49f09da2-edd7-4e9f-b582-2ebb8341013a'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:19.561257 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-49f09da2-edd7-4e9f-b582-2ebb8341013a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10ec56d48dd54e36b1607f30ff55edca', 'request_id': 'req-49f09da2-edd7-4e9f-b582-2ebb8341013a'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:19.649283 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-49f09da2-edd7-4e9f-b582-2ebb8341013a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10ec56d48dd54e36b1607f30ff55edca', 'request_id': 'req-49f09da2-edd7-4e9f-b582-2ebb8341013a'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:19.660191 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-49f09da2-edd7-4e9f-b582-2ebb8341013a admin admin] The token cache is being invalidate because project 10ec56d48dd54e36b1607f30ff55edca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:27:19.660474 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-49f09da2-edd7-4e9f-b582-2ebb8341013a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:19.661115 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-49f09da2-edd7-4e9f-b582-2ebb8341013a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:19.662844 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1247/2478] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:27:19 2022] DELETE /identity/v3/projects/10ec56d48dd54e36b1607f30ff55edca => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:19.667694 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba86dc-bd68-4194-bd75-e09a8970a895 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:19.668179 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba86dc-bd68-4194-bd75-e09a8970a895 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:19.668280 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba86dc-bd68-4194-bd75-e09a8970a895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:19.687477 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-47ba86dc-bd68-4194-bd75-e09a8970a895 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:19.688734 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-47ba86dc-bd68-4194-bd75-e09a8970a895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:19.748607 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1232/2479] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:19.756508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b6980-b3a6-4d42-8bcd-a5d779d79ce4 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:19.756797 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b6980-b3a6-4d42-8bcd-a5d779d79ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:19.757098 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b6980-b3a6-4d42-8bcd-a5d779d79ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:19.775447 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-415b6980-b3a6-4d42-8bcd-a5d779d79ce4 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:19.776628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-415b6980-b3a6-4d42-8bcd-a5d779d79ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:19.784312 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1248/2480] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:19.788378 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba86dc-bd68-4194-bd75-e09a8970a895 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:19.798159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba86dc-bd68-4194-bd75-e09a8970a895 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:19.802828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd8280-067f-4cc5-a315-70c42e833914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:19.803593 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd8280-067f-4cc5-a315-70c42e833914 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:19.803882 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd8280-067f-4cc5-a315-70c42e833914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:19.804159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd8280-067f-4cc5-a315-70c42e833914 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:19.804888 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd8280-067f-4cc5-a315-70c42e833914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:27:19.805198 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd8280-067f-4cc5-a315-70c42e833914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:19.807413 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd8280-067f-4cc5-a315-70c42e833914 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:19.818567 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1233/2481] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:27:19.823160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b6980-b3a6-4d42-8bcd-a5d779d79ce4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:19.832446 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b6980-b3a6-4d42-8bcd-a5d779d79ce4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:19.837076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8531f0-0349-497b-9b6d-746f1be525a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:19.837750 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8531f0-0349-497b-9b6d-746f1be525a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:19.838033 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8531f0-0349-497b-9b6d-746f1be525a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:19.838349 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8531f0-0349-497b-9b6d-746f1be525a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:19.839175 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8531f0-0349-497b-9b6d-746f1be525a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:19.841097 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8531f0-0349-497b-9b6d-746f1be525a5 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:19.907707 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1249/2482] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:27:19 2022] POST /identity/v3/projects => generated 369 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:19.911781 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd8280-067f-4cc5-a315-70c42e833914 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:19.922299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd8280-067f-4cc5-a315-70c42e833914 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:19.976964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38f640-55d7-4faa-ad3b-6c63aec5bb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:19.977626 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38f640-55d7-4faa-ad3b-6c63aec5bb54 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:19.978466 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38f640-55d7-4faa-ad3b-6c63aec5bb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:19.978744 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38f640-55d7-4faa-ad3b-6c63aec5bb54 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:19.979427 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38f640-55d7-4faa-ad3b-6c63aec5bb54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:19.981353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38f640-55d7-4faa-ad3b-6c63aec5bb54 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:20.086788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1234/2483] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:27:19 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:20.091135 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8531f0-0349-497b-9b6d-746f1be525a5 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:20.101640 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8531f0-0349-497b-9b6d-746f1be525a5 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:20.106826 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38883fff-2593-4d6b-8c42-96802efd284e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:20.107480 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38883fff-2593-4d6b-8c42-96802efd284e admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:20.107761 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38883fff-2593-4d6b-8c42-96802efd284e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:20.108090 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38883fff-2593-4d6b-8c42-96802efd284e admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:20.108817 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38883fff-2593-4d6b-8c42-96802efd284e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:20.110458 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38883fff-2593-4d6b-8c42-96802efd284e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:20.121156 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1250/2484] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:20.125090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38f640-55d7-4faa-ad3b-6c63aec5bb54 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:20.135320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38f640-55d7-4faa-ad3b-6c63aec5bb54 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:20.140020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fd5ec-8aa9-47a8-ba44-cf7f7c78908b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:20.140704 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fd5ec-8aa9-47a8-ba44-cf7f7c78908b admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:20.140986 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fd5ec-8aa9-47a8-ba44-cf7f7c78908b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:20.141263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fd5ec-8aa9-47a8-ba44-cf7f7c78908b admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:20.142339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782fd5ec-8aa9-47a8-ba44-cf7f7c78908b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:20.143746 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782fd5ec-8aa9-47a8-ba44-cf7f7c78908b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:20.154020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1235/2485] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:20.158001 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38883fff-2593-4d6b-8c42-96802efd284e admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:20.175086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38883fff-2593-4d6b-8c42-96802efd284e admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:20.175086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be06411-63b6-4899-ab91-657dbe8ca8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:20.175086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be06411-63b6-4899-ab91-657dbe8ca8c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:20.175086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be06411-63b6-4899-ab91-657dbe8ca8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:20.175463 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be06411-63b6-4899-ab91-657dbe8ca8c1 admin admin] PATH_INFO: `/v3/projects/2f674bb0fa8b4d019cb9925c7c916fc3/users/7303616e51cd4a16bb827a199f5ce6a5/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:20.190095 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be06411-63b6-4899-ab91-657dbe8ca8c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f674bb0fa8b4d019cb9925c7c916fc3, user_id=7303616e51cd4a16bb827a199f5ce6a5, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:20.192784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be06411-63b6-4899-ab91-657dbe8ca8c1 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:20.263633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1251/2486] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:27:20 2022] PUT /identity/v3/projects/2f674bb0fa8b4d019cb9925c7c916fc3/users/7303616e51cd4a16bb827a199f5ce6a5/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:20.273846 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d944d-aa97-49ea-83e7-2b8376591cf7 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:20.274148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d944d-aa97-49ea-83e7-2b8376591cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:20.274450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d944d-aa97-49ea-83e7-2b8376591cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:20.301197 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-8b1d944d-aa97-49ea-83e7-2b8376591cf7 None None] MFA Rules not processed for user `7303616e51cd4a16bb827a199f5ce6a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:20.302491 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8b1d944d-aa97-49ea-83e7-2b8376591cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:20.365255 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1236/2487] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:20.369955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be06411-63b6-4899-ab91-657dbe8ca8c1 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:20.432829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be06411-63b6-4899-ab91-657dbe8ca8c1 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:20.437496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01676b-6830-4cec-be95-3f1cb7b92210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:20.438176 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01676b-6830-4cec-be95-3f1cb7b92210 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:20.438466 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01676b-6830-4cec-be95-3f1cb7b92210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:20.438747 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01676b-6830-4cec-be95-3f1cb7b92210 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:20.439440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01676b-6830-4cec-be95-3f1cb7b92210 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:20.441459 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01676b-6830-4cec-be95-3f1cb7b92210 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:20.564836 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1252/2488] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:27:20 2022] POST /identity/v3/projects => generated 367 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:20.568012 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d944d-aa97-49ea-83e7-2b8376591cf7 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:20.579630 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d944d-aa97-49ea-83e7-2b8376591cf7 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:20.637321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619bf3f-d20f-49e4-b795-8df88e7e5ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:20.638017 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619bf3f-d20f-49e4-b795-8df88e7e5ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:20.638332 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619bf3f-d20f-49e4-b795-8df88e7e5ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:20.638616 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619bf3f-d20f-49e4-b795-8df88e7e5ac8 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:20.639319 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619bf3f-d20f-49e4-b795-8df88e7e5ac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:20.641216 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619bf3f-d20f-49e4-b795-8df88e7e5ac8 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:20.712101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1237/2489] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:27:20 2022] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:20.716690 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01676b-6830-4cec-be95-3f1cb7b92210 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:20.726949 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01676b-6830-4cec-be95-3f1cb7b92210 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:20.731573 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6c9e9-2885-40c4-900d-43327d07693a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:20.732221 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6c9e9-2885-40c4-900d-43327d07693a admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:20.732501 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6c9e9-2885-40c4-900d-43327d07693a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:20.732774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6c9e9-2885-40c4-900d-43327d07693a admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:20.733494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6c9e9-2885-40c4-900d-43327d07693a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:20.735128 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6c9e9-2885-40c4-900d-43327d07693a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:20.745436 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1253/2490] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:20.749405 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619bf3f-d20f-49e4-b795-8df88e7e5ac8 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:20.760298 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619bf3f-d20f-49e4-b795-8df88e7e5ac8 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:20.764834 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c0307-eabb-489d-9c95-7cd857bf1612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:20.765693 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c0307-eabb-489d-9c95-7cd857bf1612 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:20.765976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c0307-eabb-489d-9c95-7cd857bf1612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:20.766392 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c0307-eabb-489d-9c95-7cd857bf1612 admin admin] PATH_INFO: `/v3/projects/e57430014f9a4799b8d37bf224d281cb/users/13b77c5fa6ff4f5298b36f8c136149b3/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:20.781094 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c0307-eabb-489d-9c95-7cd857bf1612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e57430014f9a4799b8d37bf224d281cb, user_id=13b77c5fa6ff4f5298b36f8c136149b3, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:20.783833 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c0307-eabb-489d-9c95-7cd857bf1612 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:20.845388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1238/2491] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:27:20 2022] PUT /identity/v3/projects/e57430014f9a4799b8d37bf224d281cb/users/13b77c5fa6ff4f5298b36f8c136149b3/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:20.849411 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6c9e9-2885-40c4-900d-43327d07693a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:20.859159 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6c9e9-2885-40c4-900d-43327d07693a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:20.913381 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6191bf5-aa67-4ec8-a39d-51bcdb6b860c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:20.914032 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6191bf5-aa67-4ec8-a39d-51bcdb6b860c admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:20.914345 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6191bf5-aa67-4ec8-a39d-51bcdb6b860c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:20.914624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6191bf5-aa67-4ec8-a39d-51bcdb6b860c admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:20.915341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6191bf5-aa67-4ec8-a39d-51bcdb6b860c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:20.916937 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6191bf5-aa67-4ec8-a39d-51bcdb6b860c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:20.926670 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1254/2492] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:20.931880 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c0307-eabb-489d-9c95-7cd857bf1612 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:20.941798 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c0307-eabb-489d-9c95-7cd857bf1612 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:20.946364 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444566f4-bd0d-4ef7-835d-b77b26249a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:20.947743 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444566f4-bd0d-4ef7-835d-b77b26249a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:20.948022 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444566f4-bd0d-4ef7-835d-b77b26249a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:20.948294 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444566f4-bd0d-4ef7-835d-b77b26249a97 admin admin] PATH_INFO: `/v3/projects/e57430014f9a4799b8d37bf224d281cb/users/13b77c5fa6ff4f5298b36f8c136149b3/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:20.950281 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444566f4-bd0d-4ef7-835d-b77b26249a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e57430014f9a4799b8d37bf224d281cb, user_id=13b77c5fa6ff4f5298b36f8c136149b3, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:20.952917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444566f4-bd0d-4ef7-835d-b77b26249a97 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:20.963546 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1239/2493] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:27:20 2022] PUT /identity/v3/projects/e57430014f9a4799b8d37bf224d281cb/users/13b77c5fa6ff4f5298b36f8c136149b3/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:27:20.974711 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09124968-39a5-48d3-a0bd-61fe296b7cb9 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:20.975007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09124968-39a5-48d3-a0bd-61fe296b7cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:20.975427 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09124968-39a5-48d3-a0bd-61fe296b7cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:21.008090 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-09124968-39a5-48d3-a0bd-61fe296b7cb9 None None] MFA Rules not processed for user `13b77c5fa6ff4f5298b36f8c136149b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:21.009969 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-09124968-39a5-48d3-a0bd-61fe296b7cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:21.075108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1255/2494] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:20 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:21.086225 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444566f4-bd0d-4ef7-835d-b77b26249a97 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:21.087910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-444566f4-bd0d-4ef7-835d-b77b26249a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:21.145043 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444566f4-bd0d-4ef7-835d-b77b26249a97 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:21.148649 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d238070-318b-4002-9af7-2389718a4b2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:21.149278 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d238070-318b-4002-9af7-2389718a4b2c service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:21.149560 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d238070-318b-4002-9af7-2389718a4b2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:21.149837 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d238070-318b-4002-9af7-2389718a4b2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:21.159298 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d238070-318b-4002-9af7-2389718a4b2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:21.160816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d238070-318b-4002-9af7-2389718a4b2c service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:21.170433 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1240/2495] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:27:21 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:21.304733 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09124968-39a5-48d3-a0bd-61fe296b7cb9 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:21.306706 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-09124968-39a5-48d3-a0bd-61fe296b7cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:21.318174 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09124968-39a5-48d3-a0bd-61fe296b7cb9 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:21.321650 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d21541-31ff-4c43-a86a-1b088bcc13ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:21.322878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d21541-31ff-4c43-a86a-1b088bcc13ef service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:21.323155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d21541-31ff-4c43-a86a-1b088bcc13ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:21.323426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d21541-31ff-4c43-a86a-1b088bcc13ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:21.382636 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d21541-31ff-4c43-a86a-1b088bcc13ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:21.384116 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d21541-31ff-4c43-a86a-1b088bcc13ef service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:21.393698 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1256/2496] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:27:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:24.243449 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a8944-2719-4c98-956f-d68f0c98f9c7 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:24.243909 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a8944-2719-4c98-956f-d68f0c98f9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:24.244085 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a8944-2719-4c98-956f-d68f0c98f9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:24.262390 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-a55a8944-2719-4c98-956f-d68f0c98f9c7 None None] MFA Rules not processed for user `1a7181297bf14a57b3bf1f3c8b178d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:24.263588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a55a8944-2719-4c98-956f-d68f0c98f9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:24.316806 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1241/2497] 10.222.0.76 () {58 vars in 967 bytes} [Mon May 16 15:27:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:24.447451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d21541-31ff-4c43-a86a-1b088bcc13ef service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:24.447451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e3d21541-31ff-4c43-a86a-1b088bcc13ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:24.536965 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d21541-31ff-4c43-a86a-1b088bcc13ef service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:24.542826 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37430e-9f26-412c-8410-b91ad903e054 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33470e30760842ca9e96bb7f0cf9f07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:24.543600 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37430e-9f26-412c-8410-b91ad903e054 service swift] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:24.543885 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37430e-9f26-412c-8410-b91ad903e054 service swift] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:24.544164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37430e-9f26-412c-8410-b91ad903e054 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:24.552836 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37430e-9f26-412c-8410-b91ad903e054 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:24.554596 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37430e-9f26-412c-8410-b91ad903e054 service swift] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:24.563425 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1257/2498] 10.222.0.76 () {60 vars in 1384 bytes} [Mon May 16 15:27:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:27:26.328197 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a8944-2719-4c98-956f-d68f0c98f9c7 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:26.395818 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a8944-2719-4c98-956f-d68f0c98f9c7 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:26.401464 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371007a-d1df-42e6-8443-a32379175bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:26.402443 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371007a-d1df-42e6-8443-a32379175bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:26.402724 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371007a-d1df-42e6-8443-a32379175bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:26.402997 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371007a-d1df-42e6-8443-a32379175bbd admin admin] PATH_INFO: `/v3/users/7303616e51cd4a16bb827a199f5ce6a5` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:26.404178 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371007a-d1df-42e6-8443-a32379175bbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7303616e51cd4a16bb827a199f5ce6a5)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:26.406098 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371007a-d1df-42e6-8443-a32379175bbd admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:26.626395 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5371007a-d1df-42e6-8443-a32379175bbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7303616e51cd4a16bb827a199f5ce6a5'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:26.719006 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5371007a-d1df-42e6-8443-a32379175bbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7303616e51cd4a16bb827a199f5ce6a5'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:26.719677 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5371007a-d1df-42e6-8443-a32379175bbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7303616e51cd4a16bb827a199f5ce6a5'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:26.733006 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5371007a-d1df-42e6-8443-a32379175bbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7303616e51cd4a16bb827a199f5ce6a5'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:26.733746 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-5371007a-d1df-42e6-8443-a32379175bbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7303616e51cd4a16bb827a199f5ce6a5'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:26.746518 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1242/2499] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:27:26 2022] DELETE /identity/v3/users/7303616e51cd4a16bb827a199f5ce6a5 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:26.751303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35c0ed-4a87-4b09-ba7e-b25d44ea533b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:26.751830 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35c0ed-4a87-4b09-ba7e-b25d44ea533b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:26.751830 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35c0ed-4a87-4b09-ba7e-b25d44ea533b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:26.770525 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-2d35c0ed-4a87-4b09-ba7e-b25d44ea533b None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:26.771748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2d35c0ed-4a87-4b09-ba7e-b25d44ea533b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:26.832763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1258/2500] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:26.843465 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371007a-d1df-42e6-8443-a32379175bbd admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:26.844948 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5371007a-d1df-42e6-8443-a32379175bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:26.905605 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371007a-d1df-42e6-8443-a32379175bbd admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:26.909298 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f555ff-6219-44e3-8b53-d9b74892b308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:26.909965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f555ff-6219-44e3-8b53-d9b74892b308 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:26.910307 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f555ff-6219-44e3-8b53-d9b74892b308 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:26.910596 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f555ff-6219-44e3-8b53-d9b74892b308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:26.920293 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f555ff-6219-44e3-8b53-d9b74892b308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:26.921818 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f555ff-6219-44e3-8b53-d9b74892b308 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:26.931720 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1243/2501] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:27:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:27.413841 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35c0ed-4a87-4b09-ba7e-b25d44ea533b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:27.415836 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2d35c0ed-4a87-4b09-ba7e-b25d44ea533b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:27.437805 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35c0ed-4a87-4b09-ba7e-b25d44ea533b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:27.445775 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb641da7-888b-4a08-af2c-f5d9dc15d495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:27.447034 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb641da7-888b-4a08-af2c-f5d9dc15d495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:27.451980 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb641da7-888b-4a08-af2c-f5d9dc15d495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:27.451980 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb641da7-888b-4a08-af2c-f5d9dc15d495 admin admin] PATH_INFO: `/v3/projects/2f674bb0fa8b4d019cb9925c7c916fc3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:27.451980 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb641da7-888b-4a08-af2c-f5d9dc15d495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f674bb0fa8b4d019cb9925c7c916fc3)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:27.451980 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb641da7-888b-4a08-af2c-f5d9dc15d495 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:27.568486 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-eb641da7-888b-4a08-af2c-f5d9dc15d495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f674bb0fa8b4d019cb9925c7c916fc3', 'request_id': 'req-eb641da7-888b-4a08-af2c-f5d9dc15d495'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:27.575241 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-eb641da7-888b-4a08-af2c-f5d9dc15d495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f674bb0fa8b4d019cb9925c7c916fc3', 'request_id': 'req-eb641da7-888b-4a08-af2c-f5d9dc15d495'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:27.663585 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-eb641da7-888b-4a08-af2c-f5d9dc15d495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f674bb0fa8b4d019cb9925c7c916fc3', 'request_id': 'req-eb641da7-888b-4a08-af2c-f5d9dc15d495'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:27.675534 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-eb641da7-888b-4a08-af2c-f5d9dc15d495 admin admin] The token cache is being invalidate because project 2f674bb0fa8b4d019cb9925c7c916fc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:27:27.676089 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-eb641da7-888b-4a08-af2c-f5d9dc15d495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:27.676889 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-eb641da7-888b-4a08-af2c-f5d9dc15d495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:27.682880 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1259/2502] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:27:27 2022] DELETE /identity/v3/projects/2f674bb0fa8b4d019cb9925c7c916fc3 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:27.684115 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f555ff-6219-44e3-8b53-d9b74892b308 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:27.711644 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f555ff-6219-44e3-8b53-d9b74892b308 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:27.775827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1242158-4127-4e1c-9342-37ddbf3d637a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:27.777636 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1242158-4127-4e1c-9342-37ddbf3d637a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:27.777977 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1242158-4127-4e1c-9342-37ddbf3d637a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:27.778349 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1242158-4127-4e1c-9342-37ddbf3d637a admin admin] PATH_INFO: `/v3/users/13b77c5fa6ff4f5298b36f8c136149b3` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:27.779622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1242158-4127-4e1c-9342-37ddbf3d637a admin admin] RBAC: Authorizing `identity:delete_user(user_id=13b77c5fa6ff4f5298b36f8c136149b3)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:27.782054 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1242158-4127-4e1c-9342-37ddbf3d637a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:27.968188 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b1242158-4127-4e1c-9342-37ddbf3d637a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13b77c5fa6ff4f5298b36f8c136149b3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:28.038558 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b1242158-4127-4e1c-9342-37ddbf3d637a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13b77c5fa6ff4f5298b36f8c136149b3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:28.039165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b1242158-4127-4e1c-9342-37ddbf3d637a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13b77c5fa6ff4f5298b36f8c136149b3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:28.052002 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b1242158-4127-4e1c-9342-37ddbf3d637a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13b77c5fa6ff4f5298b36f8c136149b3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:28.052587 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b1242158-4127-4e1c-9342-37ddbf3d637a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13b77c5fa6ff4f5298b36f8c136149b3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:28.064976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1244/2503] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:27:27 2022] DELETE /identity/v3/users/13b77c5fa6ff4f5298b36f8c136149b3 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:28.724055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb641da7-888b-4a08-af2c-f5d9dc15d495 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:28.726333 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-eb641da7-888b-4a08-af2c-f5d9dc15d495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:28.742239 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb641da7-888b-4a08-af2c-f5d9dc15d495 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:28.807895 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880df37b-e39a-421d-9ce0-1a086f82fbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:28.809303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880df37b-e39a-421d-9ce0-1a086f82fbaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:28.809732 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880df37b-e39a-421d-9ce0-1a086f82fbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:28.810201 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880df37b-e39a-421d-9ce0-1a086f82fbaf admin admin] PATH_INFO: `/v3/projects/e57430014f9a4799b8d37bf224d281cb` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:28.811619 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880df37b-e39a-421d-9ce0-1a086f82fbaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e57430014f9a4799b8d37bf224d281cb)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:28.814324 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880df37b-e39a-421d-9ce0-1a086f82fbaf admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:28.950173 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-880df37b-e39a-421d-9ce0-1a086f82fbaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e57430014f9a4799b8d37bf224d281cb', 'request_id': 'req-880df37b-e39a-421d-9ce0-1a086f82fbaf'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:28.957052 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-880df37b-e39a-421d-9ce0-1a086f82fbaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e57430014f9a4799b8d37bf224d281cb', 'request_id': 'req-880df37b-e39a-421d-9ce0-1a086f82fbaf'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:29.029751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-880df37b-e39a-421d-9ce0-1a086f82fbaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e57430014f9a4799b8d37bf224d281cb', 'request_id': 'req-880df37b-e39a-421d-9ce0-1a086f82fbaf'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:29.044363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-880df37b-e39a-421d-9ce0-1a086f82fbaf admin admin] The token cache is being invalidate because project e57430014f9a4799b8d37bf224d281cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:27:29.044610 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-880df37b-e39a-421d-9ce0-1a086f82fbaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:29.045352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-880df37b-e39a-421d-9ce0-1a086f82fbaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:29.046951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1260/2504] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:27:28 2022] DELETE /identity/v3/projects/e57430014f9a4799b8d37bf224d281cb => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:29.052356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca407a-69e7-4fb4-8338-b6d631e083fa None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:29.052874 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca407a-69e7-4fb4-8338-b6d631e083fa None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:29.053158 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca407a-69e7-4fb4-8338-b6d631e083fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:29.071245 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-72ca407a-69e7-4fb4-8338-b6d631e083fa None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:29.072540 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-72ca407a-69e7-4fb4-8338-b6d631e083fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:29.138756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1245/2505] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:29.146599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976f5c2-0654-4865-974f-7c6934630ce9 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:29.146977 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976f5c2-0654-4865-974f-7c6934630ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:29.147329 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976f5c2-0654-4865-974f-7c6934630ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:29.169565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b976f5c2-0654-4865-974f-7c6934630ce9 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:29.171154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b976f5c2-0654-4865-974f-7c6934630ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:29.179877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1261/2506] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:29.184428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca407a-69e7-4fb4-8338-b6d631e083fa None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:29.202412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca407a-69e7-4fb4-8338-b6d631e083fa None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:29.207844 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f77337-00e0-4b39-bf69-28d4f00d3df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:29.208586 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f77337-00e0-4b39-bf69-28d4f00d3df3 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:29.208933 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f77337-00e0-4b39-bf69-28d4f00d3df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:29.209297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f77337-00e0-4b39-bf69-28d4f00d3df3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:29.210087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f77337-00e0-4b39-bf69-28d4f00d3df3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:27:29.210497 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f77337-00e0-4b39-bf69-28d4f00d3df3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:29.212191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f77337-00e0-4b39-bf69-28d4f00d3df3 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:29.228635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1246/2507] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:27:29.233063 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976f5c2-0654-4865-974f-7c6934630ce9 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:29.242486 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976f5c2-0654-4865-974f-7c6934630ce9 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:29.247873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966116e-9665-4e22-92f8-616b2a393961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:29.248526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966116e-9665-4e22-92f8-616b2a393961 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:29.248809 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966116e-9665-4e22-92f8-616b2a393961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:29.249086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966116e-9665-4e22-92f8-616b2a393961 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:29.249783 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966116e-9665-4e22-92f8-616b2a393961 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:29.251741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966116e-9665-4e22-92f8-616b2a393961 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:29.360869 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1262/2508] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:27:29 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:27:29.360973 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f77337-00e0-4b39-bf69-28d4f00d3df3 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:29.370981 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f77337-00e0-4b39-bf69-28d4f00d3df3 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:29.427703 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e342e750-fc28-4129-9ecd-0876d724a92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:29.428369 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342e750-fc28-4129-9ecd-0876d724a92c admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:29.429067 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342e750-fc28-4129-9ecd-0876d724a92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:29.429067 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342e750-fc28-4129-9ecd-0876d724a92c admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:29.429712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e342e750-fc28-4129-9ecd-0876d724a92c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:29.431706 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e342e750-fc28-4129-9ecd-0876d724a92c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:29.521548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1247/2509] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:27:29 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:27:29.527450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966116e-9665-4e22-92f8-616b2a393961 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:29.539676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966116e-9665-4e22-92f8-616b2a393961 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:29.545491 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc25d8d-1523-4504-95c0-1b47b37f5a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:29.546565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc25d8d-1523-4504-95c0-1b47b37f5a85 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:29.547047 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc25d8d-1523-4504-95c0-1b47b37f5a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:29.547377 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc25d8d-1523-4504-95c0-1b47b37f5a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:29.549303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc25d8d-1523-4504-95c0-1b47b37f5a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:29.556917 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc25d8d-1523-4504-95c0-1b47b37f5a85 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:29.563428 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1263/2510] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:29.567019 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e342e750-fc28-4129-9ecd-0876d724a92c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:29.578579 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e342e750-fc28-4129-9ecd-0876d724a92c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:29.584481 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c53c9-46e8-4e63-881a-81dd96323174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:29.585559 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c53c9-46e8-4e63-881a-81dd96323174 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:29.586049 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c53c9-46e8-4e63-881a-81dd96323174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:29.586635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c53c9-46e8-4e63-881a-81dd96323174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:29.587559 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c53c9-46e8-4e63-881a-81dd96323174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:29.589512 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c53c9-46e8-4e63-881a-81dd96323174 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:29.602268 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1248/2511] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:29.606612 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc25d8d-1523-4504-95c0-1b47b37f5a85 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:29.618237 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc25d8d-1523-4504-95c0-1b47b37f5a85 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:29.624027 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7fb7f-4478-412d-8d78-338d99fe6150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:29.624907 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7fb7f-4478-412d-8d78-338d99fe6150 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:29.625185 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7fb7f-4478-412d-8d78-338d99fe6150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:29.625484 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7fb7f-4478-412d-8d78-338d99fe6150 admin admin] PATH_INFO: `/v3/projects/a933d1cd5aee43c1bedb3751320dd738/users/3e639b207f824b388c4ccc39f8c5f7a7/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:29.641122 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e7fb7f-4478-412d-8d78-338d99fe6150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a933d1cd5aee43c1bedb3751320dd738, user_id=3e639b207f824b388c4ccc39f8c5f7a7, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:29.643922 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e7fb7f-4478-412d-8d78-338d99fe6150 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:29.750555 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1264/2512] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:27:29 2022] PUT /identity/v3/projects/a933d1cd5aee43c1bedb3751320dd738/users/3e639b207f824b388c4ccc39f8c5f7a7/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:29.761197 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c07dc-50ad-4413-8f38-7ec5e7269053 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:29.761494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c07dc-50ad-4413-8f38-7ec5e7269053 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:29.761782 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c07dc-50ad-4413-8f38-7ec5e7269053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:29.788145 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-652c07dc-50ad-4413-8f38-7ec5e7269053 None None] MFA Rules not processed for user `3e639b207f824b388c4ccc39f8c5f7a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:29.789427 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-652c07dc-50ad-4413-8f38-7ec5e7269053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:29.853171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1249/2513] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:27:29.857855 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7fb7f-4478-412d-8d78-338d99fe6150 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:29.919785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7fb7f-4478-412d-8d78-338d99fe6150 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:29.925102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ed753-b83b-4bff-9ac8-3df1cda49a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:29.925777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ed753-b83b-4bff-9ac8-3df1cda49a62 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:29.926241 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ed753-b83b-4bff-9ac8-3df1cda49a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:29.926430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ed753-b83b-4bff-9ac8-3df1cda49a62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:29.927139 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ed753-b83b-4bff-9ac8-3df1cda49a62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:29.929265 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ed753-b83b-4bff-9ac8-3df1cda49a62 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:30.045539 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1265/2514] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:27:29 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:30.047020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c07dc-50ad-4413-8f38-7ec5e7269053 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:30.057909 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c07dc-50ad-4413-8f38-7ec5e7269053 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:30.112602 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71d177-545e-4a04-b72a-de0f6a769fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:30.113429 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71d177-545e-4a04-b72a-de0f6a769fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:30.113719 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71d177-545e-4a04-b72a-de0f6a769fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:30.114067 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71d177-545e-4a04-b72a-de0f6a769fa3 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:30.114819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71d177-545e-4a04-b72a-de0f6a769fa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:30.116815 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71d177-545e-4a04-b72a-de0f6a769fa3 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:30.250201 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1250/2515] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:27:30 2022] POST /identity/v3/users => generated 300 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:30.251413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ed753-b83b-4bff-9ac8-3df1cda49a62 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:30.262084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ed753-b83b-4bff-9ac8-3df1cda49a62 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:30.266575 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e65e34-ae79-480d-a4ed-99cac24ba110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:30.267232 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e65e34-ae79-480d-a4ed-99cac24ba110 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:30.267515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e65e34-ae79-480d-a4ed-99cac24ba110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:30.267786 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e65e34-ae79-480d-a4ed-99cac24ba110 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:30.268506 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e65e34-ae79-480d-a4ed-99cac24ba110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:30.270106 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e65e34-ae79-480d-a4ed-99cac24ba110 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:30.281978 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1266/2516] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:30.286108 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71d177-545e-4a04-b72a-de0f6a769fa3 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:30.296382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71d177-545e-4a04-b72a-de0f6a769fa3 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:30.301169 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6e1d5-c444-47e8-a021-db248cae96b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:30.302044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6e1d5-c444-47e8-a021-db248cae96b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:30.302358 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6e1d5-c444-47e8-a021-db248cae96b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:30.302638 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6e1d5-c444-47e8-a021-db248cae96b6 admin admin] PATH_INFO: `/v3/projects/5564bcc57ddf43fa9e8f0319b7c34cdb/users/5a1c0ad1ed104bbc8dbdc424425359e3/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:30.319252 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6e1d5-c444-47e8-a021-db248cae96b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5564bcc57ddf43fa9e8f0319b7c34cdb, user_id=5a1c0ad1ed104bbc8dbdc424425359e3, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:30.321907 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6e1d5-c444-47e8-a021-db248cae96b6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:30.419264 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1251/2517] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:27:30 2022] PUT /identity/v3/projects/5564bcc57ddf43fa9e8f0319b7c34cdb/users/5a1c0ad1ed104bbc8dbdc424425359e3/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:27:30.423169 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e65e34-ae79-480d-a4ed-99cac24ba110 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:30.434615 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e65e34-ae79-480d-a4ed-99cac24ba110 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:30.500290 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347a7c0-daf9-4fbf-8c12-f582130e7c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:30.501061 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347a7c0-daf9-4fbf-8c12-f582130e7c3e admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:30.501557 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347a7c0-daf9-4fbf-8c12-f582130e7c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:30.501904 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347a7c0-daf9-4fbf-8c12-f582130e7c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:30.502748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347a7c0-daf9-4fbf-8c12-f582130e7c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:30.504591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347a7c0-daf9-4fbf-8c12-f582130e7c3e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:30.517007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1267/2518] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:30.521148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6e1d5-c444-47e8-a021-db248cae96b6 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:30.537856 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6e1d5-c444-47e8-a021-db248cae96b6 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:30.544001 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6432419-81e0-4420-aac4-310ff2dfd310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:30.544971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6432419-81e0-4420-aac4-310ff2dfd310 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:30.545289 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6432419-81e0-4420-aac4-310ff2dfd310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:30.545563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6432419-81e0-4420-aac4-310ff2dfd310 admin admin] PATH_INFO: `/v3/projects/5564bcc57ddf43fa9e8f0319b7c34cdb/users/5a1c0ad1ed104bbc8dbdc424425359e3/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:30.547678 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6432419-81e0-4420-aac4-310ff2dfd310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5564bcc57ddf43fa9e8f0319b7c34cdb, user_id=5a1c0ad1ed104bbc8dbdc424425359e3, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:30.550530 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6432419-81e0-4420-aac4-310ff2dfd310 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:30.567040 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1252/2519] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:27:30 2022] PUT /identity/v3/projects/5564bcc57ddf43fa9e8f0319b7c34cdb/users/5a1c0ad1ed104bbc8dbdc424425359e3/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:30.579124 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3293b3a-490f-4d39-84bf-93938226189f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:30.579416 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3293b3a-490f-4d39-84bf-93938226189f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:30.579698 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3293b3a-490f-4d39-84bf-93938226189f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:30.613907 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c3293b3a-490f-4d39-84bf-93938226189f None None] MFA Rules not processed for user `5a1c0ad1ed104bbc8dbdc424425359e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:30.615191 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c3293b3a-490f-4d39-84bf-93938226189f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:30.686859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1268/2520] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:30.697876 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6432419-81e0-4420-aac4-310ff2dfd310 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:30.699585 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a6432419-81e0-4420-aac4-310ff2dfd310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:30.754795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6432419-81e0-4420-aac4-310ff2dfd310 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:30.758660 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4e6f0-d828-499b-9234-d97f080fadde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:30.759302 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4e6f0-d828-499b-9234-d97f080fadde service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:30.759580 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4e6f0-d828-499b-9234-d97f080fadde service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:30.759855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4e6f0-d828-499b-9234-d97f080fadde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:30.768839 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe4e6f0-d828-499b-9234-d97f080fadde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:30.770315 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe4e6f0-d828-499b-9234-d97f080fadde service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:30.780079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1253/2521] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:27:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:30.842224 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3293b3a-490f-4d39-84bf-93938226189f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:30.908434 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3293b3a-490f-4d39-84bf-93938226189f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:30.913296 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497ca4b-28e5-43ac-92f8-f49a8292f3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:30.914089 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497ca4b-28e5-43ac-92f8-f49a8292f3af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:30.914391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497ca4b-28e5-43ac-92f8-f49a8292f3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:30.914668 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497ca4b-28e5-43ac-92f8-f49a8292f3af admin admin] PATH_INFO: `/v3/users/3e639b207f824b388c4ccc39f8c5f7a7` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:30.916130 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497ca4b-28e5-43ac-92f8-f49a8292f3af admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e639b207f824b388c4ccc39f8c5f7a7)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:30.918418 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497ca4b-28e5-43ac-92f8-f49a8292f3af admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:31.049542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f497ca4b-28e5-43ac-92f8-f49a8292f3af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e639b207f824b388c4ccc39f8c5f7a7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:31.061994 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f497ca4b-28e5-43ac-92f8-f49a8292f3af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e639b207f824b388c4ccc39f8c5f7a7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:31.062770 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f497ca4b-28e5-43ac-92f8-f49a8292f3af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e639b207f824b388c4ccc39f8c5f7a7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:31.063383 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f497ca4b-28e5-43ac-92f8-f49a8292f3af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e639b207f824b388c4ccc39f8c5f7a7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:31.070429 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f497ca4b-28e5-43ac-92f8-f49a8292f3af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e639b207f824b388c4ccc39f8c5f7a7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:31.159589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1269/2522] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:27:30 2022] DELETE /identity/v3/users/3e639b207f824b388c4ccc39f8c5f7a7 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:31.168522 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e830fc4-812a-4259-9200-162da16ab884 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:31.169076 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e830fc4-812a-4259-9200-162da16ab884 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:31.169279 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e830fc4-812a-4259-9200-162da16ab884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:31.189665 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-8e830fc4-812a-4259-9200-162da16ab884 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:31.191007 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8e830fc4-812a-4259-9200-162da16ab884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:31.254164 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1254/2523] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:31.265766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497ca4b-28e5-43ac-92f8-f49a8292f3af admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:31.267821 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f497ca4b-28e5-43ac-92f8-f49a8292f3af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:31.337544 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497ca4b-28e5-43ac-92f8-f49a8292f3af admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:31.340240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6ba1c-c2a6-4e85-943f-4fa99d210119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:31.340886 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6ba1c-c2a6-4e85-943f-4fa99d210119 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:31.341172 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6ba1c-c2a6-4e85-943f-4fa99d210119 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:31.341449 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6ba1c-c2a6-4e85-943f-4fa99d210119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:31.352427 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6ba1c-c2a6-4e85-943f-4fa99d210119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:31.354046 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6ba1c-c2a6-4e85-943f-4fa99d210119 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:31.365139 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1270/2524] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:27:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:31.888977 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e830fc4-812a-4259-9200-162da16ab884 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:31.890788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8e830fc4-812a-4259-9200-162da16ab884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:31.905529 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e830fc4-812a-4259-9200-162da16ab884 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:31.915938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9478b16-6e36-4366-ad0c-ac1f74288b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:31.918599 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9478b16-6e36-4366-ad0c-ac1f74288b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:31.918599 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9478b16-6e36-4366-ad0c-ac1f74288b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:31.918599 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9478b16-6e36-4366-ad0c-ac1f74288b46 admin admin] PATH_INFO: `/v3/projects/a933d1cd5aee43c1bedb3751320dd738` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:31.922776 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9478b16-6e36-4366-ad0c-ac1f74288b46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a933d1cd5aee43c1bedb3751320dd738)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:31.928428 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9478b16-6e36-4366-ad0c-ac1f74288b46 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:32.070024 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e9478b16-6e36-4366-ad0c-ac1f74288b46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a933d1cd5aee43c1bedb3751320dd738', 'request_id': 'req-e9478b16-6e36-4366-ad0c-ac1f74288b46'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:32.141708 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e9478b16-6e36-4366-ad0c-ac1f74288b46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a933d1cd5aee43c1bedb3751320dd738', 'request_id': 'req-e9478b16-6e36-4366-ad0c-ac1f74288b46'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:32.149215 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e9478b16-6e36-4366-ad0c-ac1f74288b46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a933d1cd5aee43c1bedb3751320dd738', 'request_id': 'req-e9478b16-6e36-4366-ad0c-ac1f74288b46'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:32.160434 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e9478b16-6e36-4366-ad0c-ac1f74288b46 admin admin] The token cache is being invalidate because project a933d1cd5aee43c1bedb3751320dd738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:27:32.160730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e9478b16-6e36-4366-ad0c-ac1f74288b46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:32.161394 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e9478b16-6e36-4366-ad0c-ac1f74288b46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:32.163391 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1255/2525] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:27:31 2022] DELETE /identity/v3/projects/a933d1cd5aee43c1bedb3751320dd738 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:27:32.167414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6ba1c-c2a6-4e85-943f-4fa99d210119 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:32.177555 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6ba1c-c2a6-4e85-943f-4fa99d210119 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:32.252492 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276225f-60ca-47ac-933f-39b543525047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:32.253374 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276225f-60ca-47ac-933f-39b543525047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:32.253657 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276225f-60ca-47ac-933f-39b543525047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:32.254179 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276225f-60ca-47ac-933f-39b543525047 admin admin] PATH_INFO: `/v3/users/5a1c0ad1ed104bbc8dbdc424425359e3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:32.255427 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276225f-60ca-47ac-933f-39b543525047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a1c0ad1ed104bbc8dbdc424425359e3)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:32.257650 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276225f-60ca-47ac-933f-39b543525047 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:32.436894 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a276225f-60ca-47ac-933f-39b543525047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a1c0ad1ed104bbc8dbdc424425359e3'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:32.450818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a276225f-60ca-47ac-933f-39b543525047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a1c0ad1ed104bbc8dbdc424425359e3'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:32.451554 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a276225f-60ca-47ac-933f-39b543525047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a1c0ad1ed104bbc8dbdc424425359e3'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:32.452166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a276225f-60ca-47ac-933f-39b543525047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a1c0ad1ed104bbc8dbdc424425359e3'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:32.459376 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a276225f-60ca-47ac-933f-39b543525047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a1c0ad1ed104bbc8dbdc424425359e3'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:32.541598 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1271/2526] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:27:32 2022] DELETE /identity/v3/users/5a1c0ad1ed104bbc8dbdc424425359e3 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:33.102249 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9478b16-6e36-4366-ad0c-ac1f74288b46 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:33.104995 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e9478b16-6e36-4366-ad0c-ac1f74288b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:33.125370 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9478b16-6e36-4366-ad0c-ac1f74288b46 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:33.187367 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eab563-9a34-4d7b-8dd7-ae660d11a6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:33.188367 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eab563-9a34-4d7b-8dd7-ae660d11a6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:33.188833 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eab563-9a34-4d7b-8dd7-ae660d11a6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:33.189177 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eab563-9a34-4d7b-8dd7-ae660d11a6c6 admin admin] PATH_INFO: `/v3/projects/5564bcc57ddf43fa9e8f0319b7c34cdb` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:33.190541 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eab563-9a34-4d7b-8dd7-ae660d11a6c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5564bcc57ddf43fa9e8f0319b7c34cdb)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:33.192571 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eab563-9a34-4d7b-8dd7-ae660d11a6c6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:33.373256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c7eab563-9a34-4d7b-8dd7-ae660d11a6c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5564bcc57ddf43fa9e8f0319b7c34cdb', 'request_id': 'req-c7eab563-9a34-4d7b-8dd7-ae660d11a6c6'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:33.440903 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c7eab563-9a34-4d7b-8dd7-ae660d11a6c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5564bcc57ddf43fa9e8f0319b7c34cdb', 'request_id': 'req-c7eab563-9a34-4d7b-8dd7-ae660d11a6c6'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:33.448476 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c7eab563-9a34-4d7b-8dd7-ae660d11a6c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5564bcc57ddf43fa9e8f0319b7c34cdb', 'request_id': 'req-c7eab563-9a34-4d7b-8dd7-ae660d11a6c6'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:33.458553 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c7eab563-9a34-4d7b-8dd7-ae660d11a6c6 admin admin] The token cache is being invalidate because project 5564bcc57ddf43fa9e8f0319b7c34cdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:27:33.458844 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c7eab563-9a34-4d7b-8dd7-ae660d11a6c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:33.459482 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-c7eab563-9a34-4d7b-8dd7-ae660d11a6c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:33.461023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1256/2527] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:27:33 2022] DELETE /identity/v3/projects/5564bcc57ddf43fa9e8f0319b7c34cdb => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:33.466451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f652eb-fea5-42a0-963a-2eff3067cce5 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:33.466919 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f652eb-fea5-42a0-963a-2eff3067cce5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:33.467204 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f652eb-fea5-42a0-963a-2eff3067cce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:33.500113 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eab563-9a34-4d7b-8dd7-ae660d11a6c6 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:33.501593 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c2f652eb-fea5-42a0-963a-2eff3067cce5 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:33.502485 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c7eab563-9a34-4d7b-8dd7-ae660d11a6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:33.509011 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c2f652eb-fea5-42a0-963a-2eff3067cce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:33.583732 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1272/2528] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:33.592036 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b9bc1-6852-49c2-ae4f-e8455bf0d3bd None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:33.593000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b9bc1-6852-49c2-ae4f-e8455bf0d3bd None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:33.599553 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b9bc1-6852-49c2-ae4f-e8455bf0d3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:33.607663 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eab563-9a34-4d7b-8dd7-ae660d11a6c6 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:33.614892 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb61321-3efe-4f98-8e3b-1a8f5074659c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:33.615780 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ca9b9bc1-6852-49c2-ae4f-e8455bf0d3bd None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:33.615920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb61321-3efe-4f98-8e3b-1a8f5074659c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:33.616064 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb61321-3efe-4f98-8e3b-1a8f5074659c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:33.616347 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb61321-3efe-4f98-8e3b-1a8f5074659c admin admin] PATH_INFO: `/v3/users/816ac740698548b1b25826fe5168a62a` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:33.617276 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ca9b9bc1-6852-49c2-ae4f-e8455bf0d3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:33.617573 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb61321-3efe-4f98-8e3b-1a8f5074659c admin admin] RBAC: Authorizing `identity:delete_user(user_id=816ac740698548b1b25826fe5168a62a)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:33.619638 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb61321-3efe-4f98-8e3b-1a8f5074659c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:33.628984 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1273/2529] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:33.634114 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b9bc1-6852-49c2-ae4f-e8455bf0d3bd None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:33.652533 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b9bc1-6852-49c2-ae4f-e8455bf0d3bd None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:33.657449 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bccd02-0c45-434f-bd59-9ad217101e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:33.658112 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bccd02-0c45-434f-bd59-9ad217101e6d admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:33.658432 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bccd02-0c45-434f-bd59-9ad217101e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:33.658709 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bccd02-0c45-434f-bd59-9ad217101e6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:33.659441 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bccd02-0c45-434f-bd59-9ad217101e6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:27:33.659748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bccd02-0c45-434f-bd59-9ad217101e6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:33.661354 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bccd02-0c45-434f-bd59-9ad217101e6d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:33.674224 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1274/2530] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:27:33.677912 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bccd02-0c45-434f-bd59-9ad217101e6d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:33.688474 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bccd02-0c45-434f-bd59-9ad217101e6d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:33.693598 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42833536-3c4b-4c98-8362-51fc87433bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:33.694292 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42833536-3c4b-4c98-8362-51fc87433bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:33.694578 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42833536-3c4b-4c98-8362-51fc87433bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:33.694883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42833536-3c4b-4c98-8362-51fc87433bc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:33.695568 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42833536-3c4b-4c98-8362-51fc87433bc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:33.697480 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42833536-3c4b-4c98-8362-51fc87433bc2 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:33.926431 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1275/2531] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:27:33 2022] POST /identity/v3/projects => generated 391 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:33.930322 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42833536-3c4b-4c98-8362-51fc87433bc2 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:33.960259 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-cfb61321-3efe-4f98-8e3b-1a8f5074659c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '816ac740698548b1b25826fe5168a62a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:34.005272 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42833536-3c4b-4c98-8362-51fc87433bc2 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:34.010459 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6faa93-87c1-489a-8a6d-b23c0f49aa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:34.011311 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6faa93-87c1-489a-8a6d-b23c0f49aa1a admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:34.011597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6faa93-87c1-489a-8a6d-b23c0f49aa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:34.011988 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6faa93-87c1-489a-8a6d-b23c0f49aa1a admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:34.012691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6faa93-87c1-489a-8a6d-b23c0f49aa1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:34.014642 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6faa93-87c1-489a-8a6d-b23c0f49aa1a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:34.058807 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-cfb61321-3efe-4f98-8e3b-1a8f5074659c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '816ac740698548b1b25826fe5168a62a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:34.059498 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-cfb61321-3efe-4f98-8e3b-1a8f5074659c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '816ac740698548b1b25826fe5168a62a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:34.072056 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-cfb61321-3efe-4f98-8e3b-1a8f5074659c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '816ac740698548b1b25826fe5168a62a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:34.072828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-cfb61321-3efe-4f98-8e3b-1a8f5074659c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '816ac740698548b1b25826fe5168a62a'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:34.087761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1257/2532] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:27:33 2022] DELETE /identity/v3/users/816ac740698548b1b25826fe5168a62a => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:34.127586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1276/2533] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:27:33 2022] POST /identity/v3/users => generated 296 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:34.131938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb61321-3efe-4f98-8e3b-1a8f5074659c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:34.133343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-cfb61321-3efe-4f98-8e3b-1a8f5074659c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:34.211496 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb61321-3efe-4f98-8e3b-1a8f5074659c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:34.219561 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3be20-47bc-4d06-9cc9-d2d50898b842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:34.220239 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3be20-47bc-4d06-9cc9-d2d50898b842 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:34.220525 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3be20-47bc-4d06-9cc9-d2d50898b842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:34.220807 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3be20-47bc-4d06-9cc9-d2d50898b842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:34.221972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3be20-47bc-4d06-9cc9-d2d50898b842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:34.223496 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3be20-47bc-4d06-9cc9-d2d50898b842 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:34.238402 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1258/2534] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:34.239738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6faa93-87c1-489a-8a6d-b23c0f49aa1a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:34.250709 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6faa93-87c1-489a-8a6d-b23c0f49aa1a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:34.255664 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3250b-58aa-4842-95cb-af5229ca71b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:34.256822 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3250b-58aa-4842-95cb-af5229ca71b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:34.257064 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3250b-58aa-4842-95cb-af5229ca71b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:34.257336 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3250b-58aa-4842-95cb-af5229ca71b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:34.258067 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3250b-58aa-4842-95cb-af5229ca71b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:34.259696 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3250b-58aa-4842-95cb-af5229ca71b2 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:34.270057 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1277/2535] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:27:34.274571 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3be20-47bc-4d06-9cc9-d2d50898b842 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:34.285392 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3be20-47bc-4d06-9cc9-d2d50898b842 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:34.290023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea110a15-f250-4080-8c7e-e5e3c6ecd161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:34.290969 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea110a15-f250-4080-8c7e-e5e3c6ecd161 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:34.291248 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea110a15-f250-4080-8c7e-e5e3c6ecd161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:34.291513 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea110a15-f250-4080-8c7e-e5e3c6ecd161 admin admin] PATH_INFO: `/v3/projects/464e0ba9863847a78cb7babeb4a2e5f8/users/c8555bff3b09414aafccae6e25da6c7b/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:34.306880 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea110a15-f250-4080-8c7e-e5e3c6ecd161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=464e0ba9863847a78cb7babeb4a2e5f8, user_id=c8555bff3b09414aafccae6e25da6c7b, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:34.309604 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea110a15-f250-4080-8c7e-e5e3c6ecd161 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:34.404489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3250b-58aa-4842-95cb-af5229ca71b2 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:34.404489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-69b3250b-58aa-4842-95cb-af5229ca71b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:34.414465 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1259/2536] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:27:34 2022] PUT /identity/v3/projects/464e0ba9863847a78cb7babeb4a2e5f8/users/c8555bff3b09414aafccae6e25da6c7b/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:34.422071 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3250b-58aa-4842-95cb-af5229ca71b2 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:34.425738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87942e7f-de8a-4083-b0e0-2c6f5cd96021 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:34.426077 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87942e7f-de8a-4083-b0e0-2c6f5cd96021 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:34.426429 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87942e7f-de8a-4083-b0e0-2c6f5cd96021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:34.462641 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-87942e7f-de8a-4083-b0e0-2c6f5cd96021 None None] MFA Rules not processed for user `c8555bff3b09414aafccae6e25da6c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:34.465495 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-87942e7f-de8a-4083-b0e0-2c6f5cd96021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:34.518294 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a03c8c-974d-4ef9-b3db-939a8826f3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:34.519500 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a03c8c-974d-4ef9-b3db-939a8826f3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:34.519886 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a03c8c-974d-4ef9-b3db-939a8826f3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:34.520270 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a03c8c-974d-4ef9-b3db-939a8826f3e4 admin admin] PATH_INFO: `/v3/projects/65e5f9f015814278b1062e2d7d681cc5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:34.521777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a03c8c-974d-4ef9-b3db-939a8826f3e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65e5f9f015814278b1062e2d7d681cc5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:34.524072 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a03c8c-974d-4ef9-b3db-939a8826f3e4 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:34.559544 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1260/2537] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:27:34.560541 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87942e7f-de8a-4083-b0e0-2c6f5cd96021 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:34.571260 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87942e7f-de8a-4083-b0e0-2c6f5cd96021 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:34.575902 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dc7c8-9d98-4f59-a798-66aa801e1e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:34.576559 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dc7c8-9d98-4f59-a798-66aa801e1e39 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:34.576836 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dc7c8-9d98-4f59-a798-66aa801e1e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:34.577107 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dc7c8-9d98-4f59-a798-66aa801e1e39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:34.577789 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dc7c8-9d98-4f59-a798-66aa801e1e39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:34.579723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dc7c8-9d98-4f59-a798-66aa801e1e39 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:34.709755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-27a03c8c-974d-4ef9-b3db-939a8826f3e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65e5f9f015814278b1062e2d7d681cc5', 'request_id': 'req-27a03c8c-974d-4ef9-b3db-939a8826f3e4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:34.716391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-27a03c8c-974d-4ef9-b3db-939a8826f3e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65e5f9f015814278b1062e2d7d681cc5', 'request_id': 'req-27a03c8c-974d-4ef9-b3db-939a8826f3e4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:34.730288 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1261/2538] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:27:34 2022] POST /identity/v3/projects => generated 393 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:34.731683 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dc7c8-9d98-4f59-a798-66aa801e1e39 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:34.791344 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dc7c8-9d98-4f59-a798-66aa801e1e39 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:34.796719 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156d2b3-b0ae-4426-a84a-e94052acb564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:34.797435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156d2b3-b0ae-4426-a84a-e94052acb564 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:34.797713 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156d2b3-b0ae-4426-a84a-e94052acb564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:34.797993 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156d2b3-b0ae-4426-a84a-e94052acb564 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:34.798447 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-27a03c8c-974d-4ef9-b3db-939a8826f3e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65e5f9f015814278b1062e2d7d681cc5', 'request_id': 'req-27a03c8c-974d-4ef9-b3db-939a8826f3e4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:34.798698 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156d2b3-b0ae-4426-a84a-e94052acb564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:34.800612 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156d2b3-b0ae-4426-a84a-e94052acb564 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:34.809366 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-27a03c8c-974d-4ef9-b3db-939a8826f3e4 admin admin] The token cache is being invalidate because project 65e5f9f015814278b1062e2d7d681cc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:27:34.809739 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-27a03c8c-974d-4ef9-b3db-939a8826f3e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:34.810500 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-27a03c8c-974d-4ef9-b3db-939a8826f3e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:34.812087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1278/2539] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:27:34 2022] DELETE /identity/v3/projects/65e5f9f015814278b1062e2d7d681cc5 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:34.816027 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a03c8c-974d-4ef9-b3db-939a8826f3e4 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:34.817436 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-27a03c8c-974d-4ef9-b3db-939a8826f3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:34.882543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a03c8c-974d-4ef9-b3db-939a8826f3e4 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:34.887736 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899bb02-d7d2-4148-81e4-a51911f4018a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:34.888599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899bb02-d7d2-4148-81e4-a51911f4018a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:34.888882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899bb02-d7d2-4148-81e4-a51911f4018a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:34.889158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899bb02-d7d2-4148-81e4-a51911f4018a admin admin] PATH_INFO: `/v3/users/13195494ed564e0594dbffebf6b81d46` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:34.890396 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899bb02-d7d2-4148-81e4-a51911f4018a admin admin] RBAC: Authorizing `identity:delete_user(user_id=13195494ed564e0594dbffebf6b81d46)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:34.892321 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899bb02-d7d2-4148-81e4-a51911f4018a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:34.892993 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1262/2540] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:27:34 2022] POST /identity/v3/users => generated 303 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:27:34.896893 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156d2b3-b0ae-4426-a84a-e94052acb564 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:34.898613 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f156d2b3-b0ae-4426-a84a-e94052acb564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:34.910983 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156d2b3-b0ae-4426-a84a-e94052acb564 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:34.915650 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a212a-9a0d-4c6f-909a-7be59d79971e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:34.916307 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a212a-9a0d-4c6f-909a-7be59d79971e admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:34.916596 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a212a-9a0d-4c6f-909a-7be59d79971e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:34.916873 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a212a-9a0d-4c6f-909a-7be59d79971e admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:34.917605 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a212a-9a0d-4c6f-909a-7be59d79971e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:34.919263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a212a-9a0d-4c6f-909a-7be59d79971e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:34.928991 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1263/2541] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:27:34.932954 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a212a-9a0d-4c6f-909a-7be59d79971e admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:34.942249 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a212a-9a0d-4c6f-909a-7be59d79971e admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:34.946817 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd71f16-9684-40b3-b792-89ce52cb777d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:34.947654 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd71f16-9684-40b3-b792-89ce52cb777d admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:34.947942 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd71f16-9684-40b3-b792-89ce52cb777d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:34.948727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd71f16-9684-40b3-b792-89ce52cb777d admin admin] PATH_INFO: `/v3/projects/28d7f9eba89e4d20a3a4fbc22ba7d0b0/users/77df61ccd0a548149a3c8ba1b0a1bc6c/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:34.964378 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd71f16-9684-40b3-b792-89ce52cb777d admin admin] RBAC: Authorizing `identity:create_grant(project_id=28d7f9eba89e4d20a3a4fbc22ba7d0b0, user_id=77df61ccd0a548149a3c8ba1b0a1bc6c, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:34.966168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd71f16-9684-40b3-b792-89ce52cb777d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:35.075817 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1264/2542] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:27:34 2022] PUT /identity/v3/projects/28d7f9eba89e4d20a3a4fbc22ba7d0b0/users/77df61ccd0a548149a3c8ba1b0a1bc6c/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:27:35.079556 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd71f16-9684-40b3-b792-89ce52cb777d admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:35.128564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5899bb02-d7d2-4148-81e4-a51911f4018a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13195494ed564e0594dbffebf6b81d46'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:35.140015 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd71f16-9684-40b3-b792-89ce52cb777d admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:35.140936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5899bb02-d7d2-4148-81e4-a51911f4018a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13195494ed564e0594dbffebf6b81d46'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:35.141600 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5899bb02-d7d2-4148-81e4-a51911f4018a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13195494ed564e0594dbffebf6b81d46'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:35.142261 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5899bb02-d7d2-4148-81e4-a51911f4018a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13195494ed564e0594dbffebf6b81d46'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:35.144763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f5bdb-8f43-42aa-bddb-1dc268b18a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:35.145415 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f5bdb-8f43-42aa-bddb-1dc268b18a45 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:35.145700 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f5bdb-8f43-42aa-bddb-1dc268b18a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:35.145978 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f5bdb-8f43-42aa-bddb-1dc268b18a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:35.146736 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f5bdb-8f43-42aa-bddb-1dc268b18a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:35.148322 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f5bdb-8f43-42aa-bddb-1dc268b18a45 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:35.148898 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5899bb02-d7d2-4148-81e4-a51911f4018a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13195494ed564e0594dbffebf6b81d46'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:35.158639 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1265/2543] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:27:35.162878 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f5bdb-8f43-42aa-bddb-1dc268b18a45 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:35.164531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d31f5bdb-8f43-42aa-bddb-1dc268b18a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:35.176567 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f5bdb-8f43-42aa-bddb-1dc268b18a45 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:35.181138 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e81eba-955e-49f4-baec-5c278810a1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:35.186433 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e81eba-955e-49f4-baec-5c278810a1cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:35.186433 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e81eba-955e-49f4-baec-5c278810a1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:35.186433 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e81eba-955e-49f4-baec-5c278810a1cd admin admin] PATH_INFO: `/v3/projects/28d7f9eba89e4d20a3a4fbc22ba7d0b0/users/77df61ccd0a548149a3c8ba1b0a1bc6c/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:35.186433 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e81eba-955e-49f4-baec-5c278810a1cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=28d7f9eba89e4d20a3a4fbc22ba7d0b0, user_id=77df61ccd0a548149a3c8ba1b0a1bc6c, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:35.187099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e81eba-955e-49f4-baec-5c278810a1cd admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:35.197486 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1266/2544] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:27:35 2022] PUT /identity/v3/projects/28d7f9eba89e4d20a3a4fbc22ba7d0b0/users/77df61ccd0a548149a3c8ba1b0a1bc6c/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:27:35.215891 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e813b0d-f0ed-4a56-a768-2d33cc487c56 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:35.215891 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e813b0d-f0ed-4a56-a768-2d33cc487c56 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:35.215891 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e813b0d-f0ed-4a56-a768-2d33cc487c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:35.240900 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1279/2545] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:27:34 2022] DELETE /identity/v3/users/13195494ed564e0594dbffebf6b81d46 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:27:35.244651 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-6e813b0d-f0ed-4a56-a768-2d33cc487c56 None None] MFA Rules not processed for user `77df61ccd0a548149a3c8ba1b0a1bc6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:35.244651 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6e813b0d-f0ed-4a56-a768-2d33cc487c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:35.311331 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1267/2546] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:35.322255 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899bb02-d7d2-4148-81e4-a51911f4018a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:35.324250 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5899bb02-d7d2-4148-81e4-a51911f4018a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:35.381057 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899bb02-d7d2-4148-81e4-a51911f4018a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:35.385077 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfc1e7-91d0-45a9-a22c-a6407842720e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:35.386309 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfc1e7-91d0-45a9-a22c-a6407842720e service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:35.386591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfc1e7-91d0-45a9-a22c-a6407842720e service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:35.386861 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfc1e7-91d0-45a9-a22c-a6407842720e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:35.396043 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfc1e7-91d0-45a9-a22c-a6407842720e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:35.397520 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfc1e7-91d0-45a9-a22c-a6407842720e service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:35.407883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1280/2547] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:27:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:35.452818 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e813b0d-f0ed-4a56-a768-2d33cc487c56 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:35.461969 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6e813b0d-f0ed-4a56-a768-2d33cc487c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:35.466816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e813b0d-f0ed-4a56-a768-2d33cc487c56 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:35.470481 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153212f-ff0a-41ba-87f6-11f39a1b4421 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:35.471120 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153212f-ff0a-41ba-87f6-11f39a1b4421 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:35.471407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153212f-ff0a-41ba-87f6-11f39a1b4421 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:35.471686 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153212f-ff0a-41ba-87f6-11f39a1b4421 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:35.473498 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d153212f-ff0a-41ba-87f6-11f39a1b4421 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:35.497993 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfc1e7-91d0-45a9-a22c-a6407842720e service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:35.500805 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9dbfc1e7-91d0-45a9-a22c-a6407842720e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:35.536891 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153212f-ff0a-41ba-87f6-11f39a1b4421 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:35.538393 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153212f-ff0a-41ba-87f6-11f39a1b4421 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:35.548507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1268/2548] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:27:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:35.577726 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfc1e7-91d0-45a9-a22c-a6407842720e service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:35.588067 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e9392-691d-40a4-a53d-f0ecf51cb14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:35.589311 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e9392-691d-40a4-a53d-f0ecf51cb14e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:35.589311 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e9392-691d-40a4-a53d-f0ecf51cb14e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:35.589541 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e9392-691d-40a4-a53d-f0ecf51cb14e admin admin] PATH_INFO: `/v3/projects/4d86728a09154cb2917f313ed9bf8478` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:35.590792 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e9392-691d-40a4-a53d-f0ecf51cb14e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d86728a09154cb2917f313ed9bf8478)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:35.592751 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e9392-691d-40a4-a53d-f0ecf51cb14e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:35.756722 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-319e9392-691d-40a4-a53d-f0ecf51cb14e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d86728a09154cb2917f313ed9bf8478', 'request_id': 'req-319e9392-691d-40a4-a53d-f0ecf51cb14e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:35.762988 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-319e9392-691d-40a4-a53d-f0ecf51cb14e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d86728a09154cb2917f313ed9bf8478', 'request_id': 'req-319e9392-691d-40a4-a53d-f0ecf51cb14e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:35.858185 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-319e9392-691d-40a4-a53d-f0ecf51cb14e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d86728a09154cb2917f313ed9bf8478', 'request_id': 'req-319e9392-691d-40a4-a53d-f0ecf51cb14e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:35.869756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-319e9392-691d-40a4-a53d-f0ecf51cb14e admin admin] The token cache is being invalidate because project 4d86728a09154cb2917f313ed9bf8478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:27:35.869953 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-319e9392-691d-40a4-a53d-f0ecf51cb14e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:35.870867 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-319e9392-691d-40a4-a53d-f0ecf51cb14e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:35.875676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1281/2549] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:27:35 2022] DELETE /identity/v3/projects/4d86728a09154cb2917f313ed9bf8478 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:35.877553 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e83a2-3fbe-4307-8734-77799d540b17 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:35.877686 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e83a2-3fbe-4307-8734-77799d540b17 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:35.877953 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e83a2-3fbe-4307-8734-77799d540b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:35.895390 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-157e83a2-3fbe-4307-8734-77799d540b17 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:35.896585 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-157e83a2-3fbe-4307-8734-77799d540b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:35.952553 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1269/2550] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:35.960923 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee34eba-2170-40ee-ad23-27dfb074e30a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:35.961216 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee34eba-2170-40ee-ad23-27dfb074e30a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:35.961500 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee34eba-2170-40ee-ad23-27dfb074e30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:35.981004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7ee34eba-2170-40ee-ad23-27dfb074e30a None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:35.982375 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7ee34eba-2170-40ee-ad23-27dfb074e30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:35.990243 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1282/2551] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:35.994450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e83a2-3fbe-4307-8734-77799d540b17 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:36.003969 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e83a2-3fbe-4307-8734-77799d540b17 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:36.009183 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21da8b-4e29-4a7b-aeb6-817ddef5cd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:36.009838 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21da8b-4e29-4a7b-aeb6-817ddef5cd0f admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:36.010144 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21da8b-4e29-4a7b-aeb6-817ddef5cd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:36.010424 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21da8b-4e29-4a7b-aeb6-817ddef5cd0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:36.011665 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21da8b-4e29-4a7b-aeb6-817ddef5cd0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:27:36.011971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21da8b-4e29-4a7b-aeb6-817ddef5cd0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:36.019697 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21da8b-4e29-4a7b-aeb6-817ddef5cd0f admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:36.025361 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1270/2552] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:27:36.030017 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee34eba-2170-40ee-ad23-27dfb074e30a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:36.039143 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee34eba-2170-40ee-ad23-27dfb074e30a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:36.043868 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7654673-b823-42e2-9bb9-62a0d0e82dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:36.044583 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7654673-b823-42e2-9bb9-62a0d0e82dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:36.045042 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7654673-b823-42e2-9bb9-62a0d0e82dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:36.045301 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7654673-b823-42e2-9bb9-62a0d0e82dd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:36.045912 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7654673-b823-42e2-9bb9-62a0d0e82dd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:36.047856 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7654673-b823-42e2-9bb9-62a0d0e82dd1 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:36.249027 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1283/2553] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:27:36 2022] POST /identity/v3/projects => generated 379 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:36.252915 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21da8b-4e29-4a7b-aeb6-817ddef5cd0f admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:36.263811 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21da8b-4e29-4a7b-aeb6-817ddef5cd0f admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:36.317401 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6e38b-3a96-49ca-84c4-3b1ce5cf1bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:36.318064 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6e38b-3a96-49ca-84c4-3b1ce5cf1bae admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:36.318493 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6e38b-3a96-49ca-84c4-3b1ce5cf1bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:36.318770 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6e38b-3a96-49ca-84c4-3b1ce5cf1bae admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:36.319488 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6e38b-3a96-49ca-84c4-3b1ce5cf1bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:36.321401 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6e38b-3a96-49ca-84c4-3b1ce5cf1bae admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:36.429506 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1271/2554] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:27:36 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:36.433954 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7654673-b823-42e2-9bb9-62a0d0e82dd1 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:36.444508 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7654673-b823-42e2-9bb9-62a0d0e82dd1 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:36.450260 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02621e1e-9c2e-457c-b072-c256dfd26c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:36.450937 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02621e1e-9c2e-457c-b072-c256dfd26c8d admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:36.451257 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02621e1e-9c2e-457c-b072-c256dfd26c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:36.451553 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02621e1e-9c2e-457c-b072-c256dfd26c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:36.452315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02621e1e-9c2e-457c-b072-c256dfd26c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:36.453953 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02621e1e-9c2e-457c-b072-c256dfd26c8d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:36.464901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1284/2555] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:36.468980 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6e38b-3a96-49ca-84c4-3b1ce5cf1bae admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:36.479662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6e38b-3a96-49ca-84c4-3b1ce5cf1bae admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:36.484317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6953b-66bf-4991-b943-6b29fa53b7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:36.484991 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6953b-66bf-4991-b943-6b29fa53b7ed admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:36.485265 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6953b-66bf-4991-b943-6b29fa53b7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:36.485540 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6953b-66bf-4991-b943-6b29fa53b7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:36.486302 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6953b-66bf-4991-b943-6b29fa53b7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:36.488074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6953b-66bf-4991-b943-6b29fa53b7ed admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:36.499089 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1272/2556] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:36.503294 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02621e1e-9c2e-457c-b072-c256dfd26c8d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:36.514382 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02621e1e-9c2e-457c-b072-c256dfd26c8d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:36.521209 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb6db1-8189-4f69-9bb5-b65d72482e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:36.522086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb6db1-8189-4f69-9bb5-b65d72482e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:36.522406 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb6db1-8189-4f69-9bb5-b65d72482e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:36.522681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb6db1-8189-4f69-9bb5-b65d72482e34 admin admin] PATH_INFO: `/v3/projects/bc74c97613c4462bb551e50800a5f5e2/users/e916a70861fc44e69160faf793999f6d/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:36.546701 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb6db1-8189-4f69-9bb5-b65d72482e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc74c97613c4462bb551e50800a5f5e2, user_id=e916a70861fc44e69160faf793999f6d, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:36.549431 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb6db1-8189-4f69-9bb5-b65d72482e34 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:36.660105 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1285/2557] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:27:36 2022] PUT /identity/v3/projects/bc74c97613c4462bb551e50800a5f5e2/users/e916a70861fc44e69160faf793999f6d/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:27:36.663178 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e5130-307c-4e07-9965-2efb126b3653 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:36.663475 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e5130-307c-4e07-9965-2efb126b3653 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:36.663757 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e5130-307c-4e07-9965-2efb126b3653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:36.688160 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-017e5130-307c-4e07-9965-2efb126b3653 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:36.689095 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-017e5130-307c-4e07-9965-2efb126b3653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:36.749972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1273/2558] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:36.759876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb6db1-8189-4f69-9bb5-b65d72482e34 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:36.762139 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-03eb6db1-8189-4f69-9bb5-b65d72482e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:36.818848 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb6db1-8189-4f69-9bb5-b65d72482e34 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:36.822680 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ae9e5-9fd4-4904-845d-55b98c78bc1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:36.823886 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ae9e5-9fd4-4904-845d-55b98c78bc1f service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:36.824179 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ae9e5-9fd4-4904-845d-55b98c78bc1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:36.824440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ae9e5-9fd4-4904-845d-55b98c78bc1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:36.834240 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ae9e5-9fd4-4904-845d-55b98c78bc1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:36.835647 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ae9e5-9fd4-4904-845d-55b98c78bc1f service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:36.846685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1286/2559] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:27:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:40.616959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e5130-307c-4e07-9965-2efb126b3653 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:40.619207 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-017e5130-307c-4e07-9965-2efb126b3653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:40.631594 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e5130-307c-4e07-9965-2efb126b3653 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:40.637740 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d7df2-bfab-4757-8fa5-26d0abaf0fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:40.638108 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d7df2-bfab-4757-8fa5-26d0abaf0fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:40.638422 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d7df2-bfab-4757-8fa5-26d0abaf0fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:40.638693 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d7df2-bfab-4757-8fa5-26d0abaf0fbd admin admin] PATH_INFO: `/v3/users/c8555bff3b09414aafccae6e25da6c7b` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:40.639944 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d7df2-bfab-4757-8fa5-26d0abaf0fbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8555bff3b09414aafccae6e25da6c7b)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:40.641993 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d7df2-bfab-4757-8fa5-26d0abaf0fbd admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:40.805431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-682d7df2-bfab-4757-8fa5-26d0abaf0fbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8555bff3b09414aafccae6e25da6c7b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:40.869785 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-682d7df2-bfab-4757-8fa5-26d0abaf0fbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8555bff3b09414aafccae6e25da6c7b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:40.870783 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-682d7df2-bfab-4757-8fa5-26d0abaf0fbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8555bff3b09414aafccae6e25da6c7b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:40.899585 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-682d7df2-bfab-4757-8fa5-26d0abaf0fbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8555bff3b09414aafccae6e25da6c7b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:40.900296 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-682d7df2-bfab-4757-8fa5-26d0abaf0fbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8555bff3b09414aafccae6e25da6c7b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:40.917751 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1274/2560] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:27:40 2022] DELETE /identity/v3/users/c8555bff3b09414aafccae6e25da6c7b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:40.922425 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23955f-7dda-4f0f-989f-777b1c6ef077 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:40.922881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23955f-7dda-4f0f-989f-777b1c6ef077 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:40.922881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23955f-7dda-4f0f-989f-777b1c6ef077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:40.953087 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-fa23955f-7dda-4f0f-989f-777b1c6ef077 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:40.955421 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fa23955f-7dda-4f0f-989f-777b1c6ef077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:41.035411 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1287/2561] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:41.050509 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d7df2-bfab-4757-8fa5-26d0abaf0fbd admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:41.052225 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-682d7df2-bfab-4757-8fa5-26d0abaf0fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:41.149570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d7df2-bfab-4757-8fa5-26d0abaf0fbd admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:41.153857 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27cde5-a52a-4490-816d-a9e1174ee177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:41.154555 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27cde5-a52a-4490-816d-a9e1174ee177 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:41.154839 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27cde5-a52a-4490-816d-a9e1174ee177 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:41.155112 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27cde5-a52a-4490-816d-a9e1174ee177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:41.164944 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27cde5-a52a-4490-816d-a9e1174ee177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:41.168973 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27cde5-a52a-4490-816d-a9e1174ee177 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:41.176094 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1275/2562] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:41.794002 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23955f-7dda-4f0f-989f-777b1c6ef077 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:41.795571 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fa23955f-7dda-4f0f-989f-777b1c6ef077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:41.817996 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23955f-7dda-4f0f-989f-777b1c6ef077 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:41.827437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb9113-ce2a-43cc-bc83-744679f6130b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:41.828677 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb9113-ce2a-43cc-bc83-744679f6130b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:41.829136 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb9113-ce2a-43cc-bc83-744679f6130b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:41.829573 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb9113-ce2a-43cc-bc83-744679f6130b admin admin] PATH_INFO: `/v3/projects/464e0ba9863847a78cb7babeb4a2e5f8` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:41.830999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb9113-ce2a-43cc-bc83-744679f6130b admin admin] RBAC: Authorizing `identity:delete_project(project_id=464e0ba9863847a78cb7babeb4a2e5f8)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:41.833934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb9113-ce2a-43cc-bc83-744679f6130b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:41.967647 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-adbb9113-ce2a-43cc-bc83-744679f6130b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '464e0ba9863847a78cb7babeb4a2e5f8', 'request_id': 'req-adbb9113-ce2a-43cc-bc83-744679f6130b'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:41.976926 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-adbb9113-ce2a-43cc-bc83-744679f6130b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '464e0ba9863847a78cb7babeb4a2e5f8', 'request_id': 'req-adbb9113-ce2a-43cc-bc83-744679f6130b'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:42.059267 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-adbb9113-ce2a-43cc-bc83-744679f6130b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '464e0ba9863847a78cb7babeb4a2e5f8', 'request_id': 'req-adbb9113-ce2a-43cc-bc83-744679f6130b'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:42.078785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-adbb9113-ce2a-43cc-bc83-744679f6130b admin admin] The token cache is being invalidate because project 464e0ba9863847a78cb7babeb4a2e5f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:27:42.079076 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-adbb9113-ce2a-43cc-bc83-744679f6130b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:42.079934 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-adbb9113-ce2a-43cc-bc83-744679f6130b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:42.081958 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1288/2563] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:27:41 2022] DELETE /identity/v3/projects/464e0ba9863847a78cb7babeb4a2e5f8 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:42.085816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27cde5-a52a-4490-816d-a9e1174ee177 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:42.095616 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27cde5-a52a-4490-816d-a9e1174ee177 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:42.201514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d508ccf-e248-4e53-bb59-520b4067ab62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:42.202743 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d508ccf-e248-4e53-bb59-520b4067ab62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:42.203216 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d508ccf-e248-4e53-bb59-520b4067ab62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:42.203486 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d508ccf-e248-4e53-bb59-520b4067ab62 admin admin] PATH_INFO: `/v3/users/77df61ccd0a548149a3c8ba1b0a1bc6c` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:42.205501 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d508ccf-e248-4e53-bb59-520b4067ab62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77df61ccd0a548149a3c8ba1b0a1bc6c)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:42.207672 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d508ccf-e248-4e53-bb59-520b4067ab62 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:42.455279 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1d508ccf-e248-4e53-bb59-520b4067ab62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77df61ccd0a548149a3c8ba1b0a1bc6c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:42.516399 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92beffb8-4721-41e1-87f6-92d391e76f94 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:42.516682 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92beffb8-4721-41e1-87f6-92d391e76f94 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:42.516960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92beffb8-4721-41e1-87f6-92d391e76f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:42.544620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1d508ccf-e248-4e53-bb59-520b4067ab62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77df61ccd0a548149a3c8ba1b0a1bc6c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:42.545256 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1d508ccf-e248-4e53-bb59-520b4067ab62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77df61ccd0a548149a3c8ba1b0a1bc6c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:42.547981 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-92beffb8-4721-41e1-87f6-92d391e76f94 None None] MFA Rules not processed for user `e916a70861fc44e69160faf793999f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:42.549584 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-92beffb8-4721-41e1-87f6-92d391e76f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:42.559803 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1d508ccf-e248-4e53-bb59-520b4067ab62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77df61ccd0a548149a3c8ba1b0a1bc6c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:42.560959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1d508ccf-e248-4e53-bb59-520b4067ab62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77df61ccd0a548149a3c8ba1b0a1bc6c'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:42.574392 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1276/2564] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:27:42 2022] DELETE /identity/v3/users/77df61ccd0a548149a3c8ba1b0a1bc6c => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:42.641246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1289/2565] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:27:42.642875 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d508ccf-e248-4e53-bb59-520b4067ab62 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:42.644784 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-1d508ccf-e248-4e53-bb59-520b4067ab62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:42.713622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d508ccf-e248-4e53-bb59-520b4067ab62 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:42.718450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b219a-0856-4838-a679-dfc5d30685af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:42.719118 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b219a-0856-4838-a679-dfc5d30685af admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:42.719403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b219a-0856-4838-a679-dfc5d30685af admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:42.719677 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b219a-0856-4838-a679-dfc5d30685af admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:42.720372 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b219a-0856-4838-a679-dfc5d30685af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:42.722315 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b219a-0856-4838-a679-dfc5d30685af admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:42.810154 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1277/2566] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:27:42 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:42.815369 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92beffb8-4721-41e1-87f6-92d391e76f94 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:42.827493 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92beffb8-4721-41e1-87f6-92d391e76f94 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:42.901297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1f40b-991b-4be2-a385-706583dafe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:42.902583 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1f40b-991b-4be2-a385-706583dafe93 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:42.902870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1f40b-991b-4be2-a385-706583dafe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:42.903150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1f40b-991b-4be2-a385-706583dafe93 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:42.903863 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1f40b-991b-4be2-a385-706583dafe93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:42.905855 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1f40b-991b-4be2-a385-706583dafe93 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:43.020752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1290/2567] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:27:42 2022] POST /identity/v3/users => generated 295 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:43.023272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b219a-0856-4838-a679-dfc5d30685af admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:43.038819 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1f40b-991b-4be2-a385-706583dafe93 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:43.038977 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b219a-0856-4838-a679-dfc5d30685af admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:43.041434 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1ae1f40b-991b-4be2-a385-706583dafe93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:43.052469 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a649a6-d5bb-403e-827e-69af4c9d8f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:43.053154 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a649a6-d5bb-403e-827e-69af4c9d8f3a admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:43.053444 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a649a6-d5bb-403e-827e-69af4c9d8f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:43.053715 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a649a6-d5bb-403e-827e-69af4c9d8f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:43.054485 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a649a6-d5bb-403e-827e-69af4c9d8f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:43.058968 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1f40b-991b-4be2-a385-706583dafe93 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:43.060961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a649a6-d5bb-403e-827e-69af4c9d8f3a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:43.082687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1278/2568] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:43.083923 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a649a6-d5bb-403e-827e-69af4c9d8f3a admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:43.094104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b00b85-a561-472e-8eab-d59453606c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:43.095086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b00b85-a561-472e-8eab-d59453606c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:43.095555 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b00b85-a561-472e-8eab-d59453606c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:43.095683 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b00b85-a561-472e-8eab-d59453606c1c admin admin] PATH_INFO: `/v3/projects/28d7f9eba89e4d20a3a4fbc22ba7d0b0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:43.097513 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b00b85-a561-472e-8eab-d59453606c1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=28d7f9eba89e4d20a3a4fbc22ba7d0b0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:43.099217 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b00b85-a561-472e-8eab-d59453606c1c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:43.106036 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a649a6-d5bb-403e-827e-69af4c9d8f3a admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:43.122505 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262695e-11e6-48ec-a03d-5a03e07dda05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:43.123442 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262695e-11e6-48ec-a03d-5a03e07dda05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:43.123723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262695e-11e6-48ec-a03d-5a03e07dda05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:43.124001 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262695e-11e6-48ec-a03d-5a03e07dda05 admin admin] PATH_INFO: `/v3/projects/093f74506b6c4769ba1b72e49e46b02a/users/89fffe6b0a22490b81795b49d02c171b/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:43.139054 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262695e-11e6-48ec-a03d-5a03e07dda05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=093f74506b6c4769ba1b72e49e46b02a, user_id=89fffe6b0a22490b81795b49d02c171b, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:43.141751 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262695e-11e6-48ec-a03d-5a03e07dda05 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:43.250373 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1279/2569] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:27:43 2022] PUT /identity/v3/projects/093f74506b6c4769ba1b72e49e46b02a/users/89fffe6b0a22490b81795b49d02c171b/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:43.254172 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262695e-11e6-48ec-a03d-5a03e07dda05 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:43.257943 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-64b00b85-a561-472e-8eab-d59453606c1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28d7f9eba89e4d20a3a4fbc22ba7d0b0', 'request_id': 'req-64b00b85-a561-472e-8eab-d59453606c1c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:43.265079 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-64b00b85-a561-472e-8eab-d59453606c1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28d7f9eba89e4d20a3a4fbc22ba7d0b0', 'request_id': 'req-64b00b85-a561-472e-8eab-d59453606c1c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:43.316174 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262695e-11e6-48ec-a03d-5a03e07dda05 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:43.341890 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-64b00b85-a561-472e-8eab-d59453606c1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28d7f9eba89e4d20a3a4fbc22ba7d0b0', 'request_id': 'req-64b00b85-a561-472e-8eab-d59453606c1c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:43.353159 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-64b00b85-a561-472e-8eab-d59453606c1c admin admin] The token cache is being invalidate because project 28d7f9eba89e4d20a3a4fbc22ba7d0b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:27:43.357254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-64b00b85-a561-472e-8eab-d59453606c1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:43.357254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-64b00b85-a561-472e-8eab-d59453606c1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:43.357254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1291/2570] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:27:43 2022] DELETE /identity/v3/projects/28d7f9eba89e4d20a3a4fbc22ba7d0b0 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:27:43.361244 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577ee1a-0eba-4567-9df8-7117775680ab None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:43.361604 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577ee1a-0eba-4567-9df8-7117775680ab None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:43.361975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577ee1a-0eba-4567-9df8-7117775680ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:43.376221 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe9bc0-1568-4ba4-b4f7-f978c96e0870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:43.377141 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe9bc0-1568-4ba4-b4f7-f978c96e0870 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:43.377405 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe9bc0-1568-4ba4-b4f7-f978c96e0870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:43.377677 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe9bc0-1568-4ba4-b4f7-f978c96e0870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:43.378469 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe9bc0-1568-4ba4-b4f7-f978c96e0870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:43.380158 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe9bc0-1568-4ba4-b4f7-f978c96e0870 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:43.380287 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a577ee1a-0eba-4567-9df8-7117775680ab None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:43.381448 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a577ee1a-0eba-4567-9df8-7117775680ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:43.390994 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1292/2571] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:27:43.392083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1280/2572] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:27:43.396378 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577ee1a-0eba-4567-9df8-7117775680ab None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:43.398108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a577ee1a-0eba-4567-9df8-7117775680ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:43.398588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2419fe-9a5d-4950-a591-69b442c88bd8 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:43.398880 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2419fe-9a5d-4950-a591-69b442c88bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:43.399165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2419fe-9a5d-4950-a591-69b442c88bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:43.410736 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577ee1a-0eba-4567-9df8-7117775680ab None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:43.415496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3077a-5f6e-43f8-9edb-5a8df5817058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:43.416389 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3077a-5f6e-43f8-9edb-5a8df5817058 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:43.416672 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3077a-5f6e-43f8-9edb-5a8df5817058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:43.416948 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3077a-5f6e-43f8-9edb-5a8df5817058 admin admin] PATH_INFO: `/v3/projects/093f74506b6c4769ba1b72e49e46b02a/users/89fffe6b0a22490b81795b49d02c171b/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:43.418718 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-bc2419fe-9a5d-4950-a591-69b442c88bd8 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:43.419067 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3077a-5f6e-43f8-9edb-5a8df5817058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=093f74506b6c4769ba1b72e49e46b02a, user_id=89fffe6b0a22490b81795b49d02c171b, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:43.419907 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-bc2419fe-9a5d-4950-a591-69b442c88bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:43.421721 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3077a-5f6e-43f8-9edb-5a8df5817058 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:43.427851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1281/2573] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:43.431863 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2419fe-9a5d-4950-a591-69b442c88bd8 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:43.434215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1293/2574] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:27:43 2022] PUT /identity/v3/projects/093f74506b6c4769ba1b72e49e46b02a/users/89fffe6b0a22490b81795b49d02c171b/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:27:43.441119 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2419fe-9a5d-4950-a591-69b442c88bd8 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:43.501636 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0c0cc-3add-4c8c-93a7-f485f8073c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:43.502364 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0c0cc-3add-4c8c-93a7-f485f8073c2e admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:43.502647 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0c0cc-3add-4c8c-93a7-f485f8073c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:43.502930 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0c0cc-3add-4c8c-93a7-f485f8073c2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:43.503663 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0c0cc-3add-4c8c-93a7-f485f8073c2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:27:43.503969 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0c0cc-3add-4c8c-93a7-f485f8073c2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:43.505574 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0c0cc-3add-4c8c-93a7-f485f8073c2e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:43.518548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1282/2575] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:27:43.529331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3077a-5f6e-43f8-9edb-5a8df5817058 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:43.539936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3077a-5f6e-43f8-9edb-5a8df5817058 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:43.545303 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ce8c0-1c74-402a-b24d-3f3a35434bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:43.546533 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ce8c0-1c74-402a-b24d-3f3a35434bab admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:43.546817 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ce8c0-1c74-402a-b24d-3f3a35434bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:43.547094 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ce8c0-1c74-402a-b24d-3f3a35434bab admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:43.547858 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ce8c0-1c74-402a-b24d-3f3a35434bab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:43.549862 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ce8c0-1c74-402a-b24d-3f3a35434bab admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:43.650480 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1294/2576] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:27:43 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:43.654571 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0c0cc-3add-4c8c-93a7-f485f8073c2e admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:43.667049 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0c0cc-3add-4c8c-93a7-f485f8073c2e admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:43.735719 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfab60-fb40-4ef0-95e2-9a2102af260c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:43.736558 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfab60-fb40-4ef0-95e2-9a2102af260c admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:43.736849 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfab60-fb40-4ef0-95e2-9a2102af260c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:43.737173 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfab60-fb40-4ef0-95e2-9a2102af260c admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:43.737833 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfab60-fb40-4ef0-95e2-9a2102af260c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:43.739960 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfab60-fb40-4ef0-95e2-9a2102af260c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:43.835925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1283/2577] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:27:43 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:43.837096 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ce8c0-1c74-402a-b24d-3f3a35434bab admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:43.848071 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ce8c0-1c74-402a-b24d-3f3a35434bab admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:43.852988 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90897af5-0ba3-48d2-818e-e416afe03270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:43.853706 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90897af5-0ba3-48d2-818e-e416afe03270 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:43.854050 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90897af5-0ba3-48d2-818e-e416afe03270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:43.857732 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90897af5-0ba3-48d2-818e-e416afe03270 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:43.857732 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90897af5-0ba3-48d2-818e-e416afe03270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:43.857732 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90897af5-0ba3-48d2-818e-e416afe03270 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:43.867667 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1295/2578] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:43.873643 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfab60-fb40-4ef0-95e2-9a2102af260c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:43.886735 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfab60-fb40-4ef0-95e2-9a2102af260c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:43.892726 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0dbc4-92cd-4d1d-8a1c-0f9064b03b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:43.893684 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0dbc4-92cd-4d1d-8a1c-0f9064b03b64 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:43.894062 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0dbc4-92cd-4d1d-8a1c-0f9064b03b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:43.894706 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0dbc4-92cd-4d1d-8a1c-0f9064b03b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:43.895729 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0dbc4-92cd-4d1d-8a1c-0f9064b03b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:43.897628 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0dbc4-92cd-4d1d-8a1c-0f9064b03b64 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:43.912303 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1284/2579] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:27:43.916688 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90897af5-0ba3-48d2-818e-e416afe03270 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:43.928898 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90897af5-0ba3-48d2-818e-e416afe03270 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:43.934487 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd27cc5-2431-4fbd-9747-9221eeac463c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:43.935367 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd27cc5-2431-4fbd-9747-9221eeac463c admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:43.935646 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd27cc5-2431-4fbd-9747-9221eeac463c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:43.938243 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd27cc5-2431-4fbd-9747-9221eeac463c admin admin] PATH_INFO: `/v3/projects/6b271894c84c41288950e1f2aa6a98a0/users/4b18e5ce41794565848fe6d15e57ac19/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:43.952167 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd27cc5-2431-4fbd-9747-9221eeac463c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b271894c84c41288950e1f2aa6a98a0, user_id=4b18e5ce41794565848fe6d15e57ac19, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:43.955354 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd27cc5-2431-4fbd-9747-9221eeac463c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:44.093165 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1296/2580] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:27:43 2022] PUT /identity/v3/projects/6b271894c84c41288950e1f2aa6a98a0/users/4b18e5ce41794565848fe6d15e57ac19/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:44.105554 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92724c0-3912-471c-8614-9de91c569337 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:44.106235 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92724c0-3912-471c-8614-9de91c569337 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:44.107388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92724c0-3912-471c-8614-9de91c569337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:44.179962 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-f92724c0-3912-471c-8614-9de91c569337 None None] MFA Rules not processed for user `4b18e5ce41794565848fe6d15e57ac19`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:44.182102 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f92724c0-3912-471c-8614-9de91c569337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:44.279978 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1285/2581] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:44.283999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd27cc5-2431-4fbd-9747-9221eeac463c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:44.364644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd27cc5-2431-4fbd-9747-9221eeac463c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:44.370090 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacc84b-0949-426c-aec9-8e5f1b0c7213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:44.370924 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacc84b-0949-426c-aec9-8e5f1b0c7213 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:44.371284 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacc84b-0949-426c-aec9-8e5f1b0c7213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:44.371575 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacc84b-0949-426c-aec9-8e5f1b0c7213 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:44.372350 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aacc84b-0949-426c-aec9-8e5f1b0c7213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:44.374328 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aacc84b-0949-426c-aec9-8e5f1b0c7213 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:44.465072 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1297/2582] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:27:44 2022] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:44.469150 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92724c0-3912-471c-8614-9de91c569337 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:44.481357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92724c0-3912-471c-8614-9de91c569337 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:44.544546 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde8d90-4084-49a5-9d4b-3c830698f829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:44.548733 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde8d90-4084-49a5-9d4b-3c830698f829 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:44.548733 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde8d90-4084-49a5-9d4b-3c830698f829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:44.548733 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde8d90-4084-49a5-9d4b-3c830698f829 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:44.548733 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde8d90-4084-49a5-9d4b-3c830698f829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:44.548733 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde8d90-4084-49a5-9d4b-3c830698f829 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:44.665962 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1286/2583] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:27:44 2022] POST /identity/v3/users => generated 298 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:27:44.668782 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacc84b-0949-426c-aec9-8e5f1b0c7213 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:44.679557 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacc84b-0949-426c-aec9-8e5f1b0c7213 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:44.684331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f379adf-0050-4ee4-a3f2-ebd89965f3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:44.684996 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f379adf-0050-4ee4-a3f2-ebd89965f3ed admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:44.688852 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f379adf-0050-4ee4-a3f2-ebd89965f3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:44.688852 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f379adf-0050-4ee4-a3f2-ebd89965f3ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:44.688852 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f379adf-0050-4ee4-a3f2-ebd89965f3ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:44.688852 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f379adf-0050-4ee4-a3f2-ebd89965f3ed admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:44.700057 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1298/2584] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:27:44.704241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde8d90-4084-49a5-9d4b-3c830698f829 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:44.714574 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde8d90-4084-49a5-9d4b-3c830698f829 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:44.719187 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffeba3-8ff8-4daa-8088-de12a97b14ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:44.720067 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffeba3-8ff8-4daa-8088-de12a97b14ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:44.720348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffeba3-8ff8-4daa-8088-de12a97b14ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:44.720622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffeba3-8ff8-4daa-8088-de12a97b14ed admin admin] PATH_INFO: `/v3/projects/5852fd65570e4d3f81e4bbad14cbd7cb/users/ff4e37b1839041f788a1d727c23ee7f4/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:44.735061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ffeba3-8ff8-4daa-8088-de12a97b14ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=5852fd65570e4d3f81e4bbad14cbd7cb, user_id=ff4e37b1839041f788a1d727c23ee7f4, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:44.737820 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ffeba3-8ff8-4daa-8088-de12a97b14ed admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:44.846707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1287/2585] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:27:44 2022] PUT /identity/v3/projects/5852fd65570e4d3f81e4bbad14cbd7cb/users/ff4e37b1839041f788a1d727c23ee7f4/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:44.850920 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f379adf-0050-4ee4-a3f2-ebd89965f3ed admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:44.862065 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f379adf-0050-4ee4-a3f2-ebd89965f3ed admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:44.958804 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e6d36-c8e3-4b77-b27f-91ad84c350a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:44.959962 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e6d36-c8e3-4b77-b27f-91ad84c350a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:44.960701 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e6d36-c8e3-4b77-b27f-91ad84c350a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:44.961044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e6d36-c8e3-4b77-b27f-91ad84c350a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:44.962002 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e6d36-c8e3-4b77-b27f-91ad84c350a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:44.964628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e6d36-c8e3-4b77-b27f-91ad84c350a3 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:44.986494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1299/2586] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:44.995505 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffeba3-8ff8-4daa-8088-de12a97b14ed admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:45.011685 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffeba3-8ff8-4daa-8088-de12a97b14ed admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:45.020208 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d11b2-a764-4991-9d68-c08b57353109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:45.021388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d11b2-a764-4991-9d68-c08b57353109 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:45.021676 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d11b2-a764-4991-9d68-c08b57353109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:45.021978 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d11b2-a764-4991-9d68-c08b57353109 admin admin] PATH_INFO: `/v3/projects/5852fd65570e4d3f81e4bbad14cbd7cb/users/ff4e37b1839041f788a1d727c23ee7f4/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:45.024672 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d11b2-a764-4991-9d68-c08b57353109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5852fd65570e4d3f81e4bbad14cbd7cb, user_id=ff4e37b1839041f788a1d727c23ee7f4, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:45.028773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d11b2-a764-4991-9d68-c08b57353109 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:45.052259 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1288/2587] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:27:44 2022] PUT /identity/v3/projects/5852fd65570e4d3f81e4bbad14cbd7cb/users/ff4e37b1839041f788a1d727c23ee7f4/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:45.054083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ad3c8-809e-4644-b9cc-9883eb01448e None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:45.054413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ad3c8-809e-4644-b9cc-9883eb01448e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:45.054693 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ad3c8-809e-4644-b9cc-9883eb01448e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:45.089893 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c17ad3c8-809e-4644-b9cc-9883eb01448e None None] MFA Rules not processed for user `ff4e37b1839041f788a1d727c23ee7f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:45.091669 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c17ad3c8-809e-4644-b9cc-9883eb01448e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:45.177480 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1300/2588] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:45.188827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d11b2-a764-4991-9d68-c08b57353109 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:45.191209 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9d0d11b2-a764-4991-9d68-c08b57353109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:45.257043 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d11b2-a764-4991-9d68-c08b57353109 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:45.261970 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d61071-1b48-4f61-bb34-ad657cd85a1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:45.262655 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d61071-1b48-4f61-bb34-ad657cd85a1a service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:45.262941 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d61071-1b48-4f61-bb34-ad657cd85a1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:45.263214 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d61071-1b48-4f61-bb34-ad657cd85a1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:45.337739 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d61071-1b48-4f61-bb34-ad657cd85a1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:45.345880 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d61071-1b48-4f61-bb34-ad657cd85a1a service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:45.348528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1289/2589] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:27:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:48.456982 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ee7fb-e4b5-4e53-b8c2-b6ddbda3e85e None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:48.459320 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ee7fb-e4b5-4e53-b8c2-b6ddbda3e85e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:48.460141 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ee7fb-e4b5-4e53-b8c2-b6ddbda3e85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:48.484691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e20ee7fb-e4b5-4e53-b8c2-b6ddbda3e85e None None] MFA Rules not processed for user `1a7181297bf14a57b3bf1f3c8b178d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:48.486411 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e20ee7fb-e4b5-4e53-b8c2-b6ddbda3e85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:48.606160 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1301/2590] 10.222.0.76 () {58 vars in 1009 bytes} [Mon May 16 15:27:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:48.621109 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d61071-1b48-4f61-bb34-ad657cd85a1a service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:48.623172 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-46d61071-1b48-4f61-bb34-ad657cd85a1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:48.704942 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d61071-1b48-4f61-bb34-ad657cd85a1a service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:48.712766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be3e1f-3624-418b-a796-c4d5d2124709 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33470e30760842ca9e96bb7f0cf9f07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:48.713435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be3e1f-3624-418b-a796-c4d5d2124709 service swift] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:48.713725 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be3e1f-3624-418b-a796-c4d5d2124709 service swift] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:48.714101 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be3e1f-3624-418b-a796-c4d5d2124709 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:48.725641 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be3e1f-3624-418b-a796-c4d5d2124709 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:48.727632 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be3e1f-3624-418b-a796-c4d5d2124709 service swift] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:48.743241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1290/2591] 10.222.0.76 () {60 vars in 1384 bytes} [Mon May 16 15:27:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:27:49.126485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ee7fb-e4b5-4e53-b8c2-b6ddbda3e85e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:49.128162 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e20ee7fb-e4b5-4e53-b8c2-b6ddbda3e85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:49.381607 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ee7fb-e4b5-4e53-b8c2-b6ddbda3e85e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:49.399510 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687fee1-6169-4a16-bdf5-db793c6d42ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:49.400435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687fee1-6169-4a16-bdf5-db793c6d42ac service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:49.400579 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687fee1-6169-4a16-bdf5-db793c6d42ac service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:49.402161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687fee1-6169-4a16-bdf5-db793c6d42ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:49.403839 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d687fee1-6169-4a16-bdf5-db793c6d42ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:49.435562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687fee1-6169-4a16-bdf5-db793c6d42ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:49.437262 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687fee1-6169-4a16-bdf5-db793c6d42ac service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:49.466200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1302/2592] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:27:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:51.414394 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d361b-f2ae-48e8-8d27-8eb1053f8246 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:51.414943 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687fee1-6169-4a16-bdf5-db793c6d42ac service nova] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:51.415385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d361b-f2ae-48e8-8d27-8eb1053f8246 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:51.415385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d361b-f2ae-48e8-8d27-8eb1053f8246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:51.418171 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d687fee1-6169-4a16-bdf5-db793c6d42ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:51.431199 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687fee1-6169-4a16-bdf5-db793c6d42ac service nova] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:51.444669 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1634da-3fd5-4110-8517-bf8b19b8788e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:51.445577 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1634da-3fd5-4110-8517-bf8b19b8788e service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:51.446016 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1634da-3fd5-4110-8517-bf8b19b8788e service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:51.446493 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1634da-3fd5-4110-8517-bf8b19b8788e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:51.459678 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1634da-3fd5-4110-8517-bf8b19b8788e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:51.461169 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1634da-3fd5-4110-8517-bf8b19b8788e service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:51.462646 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-be6d361b-f2ae-48e8-8d27-8eb1053f8246 None None] MFA Rules not processed for user `89fffe6b0a22490b81795b49d02c171b`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:51.463861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-be6d361b-f2ae-48e8-8d27-8eb1053f8246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:51.481205 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1303/2593] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:27:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:51.560184 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1291/2594] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:51.579873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1634da-3fd5-4110-8517-bf8b19b8788e service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:51.596758 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1634da-3fd5-4110-8517-bf8b19b8788e service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:51.609165 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b80df-4a9a-4925-a2af-8434d2509965 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:51.618766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b80df-4a9a-4925-a2af-8434d2509965 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:51.619066 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b80df-4a9a-4925-a2af-8434d2509965 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:51.619354 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b80df-4a9a-4925-a2af-8434d2509965 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:51.621663 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c89b80df-4a9a-4925-a2af-8434d2509965 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:51.701052 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b80df-4a9a-4925-a2af-8434d2509965 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:51.705381 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b80df-4a9a-4925-a2af-8434d2509965 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:51.716638 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1304/2595] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:27:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:58.127078 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dc8b9-cbc5-44f9-899d-6c90034d9d2c None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:58.127987 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dc8b9-cbc5-44f9-899d-6c90034d9d2c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:58.128450 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dc8b9-cbc5-44f9-899d-6c90034d9d2c None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:58.135647 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1292/2596] 10.222.0.76 () {54 vars in 921 bytes} [Mon May 16 15:27:58 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:27:58.143839 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b80df-4a9a-4925-a2af-8434d2509965 service nova] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:58.162219 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ba5c6-422c-48fe-bc46-86879f1d1f4e None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:58.162574 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ba5c6-422c-48fe-bc46-86879f1d1f4e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:58.162856 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ba5c6-422c-48fe-bc46-86879f1d1f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:58.206930 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-4a4ba5c6-422c-48fe-bc46-86879f1d1f4e None None] MFA Rules not processed for user `15ff90527ece4406be62f449bdf71d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:58.213691 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4a4ba5c6-422c-48fe-bc46-86879f1d1f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:58.277149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b80df-4a9a-4925-a2af-8434d2509965 service nova] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:58.292269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ba8c7-ee3d-448b-b94f-6e2c709121f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:58.293717 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ba8c7-ee3d-448b-b94f-6e2c709121f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:58.294001 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ba8c7-ee3d-448b-b94f-6e2c709121f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:58.294525 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ba8c7-ee3d-448b-b94f-6e2c709121f0 admin admin] PATH_INFO: `/v3/users/4b18e5ce41794565848fe6d15e57ac19` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:58.296358 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ba8c7-ee3d-448b-b94f-6e2c709121f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b18e5ce41794565848fe6d15e57ac19)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:58.298377 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ba8c7-ee3d-448b-b94f-6e2c709121f0 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:58.366338 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1293/2597] 10.222.0.76 () {58 vars in 1018 bytes} [Mon May 16 15:27:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 16 15:27:58.372824 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ba5c6-422c-48fe-bc46-86879f1d1f4e None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:58.375931 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4a4ba5c6-422c-48fe-bc46-86879f1d1f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:58.400770 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ba5c6-422c-48fe-bc46-86879f1d1f4e None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:58.413584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd497d-3c16-402d-93a6-c45e6579329e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:58.414472 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd497d-3c16-402d-93a6-c45e6579329e service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:58.414750 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd497d-3c16-402d-93a6-c45e6579329e service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:58.415214 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd497d-3c16-402d-93a6-c45e6579329e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:58.427406 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd497d-3c16-402d-93a6-c45e6579329e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:58.429128 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd497d-3c16-402d-93a6-c45e6579329e service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:58.458214 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1294/2598] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:27:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:27:58.534368 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ba8ba8c7-ee3d-448b-b94f-6e2c709121f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b18e5ce41794565848fe6d15e57ac19'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:58.550767 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ba8ba8c7-ee3d-448b-b94f-6e2c709121f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b18e5ce41794565848fe6d15e57ac19'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:58.551787 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ba8ba8c7-ee3d-448b-b94f-6e2c709121f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b18e5ce41794565848fe6d15e57ac19'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:58.552600 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ba8ba8c7-ee3d-448b-b94f-6e2c709121f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b18e5ce41794565848fe6d15e57ac19'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:58.566614 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ba8ba8c7-ee3d-448b-b94f-6e2c709121f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b18e5ce41794565848fe6d15e57ac19'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:58.595164 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ea7bb-30b1-4021-a301-9360610a23fe None None] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:58.595164 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ea7bb-30b1-4021-a301-9360610a23fe None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:58.595750 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ea7bb-30b1-4021-a301-9360610a23fe None None] PATH_INFO: `/` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:58.598467 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1295/2599] 10.222.0.76 () {54 vars in 921 bytes} [Mon May 16 15:27:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:27:58.605858 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b37be6-17fb-4ee2-a2bd-37943e5a6f69 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:58.606857 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b37be6-17fb-4ee2-a2bd-37943e5a6f69 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:58.607346 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b37be6-17fb-4ee2-a2bd-37943e5a6f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:58.635397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-c8b37be6-17fb-4ee2-a2bd-37943e5a6f69 None None] MFA Rules not processed for user `9d85024f010c40129d79543b3ec4cfae`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:58.636820 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c8b37be6-17fb-4ee2-a2bd-37943e5a6f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:58.659772 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1296/2600] 10.222.0.76 () {58 vars in 1018 bytes} [Mon May 16 15:27:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:27:58.670210 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b37be6-17fb-4ee2-a2bd-37943e5a6f69 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:58.671862 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c8b37be6-17fb-4ee2-a2bd-37943e5a6f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:58.691299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b37be6-17fb-4ee2-a2bd-37943e5a6f69 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:58.695250 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b4e7d-49be-47d4-afd3-9b4971eda82d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:58.708376 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1305/2601] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:27:58 2022] DELETE /identity/v3/users/4b18e5ce41794565848fe6d15e57ac19 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:58.708752 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b4e7d-49be-47d4-afd3-9b4971eda82d service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:58.709060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b4e7d-49be-47d4-afd3-9b4971eda82d service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:58.709332 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b4e7d-49be-47d4-afd3-9b4971eda82d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:58.712931 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6555d72-4639-4970-8c8c-0a7a2376fcfa None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:58.713220 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6555d72-4639-4970-8c8c-0a7a2376fcfa None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:58.713499 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6555d72-4639-4970-8c8c-0a7a2376fcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:58.750975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b6555d72-4639-4970-8c8c-0a7a2376fcfa None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:58.751188 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b4e7d-49be-47d4-afd3-9b4971eda82d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:58.753114 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b4e7d-49be-47d4-afd3-9b4971eda82d service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:58.756459 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b6555d72-4639-4970-8c8c-0a7a2376fcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:58.767637 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1297/2602] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:27:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:58.921363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1306/2603] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:27:58.931004 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b4e7d-49be-47d4-afd3-9b4971eda82d service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:58.932918 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-da0b4e7d-49be-47d4-afd3-9b4971eda82d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:58.959834 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b4e7d-49be-47d4-afd3-9b4971eda82d service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:59.073074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733ead2-757f-43fe-8f2c-d7061a4aa26a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:59.073829 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733ead2-757f-43fe-8f2c-d7061a4aa26a service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:59.077222 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733ead2-757f-43fe-8f2c-d7061a4aa26a service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:59.077222 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733ead2-757f-43fe-8f2c-d7061a4aa26a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:59.087574 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733ead2-757f-43fe-8f2c-d7061a4aa26a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:59.087747 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733ead2-757f-43fe-8f2c-d7061a4aa26a service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:59.101155 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1298/2604] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:27:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:59.918284 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6555d72-4639-4970-8c8c-0a7a2376fcfa None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:59.920363 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b6555d72-4639-4970-8c8c-0a7a2376fcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:59.944833 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6555d72-4639-4970-8c8c-0a7a2376fcfa None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:59.949426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ef09a-c150-45de-a036-21512e9b7de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:59.950353 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ef09a-c150-45de-a036-21512e9b7de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:59.950636 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ef09a-c150-45de-a036-21512e9b7de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:59.950960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ef09a-c150-45de-a036-21512e9b7de9 admin admin] PATH_INFO: `/v3/projects/6b271894c84c41288950e1f2aa6a98a0` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:59.952464 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ef09a-c150-45de-a036-21512e9b7de9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b271894c84c41288950e1f2aa6a98a0)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:59.954436 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ef09a-c150-45de-a036-21512e9b7de9 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:00.175021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-040ef09a-c150-45de-a036-21512e9b7de9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b271894c84c41288950e1f2aa6a98a0', 'request_id': 'req-040ef09a-c150-45de-a036-21512e9b7de9'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:00.198199 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-040ef09a-c150-45de-a036-21512e9b7de9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b271894c84c41288950e1f2aa6a98a0', 'request_id': 'req-040ef09a-c150-45de-a036-21512e9b7de9'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:00.310704 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-040ef09a-c150-45de-a036-21512e9b7de9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b271894c84c41288950e1f2aa6a98a0', 'request_id': 'req-040ef09a-c150-45de-a036-21512e9b7de9'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:00.327243 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-040ef09a-c150-45de-a036-21512e9b7de9 admin admin] The token cache is being invalidate because project 6b271894c84c41288950e1f2aa6a98a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:28:00.330671 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-040ef09a-c150-45de-a036-21512e9b7de9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:00.334998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-040ef09a-c150-45de-a036-21512e9b7de9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:00.344255 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1307/2605] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:27:59 2022] DELETE /identity/v3/projects/6b271894c84c41288950e1f2aa6a98a0 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:28:00.345320 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733ead2-757f-43fe-8f2c-d7061a4aa26a service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:00.357826 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733ead2-757f-43fe-8f2c-d7061a4aa26a service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:00.449727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14dfa6-ce03-4179-bf73-a381bbf02ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:00.450875 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14dfa6-ce03-4179-bf73-a381bbf02ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:00.453996 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14dfa6-ce03-4179-bf73-a381bbf02ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:00.454314 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14dfa6-ce03-4179-bf73-a381bbf02ca7 admin admin] PATH_INFO: `/v3/users/ff4e37b1839041f788a1d727c23ee7f4` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:00.456423 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14dfa6-ce03-4179-bf73-a381bbf02ca7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff4e37b1839041f788a1d727c23ee7f4)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:00.459673 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14dfa6-ce03-4179-bf73-a381bbf02ca7 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:00.717898 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ef14dfa6-ce03-4179-bf73-a381bbf02ca7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff4e37b1839041f788a1d727c23ee7f4'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:00.830388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ef14dfa6-ce03-4179-bf73-a381bbf02ca7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff4e37b1839041f788a1d727c23ee7f4'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:00.831252 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ef14dfa6-ce03-4179-bf73-a381bbf02ca7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff4e37b1839041f788a1d727c23ee7f4'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:00.854375 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ef14dfa6-ce03-4179-bf73-a381bbf02ca7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff4e37b1839041f788a1d727c23ee7f4'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:00.855689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ef14dfa6-ce03-4179-bf73-a381bbf02ca7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff4e37b1839041f788a1d727c23ee7f4'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:00.870076 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1299/2606] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:28:00 2022] DELETE /identity/v3/users/ff4e37b1839041f788a1d727c23ee7f4 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:28:01.419724 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ef09a-c150-45de-a036-21512e9b7de9 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:01.429230 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-040ef09a-c150-45de-a036-21512e9b7de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:01.458374 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ef09a-c150-45de-a036-21512e9b7de9 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:01.544257 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327d185-d16d-4674-a09d-43060176aa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:01.545655 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327d185-d16d-4674-a09d-43060176aa3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:01.546229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327d185-d16d-4674-a09d-43060176aa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:01.546989 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327d185-d16d-4674-a09d-43060176aa3b admin admin] PATH_INFO: `/v3/projects/5852fd65570e4d3f81e4bbad14cbd7cb` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:01.555129 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327d185-d16d-4674-a09d-43060176aa3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5852fd65570e4d3f81e4bbad14cbd7cb)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:01.557422 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327d185-d16d-4674-a09d-43060176aa3b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:01.734616 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4327d185-d16d-4674-a09d-43060176aa3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5852fd65570e4d3f81e4bbad14cbd7cb', 'request_id': 'req-4327d185-d16d-4674-a09d-43060176aa3b'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:01.744939 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4327d185-d16d-4674-a09d-43060176aa3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5852fd65570e4d3f81e4bbad14cbd7cb', 'request_id': 'req-4327d185-d16d-4674-a09d-43060176aa3b'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:01.820175 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4327d185-d16d-4674-a09d-43060176aa3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5852fd65570e4d3f81e4bbad14cbd7cb', 'request_id': 'req-4327d185-d16d-4674-a09d-43060176aa3b'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:01.837203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4327d185-d16d-4674-a09d-43060176aa3b admin admin] The token cache is being invalidate because project 5852fd65570e4d3f81e4bbad14cbd7cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:28:01.837764 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4327d185-d16d-4674-a09d-43060176aa3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:01.840549 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4327d185-d16d-4674-a09d-43060176aa3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:01.846187 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1308/2607] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:28:01 2022] DELETE /identity/v3/projects/5852fd65570e4d3f81e4bbad14cbd7cb => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:28:01.852103 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf1fdf-8866-485a-bb37-057a494a33b3 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:01.852601 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf1fdf-8866-485a-bb37-057a494a33b3 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:01.852820 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf1fdf-8866-485a-bb37-057a494a33b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:01.905482 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-2fbf1fdf-8866-485a-bb37-057a494a33b3 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:28:01.906834 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2fbf1fdf-8866-485a-bb37-057a494a33b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:02.006833 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c1c64-487b-4759-9b69-26d144753c45 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:02.007405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c1c64-487b-4759-9b69-26d144753c45 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:02.007898 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c1c64-487b-4759-9b69-26d144753c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:02.008684 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1300/2608] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:28:02.028666 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a21c1c64-487b-4759-9b69-26d144753c45 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:28:02.030023 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a21c1c64-487b-4759-9b69-26d144753c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:02.041023 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1309/2609] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:28:02.045819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf1fdf-8866-485a-bb37-057a494a33b3 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:02.058283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf1fdf-8866-485a-bb37-057a494a33b3 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:02.063282 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d4417-338d-45e4-a34d-82b12526d998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:02.063995 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d4417-338d-45e4-a34d-82b12526d998 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:02.064275 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d4417-338d-45e4-a34d-82b12526d998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:02.064558 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d4417-338d-45e4-a34d-82b12526d998 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:02.065297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d4417-338d-45e4-a34d-82b12526d998 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:28:02.065605 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d4417-338d-45e4-a34d-82b12526d998 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:02.067371 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d4417-338d-45e4-a34d-82b12526d998 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:02.082545 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1301/2610] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:28:02.085080 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c1c64-487b-4759-9b69-26d144753c45 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:02.095469 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c1c64-487b-4759-9b69-26d144753c45 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:02.106601 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5c7b2-652b-4652-a72c-694476bc8156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:02.107316 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5c7b2-652b-4652-a72c-694476bc8156 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:02.107590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5c7b2-652b-4652-a72c-694476bc8156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:02.107857 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5c7b2-652b-4652-a72c-694476bc8156 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:02.108633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea5c7b2-652b-4652-a72c-694476bc8156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:02.110913 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea5c7b2-652b-4652-a72c-694476bc8156 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:02.235706 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1310/2611] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:28:02 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:28:02.239583 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d4417-338d-45e4-a34d-82b12526d998 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:02.272697 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d4417-338d-45e4-a34d-82b12526d998 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:02.382653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168901ae-a956-4bed-86f0-1a02c5da0306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:02.383920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168901ae-a956-4bed-86f0-1a02c5da0306 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:02.384332 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168901ae-a956-4bed-86f0-1a02c5da0306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:02.384710 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168901ae-a956-4bed-86f0-1a02c5da0306 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:02.385528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168901ae-a956-4bed-86f0-1a02c5da0306 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:02.388095 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168901ae-a956-4bed-86f0-1a02c5da0306 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:02.495156 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1302/2612] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:28:02 2022] POST /identity/v3/users => generated 288 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:28:02.496563 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5c7b2-652b-4652-a72c-694476bc8156 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:02.525628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5c7b2-652b-4652-a72c-694476bc8156 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:02.542569 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043cc27-6ddd-4696-9470-4519f177be9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:02.544026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043cc27-6ddd-4696-9470-4519f177be9e admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:02.544491 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043cc27-6ddd-4696-9470-4519f177be9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:02.545120 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043cc27-6ddd-4696-9470-4519f177be9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:02.545990 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043cc27-6ddd-4696-9470-4519f177be9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:02.550031 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043cc27-6ddd-4696-9470-4519f177be9e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:02.587328 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1311/2613] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:28:02.591838 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168901ae-a956-4bed-86f0-1a02c5da0306 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:02.613665 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168901ae-a956-4bed-86f0-1a02c5da0306 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:02.619605 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5cc46-9cb3-4680-88fb-6a52d78ad949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:02.620284 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5cc46-9cb3-4680-88fb-6a52d78ad949 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:02.620566 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5cc46-9cb3-4680-88fb-6a52d78ad949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:02.627245 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5cc46-9cb3-4680-88fb-6a52d78ad949 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:02.627245 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5cc46-9cb3-4680-88fb-6a52d78ad949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:02.627245 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5cc46-9cb3-4680-88fb-6a52d78ad949 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:02.641661 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1303/2614] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:28:02.642805 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043cc27-6ddd-4696-9470-4519f177be9e admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:02.659901 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043cc27-6ddd-4696-9470-4519f177be9e admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:02.666373 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff401d-68e9-4471-b96e-9dc08cb41b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:02.667296 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff401d-68e9-4471-b96e-9dc08cb41b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:02.668866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff401d-68e9-4471-b96e-9dc08cb41b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:02.669152 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff401d-68e9-4471-b96e-9dc08cb41b91 admin admin] PATH_INFO: `/v3/projects/c934fa4e30f3405bb1016c570d30f1b1/users/7bd5c32651c44f6e9f3c78fda777a50e/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:02.701744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff401d-68e9-4471-b96e-9dc08cb41b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c934fa4e30f3405bb1016c570d30f1b1, user_id=7bd5c32651c44f6e9f3c78fda777a50e, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:02.713183 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff401d-68e9-4471-b96e-9dc08cb41b91 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:02.801057 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1312/2615] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:28:02 2022] PUT /identity/v3/projects/c934fa4e30f3405bb1016c570d30f1b1/users/7bd5c32651c44f6e9f3c78fda777a50e/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:28:02.814015 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa90d0-ea3e-4921-a91e-bf4a48480093 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:02.814333 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa90d0-ea3e-4921-a91e-bf4a48480093 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:02.814609 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa90d0-ea3e-4921-a91e-bf4a48480093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:02.868427 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-53aa90d0-ea3e-4921-a91e-bf4a48480093 None None] MFA Rules not processed for user `7bd5c32651c44f6e9f3c78fda777a50e`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:28:02.869718 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-53aa90d0-ea3e-4921-a91e-bf4a48480093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:02.944891 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1304/2616] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:28:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:28:02.958703 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff401d-68e9-4471-b96e-9dc08cb41b91 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:02.965942 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b0ff401d-68e9-4471-b96e-9dc08cb41b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:03.083945 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa90d0-ea3e-4921-a91e-bf4a48480093 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:03.085671 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-53aa90d0-ea3e-4921-a91e-bf4a48480093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:03.118829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff401d-68e9-4471-b96e-9dc08cb41b91 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:03.138495 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c7761-99e5-4618-b256-05fa633a46e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:03.140636 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c7761-99e5-4618-b256-05fa633a46e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:03.141589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c7761-99e5-4618-b256-05fa633a46e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:03.142275 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c7761-99e5-4618-b256-05fa633a46e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:03.154340 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c7761-99e5-4618-b256-05fa633a46e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:03.156189 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c7761-99e5-4618-b256-05fa633a46e0 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:03.164538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa90d0-ea3e-4921-a91e-bf4a48480093 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:03.168290 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1313/2617] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:28:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:28:03.179100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9616b20-d7e5-4984-96c4-1474e9aca00c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:03.179900 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9616b20-d7e5-4984-96c4-1474e9aca00c service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:03.180156 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9616b20-d7e5-4984-96c4-1474e9aca00c service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:03.180439 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9616b20-d7e5-4984-96c4-1474e9aca00c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:03.184246 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a9616b20-d7e5-4984-96c4-1474e9aca00c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:03.256369 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9616b20-d7e5-4984-96c4-1474e9aca00c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:03.257835 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9616b20-d7e5-4984-96c4-1474e9aca00c service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:03.273880 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1305/2618] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:28:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:28:07.797007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c7761-99e5-4618-b256-05fa633a46e0 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:07.798471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b48c7761-99e5-4618-b256-05fa633a46e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:07.814388 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c7761-99e5-4618-b256-05fa633a46e0 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:07.818909 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2626e59-9a31-4645-a120-1ddfec78e008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:07.819795 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2626e59-9a31-4645-a120-1ddfec78e008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:07.820073 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2626e59-9a31-4645-a120-1ddfec78e008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:07.820346 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2626e59-9a31-4645-a120-1ddfec78e008 admin admin] PATH_INFO: `/v3/users/6b16118d74774a9ea673d6e0532b8772` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:07.821554 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2626e59-9a31-4645-a120-1ddfec78e008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b16118d74774a9ea673d6e0532b8772)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:07.823664 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2626e59-9a31-4645-a120-1ddfec78e008 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:07.992503 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c2626e59-9a31-4645-a120-1ddfec78e008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b16118d74774a9ea673d6e0532b8772'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:08.004707 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c2626e59-9a31-4645-a120-1ddfec78e008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b16118d74774a9ea673d6e0532b8772'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:08.005384 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c2626e59-9a31-4645-a120-1ddfec78e008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b16118d74774a9ea673d6e0532b8772'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:08.005995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c2626e59-9a31-4645-a120-1ddfec78e008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b16118d74774a9ea673d6e0532b8772'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:08.012930 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c2626e59-9a31-4645-a120-1ddfec78e008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b16118d74774a9ea673d6e0532b8772'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:08.115717 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1314/2619] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:28:07 2022] DELETE /identity/v3/users/6b16118d74774a9ea673d6e0532b8772 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:28:08.396958 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9616b20-d7e5-4984-96c4-1474e9aca00c service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:08.412290 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9616b20-d7e5-4984-96c4-1474e9aca00c service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:08.466050 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05451f-930e-4310-8a63-be8980990499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:08.467032 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05451f-930e-4310-8a63-be8980990499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:08.467396 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05451f-930e-4310-8a63-be8980990499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:08.467733 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05451f-930e-4310-8a63-be8980990499 admin admin] PATH_INFO: `/v3/projects/b360d85257f14f9191b490327c110ba8` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:08.468991 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05451f-930e-4310-8a63-be8980990499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b360d85257f14f9191b490327c110ba8)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:08.470942 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05451f-930e-4310-8a63-be8980990499 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:08.613232 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1e05451f-930e-4310-8a63-be8980990499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b360d85257f14f9191b490327c110ba8', 'request_id': 'req-1e05451f-930e-4310-8a63-be8980990499'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:08.682142 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1e05451f-930e-4310-8a63-be8980990499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b360d85257f14f9191b490327c110ba8', 'request_id': 'req-1e05451f-930e-4310-8a63-be8980990499'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:08.688712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1e05451f-930e-4310-8a63-be8980990499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b360d85257f14f9191b490327c110ba8', 'request_id': 'req-1e05451f-930e-4310-8a63-be8980990499'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:08.698945 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1e05451f-930e-4310-8a63-be8980990499 admin admin] The token cache is being invalidate because project b360d85257f14f9191b490327c110ba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:28:08.699842 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1e05451f-930e-4310-8a63-be8980990499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:08.708424 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-1e05451f-930e-4310-8a63-be8980990499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:08.708424 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1306/2620] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:28:08 2022] DELETE /identity/v3/projects/b360d85257f14f9191b490327c110ba8 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:28:08.708652 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239ddbf-c5a2-4ade-97d2-0f2d10543041 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:08.708652 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239ddbf-c5a2-4ade-97d2-0f2d10543041 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:08.708652 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239ddbf-c5a2-4ade-97d2-0f2d10543041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:08.726598 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9239ddbf-c5a2-4ade-97d2-0f2d10543041 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:28:08.727809 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9239ddbf-c5a2-4ade-97d2-0f2d10543041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:08.818187 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1315/2621] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:28:08.826747 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51dbd1-7de0-4b5f-b117-2734b92ed72e None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:08.827107 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51dbd1-7de0-4b5f-b117-2734b92ed72e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:08.827510 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51dbd1-7de0-4b5f-b117-2734b92ed72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:08.847098 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-ef51dbd1-7de0-4b5f-b117-2734b92ed72e None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:28:08.848283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ef51dbd1-7de0-4b5f-b117-2734b92ed72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:08.856115 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1307/2622] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:28:08.860247 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239ddbf-c5a2-4ade-97d2-0f2d10543041 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:08.869669 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239ddbf-c5a2-4ade-97d2-0f2d10543041 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:08.874566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf387c7-9cd6-4305-892d-108cf92591ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:08.874943 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf387c7-9cd6-4305-892d-108cf92591ec admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:08.875226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf387c7-9cd6-4305-892d-108cf92591ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:08.875504 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf387c7-9cd6-4305-892d-108cf92591ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:08.876234 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf387c7-9cd6-4305-892d-108cf92591ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:28:08.876542 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf387c7-9cd6-4305-892d-108cf92591ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:08.878156 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf387c7-9cd6-4305-892d-108cf92591ec admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:08.890211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1316/2623] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:28:08.894500 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51dbd1-7de0-4b5f-b117-2734b92ed72e None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:08.904077 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51dbd1-7de0-4b5f-b117-2734b92ed72e None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:08.908637 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6d027-c74f-4c9d-b5d2-cb7bc3a00163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:08.909272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6d027-c74f-4c9d-b5d2-cb7bc3a00163 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:08.909549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6d027-c74f-4c9d-b5d2-cb7bc3a00163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:08.909820 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6d027-c74f-4c9d-b5d2-cb7bc3a00163 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:08.910555 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6d027-c74f-4c9d-b5d2-cb7bc3a00163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:08.912444 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6d027-c74f-4c9d-b5d2-cb7bc3a00163 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:09.008978 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1308/2624] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:28:08 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:28:09.013417 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf387c7-9cd6-4305-892d-108cf92591ec admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:09.023362 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf387c7-9cd6-4305-892d-108cf92591ec admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:09.079911 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65a420-a87c-42e6-8b3b-a471dcaee1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:09.080591 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65a420-a87c-42e6-8b3b-a471dcaee1aa admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:09.080875 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65a420-a87c-42e6-8b3b-a471dcaee1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:09.081155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65a420-a87c-42e6-8b3b-a471dcaee1aa admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:09.081884 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65a420-a87c-42e6-8b3b-a471dcaee1aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:09.083816 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65a420-a87c-42e6-8b3b-a471dcaee1aa admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:09.194098 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1317/2625] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:28:09 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:28:09.195698 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6d027-c74f-4c9d-b5d2-cb7bc3a00163 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:09.206514 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6d027-c74f-4c9d-b5d2-cb7bc3a00163 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:09.211221 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f4c42-14a4-4689-aa35-0b2239bf9213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:09.211871 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f4c42-14a4-4689-aa35-0b2239bf9213 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:09.212148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f4c42-14a4-4689-aa35-0b2239bf9213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:09.212418 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f4c42-14a4-4689-aa35-0b2239bf9213 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:09.213129 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f4c42-14a4-4689-aa35-0b2239bf9213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:09.214835 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f4c42-14a4-4689-aa35-0b2239bf9213 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:09.226015 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1309/2626] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:28:09.232933 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65a420-a87c-42e6-8b3b-a471dcaee1aa admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:09.242811 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65a420-a87c-42e6-8b3b-a471dcaee1aa admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:09.247915 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9d7f3-6e89-46a9-afcf-c0a45683952d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:09.248571 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9d7f3-6e89-46a9-afcf-c0a45683952d admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:09.248848 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9d7f3-6e89-46a9-afcf-c0a45683952d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:09.249123 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9d7f3-6e89-46a9-afcf-c0a45683952d admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:09.249866 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9d7f3-6e89-46a9-afcf-c0a45683952d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:09.251514 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9d7f3-6e89-46a9-afcf-c0a45683952d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:09.262181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1318/2627] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:28:09.266280 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f4c42-14a4-4689-aa35-0b2239bf9213 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:09.280773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f4c42-14a4-4689-aa35-0b2239bf9213 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:09.285590 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658fca5-2d71-4d65-a164-a79c1a03ef87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:09.287576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658fca5-2d71-4d65-a164-a79c1a03ef87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:09.287576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658fca5-2d71-4d65-a164-a79c1a03ef87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:09.287576 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658fca5-2d71-4d65-a164-a79c1a03ef87 admin admin] PATH_INFO: `/v3/projects/fbaba74aca3d447eb9cc9d56700fa13e/users/066750f0db754834aa2984c2cfd40e9f/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:09.302788 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658fca5-2d71-4d65-a164-a79c1a03ef87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbaba74aca3d447eb9cc9d56700fa13e, user_id=066750f0db754834aa2984c2cfd40e9f, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:09.305548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658fca5-2d71-4d65-a164-a79c1a03ef87 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:09.390190 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1310/2628] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:28:09 2022] PUT /identity/v3/projects/fbaba74aca3d447eb9cc9d56700fa13e/users/066750f0db754834aa2984c2cfd40e9f/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:28:09.395332 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9cdc09-5ac1-481f-8405-41f5191cb66a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:09.395652 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9cdc09-5ac1-481f-8405-41f5191cb66a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:09.395932 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9cdc09-5ac1-481f-8405-41f5191cb66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:09.413170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-cd9cdc09-5ac1-481f-8405-41f5191cb66a None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:28:09.414395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cd9cdc09-5ac1-481f-8405-41f5191cb66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:09.474102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1319/2629] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:28:09.484175 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658fca5-2d71-4d65-a164-a79c1a03ef87 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:09.486393 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8658fca5-2d71-4d65-a164-a79c1a03ef87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:09.542032 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658fca5-2d71-4d65-a164-a79c1a03ef87 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:09.546285 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e3f24-4fc7-42d6-9abd-aa740d01ad17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:09.546932 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e3f24-4fc7-42d6-9abd-aa740d01ad17 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:09.547218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e3f24-4fc7-42d6-9abd-aa740d01ad17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:09.547494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e3f24-4fc7-42d6-9abd-aa740d01ad17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:09.556197 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e3f24-4fc7-42d6-9abd-aa740d01ad17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:09.557640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e3f24-4fc7-42d6-9abd-aa740d01ad17 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:09.567732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1311/2630] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:28:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:28:15.445553 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cfa78-512f-4833-bfc2-a11a69a56b8a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:15.446148 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cfa78-512f-4833-bfc2-a11a69a56b8a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:15.450913 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cfa78-512f-4833-bfc2-a11a69a56b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:15.485739 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-419cfa78-512f-4833-bfc2-a11a69a56b8a None None] MFA Rules not processed for user `066750f0db754834aa2984c2cfd40e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:28:15.487127 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-419cfa78-512f-4833-bfc2-a11a69a56b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:15.608052 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1320/2631] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:28:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:28:15.623307 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e3f24-4fc7-42d6-9abd-aa740d01ad17 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:15.625760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-d63e3f24-4fc7-42d6-9abd-aa740d01ad17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:15.746889 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e3f24-4fc7-42d6-9abd-aa740d01ad17 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:15.756120 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbf6fd-0002-44a2-aad0-9d78e6d8214a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:15.757475 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbf6fd-0002-44a2-aad0-9d78e6d8214a service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:15.757920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbf6fd-0002-44a2-aad0-9d78e6d8214a service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:15.758662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbf6fd-0002-44a2-aad0-9d78e6d8214a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:15.768294 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbf6fd-0002-44a2-aad0-9d78e6d8214a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:15.770539 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbf6fd-0002-44a2-aad0-9d78e6d8214a service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:15.783142 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1312/2632] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:28:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:28:16.311170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e724a-1420-4e1e-afbc-3f53b67b4e50 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:16.311873 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e724a-1420-4e1e-afbc-3f53b67b4e50 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:16.312324 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e724a-1420-4e1e-afbc-3f53b67b4e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:16.347607 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-132e724a-1420-4e1e-afbc-3f53b67b4e50 None None] MFA Rules not processed for user `e916a70861fc44e69160faf793999f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:28:16.349158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-132e724a-1420-4e1e-afbc-3f53b67b4e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:16.424463 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1321/2633] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:28:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:28:16.802246 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbf6fd-0002-44a2-aad0-9d78e6d8214a service nova] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:16.804505 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9edbf6fd-0002-44a2-aad0-9d78e6d8214a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:16.817979 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbf6fd-0002-44a2-aad0-9d78e6d8214a service nova] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:16.821742 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c198d-e92c-4235-8b6d-0f303467a976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:16.822537 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c198d-e92c-4235-8b6d-0f303467a976 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:16.828302 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c198d-e92c-4235-8b6d-0f303467a976 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:16.828302 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c198d-e92c-4235-8b6d-0f303467a976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:16.828302 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-324c198d-e92c-4235-8b6d-0f303467a976 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:16.840342 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c198d-e92c-4235-8b6d-0f303467a976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:16.841945 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c198d-e92c-4235-8b6d-0f303467a976 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:16.859972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1313/2634] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:28:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:28:19.328331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa860c-fe87-4615-a844-0f7832958ea0 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:19.328848 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa860c-fe87-4615-a844-0f7832958ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:19.328946 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa860c-fe87-4615-a844-0f7832958ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:19.347975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-95aa860c-fe87-4615-a844-0f7832958ea0 None None] MFA Rules not processed for user `066750f0db754834aa2984c2cfd40e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:28:19.349380 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-95aa860c-fe87-4615-a844-0f7832958ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:19.357333 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1322/2635] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:28:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:28:23.826023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb8776-7014-4ff4-a7a3-90cfe4458705 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:23.826562 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb8776-7014-4ff4-a7a3-90cfe4458705 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:23.826562 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb8776-7014-4ff4-a7a3-90cfe4458705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:23.847574 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-7bdb8776-7014-4ff4-a7a3-90cfe4458705 None None] MFA Rules not processed for user `1a7181297bf14a57b3bf1f3c8b178d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:28:23.848763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7bdb8776-7014-4ff4-a7a3-90cfe4458705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:23.907073 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1314/2636] 10.222.0.76 () {58 vars in 1009 bytes} [Mon May 16 15:28:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:28:23.918847 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa860c-fe87-4615-a844-0f7832958ea0 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:23.920286 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-95aa860c-fe87-4615-a844-0f7832958ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:24.003263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa860c-fe87-4615-a844-0f7832958ea0 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:24.011744 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070d8df-3e2d-4185-8870-b571c26a396b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33470e30760842ca9e96bb7f0cf9f07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:24.013098 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070d8df-3e2d-4185-8870-b571c26a396b service swift] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:24.013679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070d8df-3e2d-4185-8870-b571c26a396b service swift] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:24.013764 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070d8df-3e2d-4185-8870-b571c26a396b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:24.023357 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070d8df-3e2d-4185-8870-b571c26a396b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:24.025029 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070d8df-3e2d-4185-8870-b571c26a396b service swift] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:24.042286 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1323/2637] 10.222.0.76 () {60 vars in 1384 bytes} [Mon May 16 15:28:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:28:29.447750 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb8776-7014-4ff4-a7a3-90cfe4458705 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:29.449180 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-7bdb8776-7014-4ff4-a7a3-90cfe4458705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:29.463148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb8776-7014-4ff4-a7a3-90cfe4458705 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:29.468173 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b947d1-48d6-4471-9b0e-5315a7c099b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:29.469055 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b947d1-48d6-4471-9b0e-5315a7c099b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:29.469335 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b947d1-48d6-4471-9b0e-5315a7c099b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:29.469609 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b947d1-48d6-4471-9b0e-5315a7c099b3 admin admin] PATH_INFO: `/v3/users/7bd5c32651c44f6e9f3c78fda777a50e` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:29.470845 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b947d1-48d6-4471-9b0e-5315a7c099b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bd5c32651c44f6e9f3c78fda777a50e)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:29.472780 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b947d1-48d6-4471-9b0e-5315a7c099b3 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:29.673828 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-83b947d1-48d6-4471-9b0e-5315a7c099b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bd5c32651c44f6e9f3c78fda777a50e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:29.791119 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-83b947d1-48d6-4471-9b0e-5315a7c099b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bd5c32651c44f6e9f3c78fda777a50e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:29.791748 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-83b947d1-48d6-4471-9b0e-5315a7c099b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bd5c32651c44f6e9f3c78fda777a50e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:29.804249 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-83b947d1-48d6-4471-9b0e-5315a7c099b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bd5c32651c44f6e9f3c78fda777a50e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:29.804917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-83b947d1-48d6-4471-9b0e-5315a7c099b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bd5c32651c44f6e9f3c78fda777a50e'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:29.817907 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1315/2638] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:28:29 2022] DELETE /identity/v3/users/7bd5c32651c44f6e9f3c78fda777a50e => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:28:29.822659 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb34d6-3ba7-4960-ba69-29fb2ffd7b24 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:29.823218 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb34d6-3ba7-4960-ba69-29fb2ffd7b24 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:29.823218 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb34d6-3ba7-4960-ba69-29fb2ffd7b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:29.844092 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-acfb34d6-3ba7-4960-ba69-29fb2ffd7b24 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:28:29.845348 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-acfb34d6-3ba7-4960-ba69-29fb2ffd7b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:29.908396 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1324/2639] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:28:29.919068 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b947d1-48d6-4471-9b0e-5315a7c099b3 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:29.920486 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-83b947d1-48d6-4471-9b0e-5315a7c099b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:30.007277 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b947d1-48d6-4471-9b0e-5315a7c099b3 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:30.014762 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfc736-3868-402a-ac8a-0a0fc7b53f5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:30.015434 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfc736-3868-402a-ac8a-0a0fc7b53f5c service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:30.015718 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfc736-3868-402a-ac8a-0a0fc7b53f5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:30.016074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfc736-3868-402a-ac8a-0a0fc7b53f5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:30.027379 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebfc736-3868-402a-ac8a-0a0fc7b53f5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:30.030065 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebfc736-3868-402a-ac8a-0a0fc7b53f5c service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:30.042376 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1316/2640] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:28:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:28:30.530929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb34d6-3ba7-4960-ba69-29fb2ffd7b24 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:30.532386 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-acfb34d6-3ba7-4960-ba69-29fb2ffd7b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:30.545222 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb34d6-3ba7-4960-ba69-29fb2ffd7b24 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:30.550153 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729629b9-2439-45ed-aac5-0a4f09303f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:30.551798 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729629b9-2439-45ed-aac5-0a4f09303f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:30.551798 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729629b9-2439-45ed-aac5-0a4f09303f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:30.551798 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729629b9-2439-45ed-aac5-0a4f09303f3d admin admin] PATH_INFO: `/v3/projects/c934fa4e30f3405bb1016c570d30f1b1` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:30.552806 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729629b9-2439-45ed-aac5-0a4f09303f3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c934fa4e30f3405bb1016c570d30f1b1)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:30.554850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729629b9-2439-45ed-aac5-0a4f09303f3d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:30.659640 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-729629b9-2439-45ed-aac5-0a4f09303f3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c934fa4e30f3405bb1016c570d30f1b1', 'request_id': 'req-729629b9-2439-45ed-aac5-0a4f09303f3d'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:30.666335 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-729629b9-2439-45ed-aac5-0a4f09303f3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c934fa4e30f3405bb1016c570d30f1b1', 'request_id': 'req-729629b9-2439-45ed-aac5-0a4f09303f3d'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:30.732453 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-729629b9-2439-45ed-aac5-0a4f09303f3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c934fa4e30f3405bb1016c570d30f1b1', 'request_id': 'req-729629b9-2439-45ed-aac5-0a4f09303f3d'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:30.756713 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-729629b9-2439-45ed-aac5-0a4f09303f3d admin admin] The token cache is being invalidate because project c934fa4e30f3405bb1016c570d30f1b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:28:30.756963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-729629b9-2439-45ed-aac5-0a4f09303f3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:30.757618 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-729629b9-2439-45ed-aac5-0a4f09303f3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:28:30.762221 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1325/2641] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:28:30 2022] DELETE /identity/v3/projects/c934fa4e30f3405bb1016c570d30f1b1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:28:30.766312 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd3b78-ac7e-4105-98b8-b735e60ccbb1 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:30.768062 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd3b78-ac7e-4105-98b8-b735e60ccbb1 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:30.768354 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd3b78-ac7e-4105-98b8-b735e60ccbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:30.790649 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-45fd3b78-ac7e-4105-98b8-b735e60ccbb1 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:28:30.791977 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-45fd3b78-ac7e-4105-98b8-b735e60ccbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:30.852653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1317/2642] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:28:30.861932 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460448c-9b28-4c3a-af41-e55a309008b7 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:30.862461 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460448c-9b28-4c3a-af41-e55a309008b7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:30.862582 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460448c-9b28-4c3a-af41-e55a309008b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:30.880882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1460448c-9b28-4c3a-af41-e55a309008b7 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:28:30.882066 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1460448c-9b28-4c3a-af41-e55a309008b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:30.890878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1326/2643] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:28:30.894896 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd3b78-ac7e-4105-98b8-b735e60ccbb1 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:30.904662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd3b78-ac7e-4105-98b8-b735e60ccbb1 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:30.909187 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd199e-c4e0-488e-b71d-3a5b182365e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:30.909838 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd199e-c4e0-488e-b71d-3a5b182365e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:30.910136 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd199e-c4e0-488e-b71d-3a5b182365e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:30.910437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd199e-c4e0-488e-b71d-3a5b182365e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:30.911198 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd199e-c4e0-488e-b71d-3a5b182365e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:28:30.911507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd199e-c4e0-488e-b71d-3a5b182365e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:30.913270 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd199e-c4e0-488e-b71d-3a5b182365e5 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:30.929865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1318/2644] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:28:30.930998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460448c-9b28-4c3a-af41-e55a309008b7 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:30.942026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460448c-9b28-4c3a-af41-e55a309008b7 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:30.947187 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a7bd8-c6e9-4efd-8903-437d56fac62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:30.947839 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a7bd8-c6e9-4efd-8903-437d56fac62e admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:30.948137 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a7bd8-c6e9-4efd-8903-437d56fac62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:30.948391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a7bd8-c6e9-4efd-8903-437d56fac62e admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:30.949090 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a7bd8-c6e9-4efd-8903-437d56fac62e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:30.951685 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a7bd8-c6e9-4efd-8903-437d56fac62e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:31.236350 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1327/2645] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:28:30 2022] POST /identity/v3/projects => generated 371 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:28:31.240770 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd199e-c4e0-488e-b71d-3a5b182365e5 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:31.257021 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd199e-c4e0-488e-b71d-3a5b182365e5 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:31.330227 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9a4a7-5860-485f-8e92-d010a3371ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:31.331008 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9a4a7-5860-485f-8e92-d010a3371ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:31.331353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9a4a7-5860-485f-8e92-d010a3371ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:31.331693 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9a4a7-5860-485f-8e92-d010a3371ab5 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:31.332459 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9a4a7-5860-485f-8e92-d010a3371ab5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:31.334586 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9a4a7-5860-485f-8e92-d010a3371ab5 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:31.552462 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1319/2646] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:28:31 2022] POST /identity/v3/users => generated 286 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:28:31.553960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a7bd8-c6e9-4efd-8903-437d56fac62e admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:31.564675 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a7bd8-c6e9-4efd-8903-437d56fac62e admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:31.572248 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b05261-e4da-453c-8c1a-10de51c1ab57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:31.573105 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b05261-e4da-453c-8c1a-10de51c1ab57 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:31.573491 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b05261-e4da-453c-8c1a-10de51c1ab57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:31.573777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b05261-e4da-453c-8c1a-10de51c1ab57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:31.574595 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b05261-e4da-453c-8c1a-10de51c1ab57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:31.577008 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b05261-e4da-453c-8c1a-10de51c1ab57 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:31.595164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1328/2647] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:28:31.599251 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9a4a7-5860-485f-8e92-d010a3371ab5 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:31.615179 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9a4a7-5860-485f-8e92-d010a3371ab5 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:31.621383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631a241-fdb6-41b6-9b9b-1d2cd58a2e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:31.622538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631a241-fdb6-41b6-9b9b-1d2cd58a2e26 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:31.622818 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631a241-fdb6-41b6-9b9b-1d2cd58a2e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:31.623091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631a241-fdb6-41b6-9b9b-1d2cd58a2e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:31.623818 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631a241-fdb6-41b6-9b9b-1d2cd58a2e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:31.625464 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631a241-fdb6-41b6-9b9b-1d2cd58a2e26 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:31.643070 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1320/2648] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:28:31.648041 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b05261-e4da-453c-8c1a-10de51c1ab57 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:31.658797 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b05261-e4da-453c-8c1a-10de51c1ab57 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:31.663919 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d993a7d-1eb7-4a4c-8507-caf67d332721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:31.664888 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d993a7d-1eb7-4a4c-8507-caf67d332721 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:31.665147 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d993a7d-1eb7-4a4c-8507-caf67d332721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:31.665425 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d993a7d-1eb7-4a4c-8507-caf67d332721 admin admin] PATH_INFO: `/v3/projects/38f2e257d56d477d98132d62b4f87b19/users/b52ac049f28842cbb53a283a40142faf/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:31.682882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d993a7d-1eb7-4a4c-8507-caf67d332721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38f2e257d56d477d98132d62b4f87b19, user_id=b52ac049f28842cbb53a283a40142faf, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:31.686119 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d993a7d-1eb7-4a4c-8507-caf67d332721 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:31.756416 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1329/2649] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:28:31 2022] PUT /identity/v3/projects/38f2e257d56d477d98132d62b4f87b19/users/b52ac049f28842cbb53a283a40142faf/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:28:31.761930 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5e9c3-dd8d-48cb-963f-6894aa3493d3 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:31.762255 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5e9c3-dd8d-48cb-963f-6894aa3493d3 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:31.762596 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5e9c3-dd8d-48cb-963f-6894aa3493d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:31.781605 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-42b5e9c3-dd8d-48cb-963f-6894aa3493d3 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:28:31.782986 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-42b5e9c3-dd8d-48cb-963f-6894aa3493d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:31.848188 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1321/2650] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:28:31.858318 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d993a7d-1eb7-4a4c-8507-caf67d332721 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:31.860055 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7d993a7d-1eb7-4a4c-8507-caf67d332721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:31.915832 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d993a7d-1eb7-4a4c-8507-caf67d332721 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:31.920119 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0ecf7-a005-45f6-92c0-2bc73d45f433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:31.920758 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0ecf7-a005-45f6-92c0-2bc73d45f433 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:31.921044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0ecf7-a005-45f6-92c0-2bc73d45f433 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:31.921322 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0ecf7-a005-45f6-92c0-2bc73d45f433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:31.930121 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0ecf7-a005-45f6-92c0-2bc73d45f433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:31.931590 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0ecf7-a005-45f6-92c0-2bc73d45f433 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:31.941516 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1330/2651] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:28:33.408548 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a152d-eadb-4380-ae85-d360543637c0 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:33.420632 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a152d-eadb-4380-ae85-d360543637c0 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:33.420632 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a152d-eadb-4380-ae85-d360543637c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:33.437072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-159a152d-eadb-4380-ae85-d360543637c0 None None] MFA Rules not processed for user `b52ac049f28842cbb53a283a40142faf`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:28:33.438577 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-159a152d-eadb-4380-ae85-d360543637c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:33.510627 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1322/2652] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:28:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:28:33.527353 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0ecf7-a005-45f6-92c0-2bc73d45f433 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:33.532371 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-75e0ecf7-a005-45f6-92c0-2bc73d45f433 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:33.619655 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0ecf7-a005-45f6-92c0-2bc73d45f433 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:33.623480 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995b546-2459-4573-ab01-adf29e1e18c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:33.624562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995b546-2459-4573-ab01-adf29e1e18c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:33.624562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995b546-2459-4573-ab01-adf29e1e18c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:33.624753 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995b546-2459-4573-ab01-adf29e1e18c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:33.633829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995b546-2459-4573-ab01-adf29e1e18c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:33.635645 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995b546-2459-4573-ab01-adf29e1e18c6 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:33.648196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1331/2653] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:28:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:28:35.295292 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ca635-3ff5-4319-aa6b-7e87237a8660 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:35.295801 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ca635-3ff5-4319-aa6b-7e87237a8660 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:35.296007 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ca635-3ff5-4319-aa6b-7e87237a8660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:35.320756 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-ac9ca635-3ff5-4319-aa6b-7e87237a8660 None None] MFA Rules not processed for user `b52ac049f28842cbb53a283a40142faf`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:28:35.322709 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ac9ca635-3ff5-4319-aa6b-7e87237a8660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:35.346327 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1323/2654] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:28:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:28:41.767678 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199fe4e-06a0-4ada-8a78-ea3df6afd461 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:41.768703 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199fe4e-06a0-4ada-8a78-ea3df6afd461 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:41.769273 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199fe4e-06a0-4ada-8a78-ea3df6afd461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:41.787611 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-2199fe4e-06a0-4ada-8a78-ea3df6afd461 None None] MFA Rules not processed for user `1a7181297bf14a57b3bf1f3c8b178d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:28:41.788795 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2199fe4e-06a0-4ada-8a78-ea3df6afd461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:41.844005 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1332/2655] 10.222.0.76 () {58 vars in 967 bytes} [Mon May 16 15:28:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:28:41.867177 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ca635-3ff5-4319-aa6b-7e87237a8660 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:41.868583 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ac9ca635-3ff5-4319-aa6b-7e87237a8660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:41.938307 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ca635-3ff5-4319-aa6b-7e87237a8660 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:41.943216 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e108e96-8690-4977-8d40-0b209fd05436 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33470e30760842ca9e96bb7f0cf9f07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:41.944005 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e108e96-8690-4977-8d40-0b209fd05436 service swift] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:41.944288 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e108e96-8690-4977-8d40-0b209fd05436 service swift] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:41.944561 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e108e96-8690-4977-8d40-0b209fd05436 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:41.952680 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e108e96-8690-4977-8d40-0b209fd05436 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:41.954306 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e108e96-8690-4977-8d40-0b209fd05436 service swift] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:41.962340 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1324/2656] 10.222.0.76 () {60 vars in 1384 bytes} [Mon May 16 15:28:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:28:49.953738 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199fe4e-06a0-4ada-8a78-ea3df6afd461 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:28:49.956987 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2199fe4e-06a0-4ada-8a78-ea3df6afd461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:49.971108 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199fe4e-06a0-4ada-8a78-ea3df6afd461 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:28:49.975378 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01df48b-c918-4645-b179-9c78b152b646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:28:49.976486 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01df48b-c918-4645-b179-9c78b152b646 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:49.977276 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01df48b-c918-4645-b179-9c78b152b646 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:49.977755 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01df48b-c918-4645-b179-9c78b152b646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:49.980000 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d01df48b-c918-4645-b179-9c78b152b646 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:50.065546 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01df48b-c918-4645-b179-9c78b152b646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:28:50.067178 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01df48b-c918-4645-b179-9c78b152b646 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:28:50.077846 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1333/2657] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:28:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:28:55.841308 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de96c3-3d05-433a-926e-9f1185589057 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:28:55.841806 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de96c3-3d05-433a-926e-9f1185589057 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:28:55.841925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de96c3-3d05-433a-926e-9f1185589057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:28:55.860305 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-c6de96c3-3d05-433a-926e-9f1185589057 None None] MFA Rules not processed for user `b52ac049f28842cbb53a283a40142faf`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:28:55.861570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c6de96c3-3d05-433a-926e-9f1185589057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:28:55.868466 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1325/2658] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:28:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:29:16.608313 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a480bdb-d5b4-4582-99de-032f1435df38 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:16.608313 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a480bdb-d5b4-4582-99de-032f1435df38 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:16.608313 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a480bdb-d5b4-4582-99de-032f1435df38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:16.634390 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-3a480bdb-d5b4-4582-99de-032f1435df38 None None] MFA Rules not processed for user `1a7181297bf14a57b3bf1f3c8b178d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:29:16.635638 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3a480bdb-d5b4-4582-99de-032f1435df38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:16.643480 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1334/2659] 10.222.0.76 () {58 vars in 1009 bytes} [Mon May 16 15:29:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:29:16.656590 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de96c3-3d05-433a-926e-9f1185589057 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:16.668020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de96c3-3d05-433a-926e-9f1185589057 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:16.673238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077f070-a5c8-473c-ad92-3c2ceeeefdc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33470e30760842ca9e96bb7f0cf9f07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:16.673961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077f070-a5c8-473c-ad92-3c2ceeeefdc4 service swift] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:16.674288 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077f070-a5c8-473c-ad92-3c2ceeeefdc4 service swift] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:16.674677 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077f070-a5c8-473c-ad92-3c2ceeeefdc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:16.682778 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077f070-a5c8-473c-ad92-3c2ceeeefdc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:16.684370 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077f070-a5c8-473c-ad92-3c2ceeeefdc4 service swift] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:16.693174 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1326/2660] 10.222.0.76 () {60 vars in 1384 bytes} [Mon May 16 15:29:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:29:31.274735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a480bdb-d5b4-4582-99de-032f1435df38 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:31.284774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a480bdb-d5b4-4582-99de-032f1435df38 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:31.288789 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d31b79-8b36-44aa-a5d6-6e1d06b6b6ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:31.289447 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d31b79-8b36-44aa-a5d6-6e1d06b6b6ba service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:31.289730 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d31b79-8b36-44aa-a5d6-6e1d06b6b6ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:31.290036 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d31b79-8b36-44aa-a5d6-6e1d06b6b6ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:31.291890 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-09d31b79-8b36-44aa-a5d6-6e1d06b6b6ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:31.306099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d31b79-8b36-44aa-a5d6-6e1d06b6b6ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:31.307871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d31b79-8b36-44aa-a5d6-6e1d06b6b6ba service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:31.327279 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1335/2661] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:29:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:29:34.358227 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6f034-5be7-4f8f-9cee-48c5993a2dd0 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:34.362926 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6f034-5be7-4f8f-9cee-48c5993a2dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:34.362926 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6f034-5be7-4f8f-9cee-48c5993a2dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:34.379456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9be6f034-5be7-4f8f-9cee-48c5993a2dd0 None None] MFA Rules not processed for user `1a7181297bf14a57b3bf1f3c8b178d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:29:34.380769 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9be6f034-5be7-4f8f-9cee-48c5993a2dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:34.391304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1327/2662] 10.222.0.76 () {58 vars in 967 bytes} [Mon May 16 15:29:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:29:34.408472 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d31b79-8b36-44aa-a5d6-6e1d06b6b6ba service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:34.423571 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d31b79-8b36-44aa-a5d6-6e1d06b6b6ba service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:34.431574 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098ad7c-db00-4aa5-aeeb-ae8173e444e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33470e30760842ca9e96bb7f0cf9f07d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:34.432455 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098ad7c-db00-4aa5-aeeb-ae8173e444e5 service swift] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:34.432916 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098ad7c-db00-4aa5-aeeb-ae8173e444e5 service swift] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:34.433368 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098ad7c-db00-4aa5-aeeb-ae8173e444e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:34.443418 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098ad7c-db00-4aa5-aeeb-ae8173e444e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:34.445053 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098ad7c-db00-4aa5-aeeb-ae8173e444e5 service swift] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:34.460296 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1336/2663] 10.222.0.76 () {60 vars in 1384 bytes} [Mon May 16 15:29:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 15:29:34.992701 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6f034-5be7-4f8f-9cee-48c5993a2dd0 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:34.994613 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9be6f034-5be7-4f8f-9cee-48c5993a2dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:35.009081 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6f034-5be7-4f8f-9cee-48c5993a2dd0 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:35.013978 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4989d-e19d-4a5b-be40-16869adcafb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:35.014811 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4989d-e19d-4a5b-be40-16869adcafb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:35.015085 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4989d-e19d-4a5b-be40-16869adcafb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:35.015354 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4989d-e19d-4a5b-be40-16869adcafb4 admin admin] PATH_INFO: `/v3/users/d3492cec550a46598e09c48474a4c6fb` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:35.016570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4989d-e19d-4a5b-be40-16869adcafb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3492cec550a46598e09c48474a4c6fb)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:35.018534 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4989d-e19d-4a5b-be40-16869adcafb4 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:35.310433 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-00f4989d-e19d-4a5b-be40-16869adcafb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3492cec550a46598e09c48474a4c6fb'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:35.380528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-00f4989d-e19d-4a5b-be40-16869adcafb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3492cec550a46598e09c48474a4c6fb'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:35.381293 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-00f4989d-e19d-4a5b-be40-16869adcafb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3492cec550a46598e09c48474a4c6fb'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:35.393673 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-00f4989d-e19d-4a5b-be40-16869adcafb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3492cec550a46598e09c48474a4c6fb'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:35.394343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-00f4989d-e19d-4a5b-be40-16869adcafb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3492cec550a46598e09c48474a4c6fb'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:35.406079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1328/2664] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:29:34 2022] DELETE /identity/v3/users/d3492cec550a46598e09c48474a4c6fb => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:29:35.697130 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098ad7c-db00-4aa5-aeeb-ae8173e444e5 service swift] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:35.704130 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098ad7c-db00-4aa5-aeeb-ae8173e444e5 service swift] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:35.766187 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c3779-a176-474a-bde6-fbb46c2d58b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:35.767007 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c3779-a176-474a-bde6-fbb46c2d58b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:35.767291 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c3779-a176-474a-bde6-fbb46c2d58b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:35.767586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c3779-a176-474a-bde6-fbb46c2d58b9 admin admin] PATH_INFO: `/v3/projects/f2241c9641bb401aa9f1c6930c513552` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:35.768904 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c3779-a176-474a-bde6-fbb46c2d58b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2241c9641bb401aa9f1c6930c513552)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:35.771381 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c3779-a176-474a-bde6-fbb46c2d58b9 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:35.886621 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a77c3779-a176-474a-bde6-fbb46c2d58b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2241c9641bb401aa9f1c6930c513552', 'request_id': 'req-a77c3779-a176-474a-bde6-fbb46c2d58b9'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:35.893255 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a77c3779-a176-474a-bde6-fbb46c2d58b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2241c9641bb401aa9f1c6930c513552', 'request_id': 'req-a77c3779-a176-474a-bde6-fbb46c2d58b9'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:35.974222 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a77c3779-a176-474a-bde6-fbb46c2d58b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2241c9641bb401aa9f1c6930c513552', 'request_id': 'req-a77c3779-a176-474a-bde6-fbb46c2d58b9'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:35.984772 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a77c3779-a176-474a-bde6-fbb46c2d58b9 admin admin] The token cache is being invalidate because project f2241c9641bb401aa9f1c6930c513552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:29:35.985061 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a77c3779-a176-474a-bde6-fbb46c2d58b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:35.985691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a77c3779-a176-474a-bde6-fbb46c2d58b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:35.987370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1337/2665] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:29:35 2022] DELETE /identity/v3/projects/f2241c9641bb401aa9f1c6930c513552 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:29:35.992489 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280fc6b-e0bd-4f0a-8da2-1b3966429942 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:35.992784 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280fc6b-e0bd-4f0a-8da2-1b3966429942 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:35.993060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280fc6b-e0bd-4f0a-8da2-1b3966429942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:36.011249 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0280fc6b-e0bd-4f0a-8da2-1b3966429942 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:29:36.012487 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0280fc6b-e0bd-4f0a-8da2-1b3966429942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:36.072529 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1329/2666] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:29:36.080708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf8648-673d-4bd9-ae68-206184f7a463 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:36.081001 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf8648-673d-4bd9-ae68-206184f7a463 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:36.081284 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf8648-673d-4bd9-ae68-206184f7a463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:36.100526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-0dcf8648-673d-4bd9-ae68-206184f7a463 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:29:36.101718 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0dcf8648-673d-4bd9-ae68-206184f7a463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:36.109760 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1338/2667] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:29:36.114159 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280fc6b-e0bd-4f0a-8da2-1b3966429942 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:36.123660 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280fc6b-e0bd-4f0a-8da2-1b3966429942 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:36.128272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27c613-cce0-49c8-9c67-f60ecc19b8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:36.128919 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27c613-cce0-49c8-9c67-f60ecc19b8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:36.129199 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27c613-cce0-49c8-9c67-f60ecc19b8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:36.129470 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27c613-cce0-49c8-9c67-f60ecc19b8a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:36.130732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27c613-cce0-49c8-9c67-f60ecc19b8a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:29:36.131039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27c613-cce0-49c8-9c67-f60ecc19b8a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:36.132629 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27c613-cce0-49c8-9c67-f60ecc19b8a9 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:36.143966 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1330/2668] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:29:36.148962 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf8648-673d-4bd9-ae68-206184f7a463 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:36.158474 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf8648-673d-4bd9-ae68-206184f7a463 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:36.164634 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a9bca-f27d-4c83-9397-5196d6f2455f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:36.165289 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a9bca-f27d-4c83-9397-5196d6f2455f admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:36.167523 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a9bca-f27d-4c83-9397-5196d6f2455f admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:36.167822 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a9bca-f27d-4c83-9397-5196d6f2455f admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:36.168530 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a9bca-f27d-4c83-9397-5196d6f2455f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:36.170481 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a9bca-f27d-4c83-9397-5196d6f2455f admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:36.305041 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1339/2669] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:29:36 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:29:36.307830 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27c613-cce0-49c8-9c67-f60ecc19b8a9 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:36.318016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27c613-cce0-49c8-9c67-f60ecc19b8a9 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:36.375315 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff45b1d-925a-4565-835e-138186f7883c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:36.376035 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff45b1d-925a-4565-835e-138186f7883c admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:36.376309 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff45b1d-925a-4565-835e-138186f7883c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:36.376579 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff45b1d-925a-4565-835e-138186f7883c admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:36.377285 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff45b1d-925a-4565-835e-138186f7883c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:36.379289 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff45b1d-925a-4565-835e-138186f7883c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:36.472622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1331/2670] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:29:36 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:29:36.478260 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a9bca-f27d-4c83-9397-5196d6f2455f admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:36.488574 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a9bca-f27d-4c83-9397-5196d6f2455f admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:36.493219 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b54fd-f2b2-4993-b5e8-11b3e2487235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:36.493865 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b54fd-f2b2-4993-b5e8-11b3e2487235 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:36.494238 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b54fd-f2b2-4993-b5e8-11b3e2487235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:36.494472 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b54fd-f2b2-4993-b5e8-11b3e2487235 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:36.499360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b54fd-f2b2-4993-b5e8-11b3e2487235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:36.499360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b54fd-f2b2-4993-b5e8-11b3e2487235 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:36.507061 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1340/2671] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:29:36.511177 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff45b1d-925a-4565-835e-138186f7883c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:36.521846 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff45b1d-925a-4565-835e-138186f7883c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:36.526754 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2d254-ccb1-457f-b75c-2eb1e407a27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:36.527405 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2d254-ccb1-457f-b75c-2eb1e407a27e admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:36.527726 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2d254-ccb1-457f-b75c-2eb1e407a27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:36.527965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2d254-ccb1-457f-b75c-2eb1e407a27e admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:36.528685 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2d254-ccb1-457f-b75c-2eb1e407a27e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:36.530305 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2d254-ccb1-457f-b75c-2eb1e407a27e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:36.540620 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1332/2672] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:29:36.550701 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b54fd-f2b2-4993-b5e8-11b3e2487235 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:36.554736 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b54fd-f2b2-4993-b5e8-11b3e2487235 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:36.559539 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab529f-2e03-4ff7-b374-3a44177be32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:36.560397 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab529f-2e03-4ff7-b374-3a44177be32e admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:36.560737 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab529f-2e03-4ff7-b374-3a44177be32e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:36.561017 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab529f-2e03-4ff7-b374-3a44177be32e admin admin] PATH_INFO: `/v3/projects/b8a29c645b0e414196fd433f2c6fa249/users/ce393968514a4579bfcb113a893ad4a4/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:36.575896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab529f-2e03-4ff7-b374-3a44177be32e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a29c645b0e414196fd433f2c6fa249, user_id=ce393968514a4579bfcb113a893ad4a4, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:36.578612 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab529f-2e03-4ff7-b374-3a44177be32e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:36.678287 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1341/2673] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:29:36 2022] PUT /identity/v3/projects/b8a29c645b0e414196fd433f2c6fa249/users/ce393968514a4579bfcb113a893ad4a4/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:29:36.688430 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7e1da-f7b7-4d52-a9da-b5dd8b8cde8c None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:36.691669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7e1da-f7b7-4d52-a9da-b5dd8b8cde8c None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:36.691669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7e1da-f7b7-4d52-a9da-b5dd8b8cde8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:36.716181 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-4ef7e1da-f7b7-4d52-a9da-b5dd8b8cde8c None None] MFA Rules not processed for user `ce393968514a4579bfcb113a893ad4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:29:36.720411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4ef7e1da-f7b7-4d52-a9da-b5dd8b8cde8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:36.782003 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1333/2674] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:29:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:29:36.793049 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab529f-2e03-4ff7-b374-3a44177be32e admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:36.794753 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7eab529f-2e03-4ff7-b374-3a44177be32e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:36.867495 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab529f-2e03-4ff7-b374-3a44177be32e admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:36.875522 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538cca7-2758-4354-9195-ff4f73ade9d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:36.876288 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538cca7-2758-4354-9195-ff4f73ade9d4 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:36.876571 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538cca7-2758-4354-9195-ff4f73ade9d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:36.876876 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538cca7-2758-4354-9195-ff4f73ade9d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:36.885892 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538cca7-2758-4354-9195-ff4f73ade9d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:36.887658 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538cca7-2758-4354-9195-ff4f73ade9d4 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:36.897811 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1342/2675] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:29:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:29:37.477442 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7e1da-f7b7-4d52-a9da-b5dd8b8cde8c None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:37.479662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-4ef7e1da-f7b7-4d52-a9da-b5dd8b8cde8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:37.556602 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7e1da-f7b7-4d52-a9da-b5dd8b8cde8c None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:37.569734 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1894a-e319-42bd-a21d-bf06ea48e7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:37.569734 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1894a-e319-42bd-a21d-bf06ea48e7ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:37.569734 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1894a-e319-42bd-a21d-bf06ea48e7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:37.569734 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1894a-e319-42bd-a21d-bf06ea48e7ea admin admin] PATH_INFO: `/v3/users/b52ac049f28842cbb53a283a40142faf` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:37.570253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1894a-e319-42bd-a21d-bf06ea48e7ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=b52ac049f28842cbb53a283a40142faf)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:37.570253 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1894a-e319-42bd-a21d-bf06ea48e7ea admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:37.731614 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e8d1894a-e319-42bd-a21d-bf06ea48e7ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b52ac049f28842cbb53a283a40142faf'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:37.820732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e8d1894a-e319-42bd-a21d-bf06ea48e7ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b52ac049f28842cbb53a283a40142faf'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:37.821373 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e8d1894a-e319-42bd-a21d-bf06ea48e7ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b52ac049f28842cbb53a283a40142faf'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:37.834845 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e8d1894a-e319-42bd-a21d-bf06ea48e7ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b52ac049f28842cbb53a283a40142faf'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:37.835571 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-e8d1894a-e319-42bd-a21d-bf06ea48e7ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b52ac049f28842cbb53a283a40142faf'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:37.848257 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1334/2676] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:29:37 2022] DELETE /identity/v3/users/b52ac049f28842cbb53a283a40142faf => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:29:38.120748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538cca7-2758-4354-9195-ff4f73ade9d4 service nova] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:38.133138 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538cca7-2758-4354-9195-ff4f73ade9d4 service nova] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:38.193545 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a1888-438e-4f6d-81b6-0517f77459be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:38.194450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a1888-438e-4f6d-81b6-0517f77459be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:38.194712 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a1888-438e-4f6d-81b6-0517f77459be admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:38.194989 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a1888-438e-4f6d-81b6-0517f77459be admin admin] PATH_INFO: `/v3/projects/38f2e257d56d477d98132d62b4f87b19` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:38.196263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a1888-438e-4f6d-81b6-0517f77459be admin admin] RBAC: Authorizing `identity:delete_project(project_id=38f2e257d56d477d98132d62b4f87b19)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:38.198437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a1888-438e-4f6d-81b6-0517f77459be admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:38.324480 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a72a1888-438e-4f6d-81b6-0517f77459be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38f2e257d56d477d98132d62b4f87b19', 'request_id': 'req-a72a1888-438e-4f6d-81b6-0517f77459be'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:38.330862 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a72a1888-438e-4f6d-81b6-0517f77459be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38f2e257d56d477d98132d62b4f87b19', 'request_id': 'req-a72a1888-438e-4f6d-81b6-0517f77459be'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:38.398091 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a72a1888-438e-4f6d-81b6-0517f77459be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38f2e257d56d477d98132d62b4f87b19', 'request_id': 'req-a72a1888-438e-4f6d-81b6-0517f77459be'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:38.408550 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a72a1888-438e-4f6d-81b6-0517f77459be admin admin] The token cache is being invalidate because project 38f2e257d56d477d98132d62b4f87b19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:29:38.408841 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a72a1888-438e-4f6d-81b6-0517f77459be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:38.409463 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a72a1888-438e-4f6d-81b6-0517f77459be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:38.411064 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1343/2677] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:29:38 2022] DELETE /identity/v3/projects/38f2e257d56d477d98132d62b4f87b19 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:29:38.904179 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1894a-e319-42bd-a21d-bf06ea48e7ea admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:38.905603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e8d1894a-e319-42bd-a21d-bf06ea48e7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:38.961796 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1894a-e319-42bd-a21d-bf06ea48e7ea admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:39.008850 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6b9dd-8ddf-4d6c-8504-b4fb3a285c22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:39.009502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6b9dd-8ddf-4d6c-8504-b4fb3a285c22 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:39.009787 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6b9dd-8ddf-4d6c-8504-b4fb3a285c22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:39.010065 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6b9dd-8ddf-4d6c-8504-b4fb3a285c22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:39.011980 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-efa6b9dd-8ddf-4d6c-8504-b4fb3a285c22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:39.069734 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6b9dd-8ddf-4d6c-8504-b4fb3a285c22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:39.071211 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6b9dd-8ddf-4d6c-8504-b4fb3a285c22 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:39.080085 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1335/2678] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:29:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:29:44.948389 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a1888-438e-4f6d-81b6-0517f77459be admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:44.948840 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a72a1888-438e-4f6d-81b6-0517f77459be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:45.018828 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a1888-438e-4f6d-81b6-0517f77459be admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:45.020752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a0e05-cf7c-4cf7-b2d2-b4d46e40f756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:45.021613 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a0e05-cf7c-4cf7-b2d2-b4d46e40f756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:45.021899 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a0e05-cf7c-4cf7-b2d2-b4d46e40f756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:45.022279 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a0e05-cf7c-4cf7-b2d2-b4d46e40f756 admin admin] PATH_INFO: `/v3/users/ce393968514a4579bfcb113a893ad4a4` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:45.024021 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a0e05-cf7c-4cf7-b2d2-b4d46e40f756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce393968514a4579bfcb113a893ad4a4)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:45.026109 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a0e05-cf7c-4cf7-b2d2-b4d46e40f756 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:45.255235 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-1e3a0e05-cf7c-4cf7-b2d2-b4d46e40f756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce393968514a4579bfcb113a893ad4a4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:45.271535 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-1e3a0e05-cf7c-4cf7-b2d2-b4d46e40f756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce393968514a4579bfcb113a893ad4a4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:45.276837 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-1e3a0e05-cf7c-4cf7-b2d2-b4d46e40f756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce393968514a4579bfcb113a893ad4a4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:45.276837 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-1e3a0e05-cf7c-4cf7-b2d2-b4d46e40f756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce393968514a4579bfcb113a893ad4a4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:45.280427 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-1e3a0e05-cf7c-4cf7-b2d2-b4d46e40f756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce393968514a4579bfcb113a893ad4a4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:45.387341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1344/2679] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:29:44 2022] DELETE /identity/v3/users/ce393968514a4579bfcb113a893ad4a4 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:29:45.392087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479285fc-4fa7-4334-be90-4af8d2b09b70 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:45.392606 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479285fc-4fa7-4334-be90-4af8d2b09b70 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:45.392722 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479285fc-4fa7-4334-be90-4af8d2b09b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:45.409144 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-479285fc-4fa7-4334-be90-4af8d2b09b70 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:29:45.410337 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-479285fc-4fa7-4334-be90-4af8d2b09b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:45.467098 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1336/2680] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:29:45.476994 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a0e05-cf7c-4cf7-b2d2-b4d46e40f756 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:45.478473 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1e3a0e05-cf7c-4cf7-b2d2-b4d46e40f756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:45.541341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a0e05-cf7c-4cf7-b2d2-b4d46e40f756 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:45.541588 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cac8ed-c1ed-4718-8cf7-40fcff4daa36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:45.542241 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cac8ed-c1ed-4718-8cf7-40fcff4daa36 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:45.542444 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cac8ed-c1ed-4718-8cf7-40fcff4daa36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:45.542725 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cac8ed-c1ed-4718-8cf7-40fcff4daa36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:45.552581 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cac8ed-c1ed-4718-8cf7-40fcff4daa36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:45.554661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cac8ed-c1ed-4718-8cf7-40fcff4daa36 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:45.565112 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1345/2681] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:29:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:29:45.835082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479285fc-4fa7-4334-be90-4af8d2b09b70 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:45.836508 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-479285fc-4fa7-4334-be90-4af8d2b09b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:45.911506 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479285fc-4fa7-4334-be90-4af8d2b09b70 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:45.918700 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaf3bd-212a-43a7-a69b-d41d24f3d45c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f231aa78ac84054b06a2126e1a11f31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:45.919443 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaf3bd-212a-43a7-a69b-d41d24f3d45c service placement] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:45.919795 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaf3bd-212a-43a7-a69b-d41d24f3d45c service placement] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:45.920075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaf3bd-212a-43a7-a69b-d41d24f3d45c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:45.921975 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ebeaf3bd-212a-43a7-a69b-d41d24f3d45c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:45.935166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeaf3bd-212a-43a7-a69b-d41d24f3d45c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:45.936996 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeaf3bd-212a-43a7-a69b-d41d24f3d45c service placement] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:45.948149 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1337/2682] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:29:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:29:46.056700 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cac8ed-c1ed-4718-8cf7-40fcff4daa36 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:46.058226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-24cac8ed-c1ed-4718-8cf7-40fcff4daa36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:46.078457 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cac8ed-c1ed-4718-8cf7-40fcff4daa36 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:46.084307 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78629b1d-4358-420e-88ac-7b2f56e768b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:46.086208 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78629b1d-4358-420e-88ac-7b2f56e768b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:46.086616 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78629b1d-4358-420e-88ac-7b2f56e768b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:46.086954 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78629b1d-4358-420e-88ac-7b2f56e768b5 admin admin] PATH_INFO: `/v3/projects/b8a29c645b0e414196fd433f2c6fa249` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:46.088131 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78629b1d-4358-420e-88ac-7b2f56e768b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8a29c645b0e414196fd433f2c6fa249)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:46.090071 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78629b1d-4358-420e-88ac-7b2f56e768b5 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:46.208968 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-78629b1d-4358-420e-88ac-7b2f56e768b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8a29c645b0e414196fd433f2c6fa249', 'request_id': 'req-78629b1d-4358-420e-88ac-7b2f56e768b5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:46.215757 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-78629b1d-4358-420e-88ac-7b2f56e768b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8a29c645b0e414196fd433f2c6fa249', 'request_id': 'req-78629b1d-4358-420e-88ac-7b2f56e768b5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:46.329879 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-78629b1d-4358-420e-88ac-7b2f56e768b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8a29c645b0e414196fd433f2c6fa249', 'request_id': 'req-78629b1d-4358-420e-88ac-7b2f56e768b5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:46.342038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-78629b1d-4358-420e-88ac-7b2f56e768b5 admin admin] The token cache is being invalidate because project b8a29c645b0e414196fd433f2c6fa249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:29:46.342592 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-78629b1d-4358-420e-88ac-7b2f56e768b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:46.343427 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-78629b1d-4358-420e-88ac-7b2f56e768b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:46.345396 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1346/2683] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:29:46 2022] DELETE /identity/v3/projects/b8a29c645b0e414196fd433f2c6fa249 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:29:46.350185 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a99aa2-b86e-47d3-92b0-2442cb8b48dc None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:46.350472 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a99aa2-b86e-47d3-92b0-2442cb8b48dc None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:46.351743 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a99aa2-b86e-47d3-92b0-2442cb8b48dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:46.370247 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-93a99aa2-b86e-47d3-92b0-2442cb8b48dc None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:29:46.371454 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-93a99aa2-b86e-47d3-92b0-2442cb8b48dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:46.437947 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1338/2684] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:29:46.446184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07a208-c19e-4d49-a8dd-73c51922c7c2 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:46.446518 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07a208-c19e-4d49-a8dd-73c51922c7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:46.446752 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07a208-c19e-4d49-a8dd-73c51922c7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:46.465772 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-8e07a208-c19e-4d49-a8dd-73c51922c7c2 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:29:46.467049 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8e07a208-c19e-4d49-a8dd-73c51922c7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:46.475078 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1347/2685] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:29:46.479305 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a99aa2-b86e-47d3-92b0-2442cb8b48dc None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:46.488827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a99aa2-b86e-47d3-92b0-2442cb8b48dc None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:46.493404 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c100f9-2ceb-4962-a47b-60d05e39848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:46.495951 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c100f9-2ceb-4962-a47b-60d05e39848e admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:46.495951 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c100f9-2ceb-4962-a47b-60d05e39848e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:46.495951 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c100f9-2ceb-4962-a47b-60d05e39848e admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:46.495951 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c100f9-2ceb-4962-a47b-60d05e39848e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:29:46.495951 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c100f9-2ceb-4962-a47b-60d05e39848e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:46.497280 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c100f9-2ceb-4962-a47b-60d05e39848e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:46.509489 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1339/2686] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:29:46.513627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07a208-c19e-4d49-a8dd-73c51922c7c2 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:46.524336 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07a208-c19e-4d49-a8dd-73c51922c7c2 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:46.529577 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11f731-19dd-4c94-a6ce-adcd9f192b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:46.536483 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11f731-19dd-4c94-a6ce-adcd9f192b62 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:46.536483 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11f731-19dd-4c94-a6ce-adcd9f192b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:46.536483 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11f731-19dd-4c94-a6ce-adcd9f192b62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:46.536483 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11f731-19dd-4c94-a6ce-adcd9f192b62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:46.536483 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11f731-19dd-4c94-a6ce-adcd9f192b62 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:46.652370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1348/2687] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:29:46 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:29:46.659737 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c100f9-2ceb-4962-a47b-60d05e39848e admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:46.669902 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c100f9-2ceb-4962-a47b-60d05e39848e admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:46.725784 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab5f98-6c5f-4e77-9c50-992e0af76a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:46.726580 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab5f98-6c5f-4e77-9c50-992e0af76a93 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:46.726846 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab5f98-6c5f-4e77-9c50-992e0af76a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:46.727116 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab5f98-6c5f-4e77-9c50-992e0af76a93 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:46.727851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab5f98-6c5f-4e77-9c50-992e0af76a93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:46.729810 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab5f98-6c5f-4e77-9c50-992e0af76a93 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:46.822245 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1340/2688] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:29:46 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:29:46.826181 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11f731-19dd-4c94-a6ce-adcd9f192b62 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:46.836414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11f731-19dd-4c94-a6ce-adcd9f192b62 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:46.841166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce8818-b9f6-4865-847d-8c39e81c4d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:46.841818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce8818-b9f6-4865-847d-8c39e81c4d1a admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:46.842097 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce8818-b9f6-4865-847d-8c39e81c4d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:46.842489 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce8818-b9f6-4865-847d-8c39e81c4d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:46.843297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce8818-b9f6-4865-847d-8c39e81c4d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:46.844932 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce8818-b9f6-4865-847d-8c39e81c4d1a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:46.860308 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1349/2689] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:29:46.864023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab5f98-6c5f-4e77-9c50-992e0af76a93 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:46.874871 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab5f98-6c5f-4e77-9c50-992e0af76a93 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:46.880418 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3042f9e-cc0f-4661-a2bd-d66aee1428ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:46.881078 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3042f9e-cc0f-4661-a2bd-d66aee1428ab admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:46.881388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3042f9e-cc0f-4661-a2bd-d66aee1428ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:46.881719 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3042f9e-cc0f-4661-a2bd-d66aee1428ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:46.883174 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3042f9e-cc0f-4661-a2bd-d66aee1428ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:46.884761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3042f9e-cc0f-4661-a2bd-d66aee1428ab admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:46.895675 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1341/2690] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:29:46.900543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce8818-b9f6-4865-847d-8c39e81c4d1a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:46.910546 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce8818-b9f6-4865-847d-8c39e81c4d1a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:46.915146 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b398301-9731-4ba8-8636-dd466744533c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:46.915999 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b398301-9731-4ba8-8636-dd466744533c admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:46.916282 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b398301-9731-4ba8-8636-dd466744533c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:46.916557 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b398301-9731-4ba8-8636-dd466744533c admin admin] PATH_INFO: `/v3/projects/5e6c9421be774554a4d940bdf78a941b/users/8a0e79902c3e4b58af0aaa9b348af6ba/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:46.931802 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b398301-9731-4ba8-8636-dd466744533c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e6c9421be774554a4d940bdf78a941b, user_id=8a0e79902c3e4b58af0aaa9b348af6ba, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:46.934516 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b398301-9731-4ba8-8636-dd466744533c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:47.038819 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1350/2691] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:29:46 2022] PUT /identity/v3/projects/5e6c9421be774554a4d940bdf78a941b/users/8a0e79902c3e4b58af0aaa9b348af6ba/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:29:47.050439 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f9bca-b51a-4ca5-ad09-78d76c6e9a7e None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:47.050724 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f9bca-b51a-4ca5-ad09-78d76c6e9a7e None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:47.050997 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f9bca-b51a-4ca5-ad09-78d76c6e9a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:47.078499 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9b4f9bca-b51a-4ca5-ad09-78d76c6e9a7e None None] MFA Rules not processed for user `8a0e79902c3e4b58af0aaa9b348af6ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:29:47.079670 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9b4f9bca-b51a-4ca5-ad09-78d76c6e9a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:47.143983 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1342/2692] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:29:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:29:47.148312 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b398301-9731-4ba8-8636-dd466744533c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:47.208756 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b398301-9731-4ba8-8636-dd466744533c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:47.213464 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f54d7-adfb-4cca-bea4-620b061e4698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:47.214121 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f54d7-adfb-4cca-bea4-620b061e4698 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:47.214431 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f54d7-adfb-4cca-bea4-620b061e4698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:47.214715 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f54d7-adfb-4cca-bea4-620b061e4698 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:47.215435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f54d7-adfb-4cca-bea4-620b061e4698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:47.217335 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f54d7-adfb-4cca-bea4-620b061e4698 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:47.340093 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1351/2693] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:29:47 2022] POST /identity/v3/projects => generated 381 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:29:47.341218 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f9bca-b51a-4ca5-ad09-78d76c6e9a7e None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:47.352217 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f9bca-b51a-4ca5-ad09-78d76c6e9a7e None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:47.410357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bc5cd-e407-4dc3-a755-33cf9ed41bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:47.411031 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bc5cd-e407-4dc3-a755-33cf9ed41bdd admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:47.411311 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bc5cd-e407-4dc3-a755-33cf9ed41bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:47.411589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bc5cd-e407-4dc3-a755-33cf9ed41bdd admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:47.412281 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bc5cd-e407-4dc3-a755-33cf9ed41bdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:47.414897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bc5cd-e407-4dc3-a755-33cf9ed41bdd admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:47.492222 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1343/2694] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:29:47 2022] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:29:47.496086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f54d7-adfb-4cca-bea4-620b061e4698 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:47.506938 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f54d7-adfb-4cca-bea4-620b061e4698 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:47.512644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b3228-1212-4be4-819b-8e518e53397b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:47.513539 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b3228-1212-4be4-819b-8e518e53397b admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:47.514024 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b3228-1212-4be4-819b-8e518e53397b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:47.514807 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b3228-1212-4be4-819b-8e518e53397b admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:47.515543 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b3228-1212-4be4-819b-8e518e53397b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:47.517540 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b3228-1212-4be4-819b-8e518e53397b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:47.530430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1352/2695] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:29:47.534300 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bc5cd-e407-4dc3-a755-33cf9ed41bdd admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:47.545623 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bc5cd-e407-4dc3-a755-33cf9ed41bdd admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:47.566938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb414fa-90ab-4fff-a9d8-74023fe59a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:47.566938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb414fa-90ab-4fff-a9d8-74023fe59a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:47.566938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb414fa-90ab-4fff-a9d8-74023fe59a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:47.566938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb414fa-90ab-4fff-a9d8-74023fe59a97 admin admin] PATH_INFO: `/v3/projects/6f75db92695b4885bcda000d7ae763bd/users/561c8fef0b2f44fe88abc0c558c11481/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:47.570863 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb414fa-90ab-4fff-a9d8-74023fe59a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f75db92695b4885bcda000d7ae763bd, user_id=561c8fef0b2f44fe88abc0c558c11481, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:47.573622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb414fa-90ab-4fff-a9d8-74023fe59a97 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:47.667536 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1344/2696] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:29:47 2022] PUT /identity/v3/projects/6f75db92695b4885bcda000d7ae763bd/users/561c8fef0b2f44fe88abc0c558c11481/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:29:47.671493 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b3228-1212-4be4-819b-8e518e53397b admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:47.681345 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b3228-1212-4be4-819b-8e518e53397b admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:47.735769 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a0352-0347-47ca-b84d-f946fe69f194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:47.736411 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a0352-0347-47ca-b84d-f946fe69f194 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:47.736696 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a0352-0347-47ca-b84d-f946fe69f194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:47.736976 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a0352-0347-47ca-b84d-f946fe69f194 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:47.737698 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a0352-0347-47ca-b84d-f946fe69f194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:47.739354 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a0352-0347-47ca-b84d-f946fe69f194 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:47.751884 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1353/2697] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:29:47.753743 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb414fa-90ab-4fff-a9d8-74023fe59a97 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:47.787958 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb414fa-90ab-4fff-a9d8-74023fe59a97 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:47.795760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f56122-97c5-458d-82ce-b2407be1f4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:47.796827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f56122-97c5-458d-82ce-b2407be1f4b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:47.797190 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f56122-97c5-458d-82ce-b2407be1f4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:47.797334 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f56122-97c5-458d-82ce-b2407be1f4b0 admin admin] PATH_INFO: `/v3/projects/6f75db92695b4885bcda000d7ae763bd/users/561c8fef0b2f44fe88abc0c558c11481/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:47.800041 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f56122-97c5-458d-82ce-b2407be1f4b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f75db92695b4885bcda000d7ae763bd, user_id=561c8fef0b2f44fe88abc0c558c11481, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:47.802015 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f56122-97c5-458d-82ce-b2407be1f4b0 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:47.813001 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1345/2698] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:29:47 2022] PUT /identity/v3/projects/6f75db92695b4885bcda000d7ae763bd/users/561c8fef0b2f44fe88abc0c558c11481/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:29:47.825082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a95bc-5058-4f6b-a88b-75e50f20b6c4 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:47.825650 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a95bc-5058-4f6b-a88b-75e50f20b6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:47.826349 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a95bc-5058-4f6b-a88b-75e50f20b6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:47.865709 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-057a95bc-5058-4f6b-a88b-75e50f20b6c4 None None] MFA Rules not processed for user `561c8fef0b2f44fe88abc0c558c11481`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:29:47.867001 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-057a95bc-5058-4f6b-a88b-75e50f20b6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:47.877647 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f56122-97c5-458d-82ce-b2407be1f4b0 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:47.879798 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-56f56122-97c5-458d-82ce-b2407be1f4b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:47.937064 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1354/2699] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:29:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:29:47.953586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a95bc-5058-4f6b-a88b-75e50f20b6c4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:47.954593 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f56122-97c5-458d-82ce-b2407be1f4b0 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:47.957727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bf94a-e471-4e7e-bcf4-6bbae44637f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:47.958421 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bf94a-e471-4e7e-bcf4-6bbae44637f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:47.958683 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-057a95bc-5058-4f6b-a88b-75e50f20b6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:47.958790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bf94a-e471-4e7e-bcf4-6bbae44637f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:47.958969 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bf94a-e471-4e7e-bcf4-6bbae44637f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:47.961300 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8b3bf94a-e471-4e7e-bcf4-6bbae44637f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:48.016882 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a95bc-5058-4f6b-a88b-75e50f20b6c4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:48.022304 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab8445-fe31-4f0d-b56e-a1b83362235e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:48.023514 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab8445-fe31-4f0d-b56e-a1b83362235e service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:48.023803 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab8445-fe31-4f0d-b56e-a1b83362235e service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:48.024085 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab8445-fe31-4f0d-b56e-a1b83362235e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:48.025749 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bf94a-e471-4e7e-bcf4-6bbae44637f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:48.027418 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bf94a-e471-4e7e-bcf4-6bbae44637f5 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:48.033830 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab8445-fe31-4f0d-b56e-a1b83362235e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:48.035389 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab8445-fe31-4f0d-b56e-a1b83362235e service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:48.038838 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1346/2700] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:29:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:29:48.045877 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1355/2701] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:29:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:29:48.256874 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bf94a-e471-4e7e-bcf4-6bbae44637f5 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:48.266949 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bf94a-e471-4e7e-bcf4-6bbae44637f5 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:48.270505 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b381c-ae2c-4689-8b25-0578d4a6ec58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:48.271149 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b381c-ae2c-4689-8b25-0578d4a6ec58 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:48.271429 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b381c-ae2c-4689-8b25-0578d4a6ec58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:48.271707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b381c-ae2c-4689-8b25-0578d4a6ec58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:48.296210 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16c137-5d06-4d51-a535-f1e15e6367fe None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:48.296760 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16c137-5d06-4d51-a535-f1e15e6367fe None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:48.296760 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16c137-5d06-4d51-a535-f1e15e6367fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:48.315040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ac16c137-5d06-4d51-a535-f1e15e6367fe None None] MFA Rules not processed for user `066750f0db754834aa2984c2cfd40e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:29:48.316257 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ac16c137-5d06-4d51-a535-f1e15e6367fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:48.333663 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b381c-ae2c-4689-8b25-0578d4a6ec58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:48.335544 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b381c-ae2c-4689-8b25-0578d4a6ec58 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:48.345201 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1347/2702] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:29:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:29:48.376852 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1356/2703] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:29:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:29:56.348746 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b381c-ae2c-4689-8b25-0578d4a6ec58 service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:56.350284 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-084b381c-ae2c-4689-8b25-0578d4a6ec58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:56.364964 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b381c-ae2c-4689-8b25-0578d4a6ec58 service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:56.370269 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceecc7c-b0f0-4013-ab75-37d157210dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:56.371133 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceecc7c-b0f0-4013-ab75-37d157210dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:56.371411 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceecc7c-b0f0-4013-ab75-37d157210dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:56.371682 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceecc7c-b0f0-4013-ab75-37d157210dd9 admin admin] PATH_INFO: `/v3/users/5035b142903440768a5cf79d47fc0d91` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:56.372860 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceecc7c-b0f0-4013-ab75-37d157210dd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5035b142903440768a5cf79d47fc0d91)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:56.374814 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceecc7c-b0f0-4013-ab75-37d157210dd9 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:56.538528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6ceecc7c-b0f0-4013-ab75-37d157210dd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5035b142903440768a5cf79d47fc0d91'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:56.621321 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6ceecc7c-b0f0-4013-ab75-37d157210dd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5035b142903440768a5cf79d47fc0d91'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:56.622154 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6ceecc7c-b0f0-4013-ab75-37d157210dd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5035b142903440768a5cf79d47fc0d91'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:56.634650 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6ceecc7c-b0f0-4013-ab75-37d157210dd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5035b142903440768a5cf79d47fc0d91'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:56.635305 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-6ceecc7c-b0f0-4013-ab75-37d157210dd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5035b142903440768a5cf79d47fc0d91'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:56.647854 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1348/2704] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:29:56 2022] DELETE /identity/v3/users/5035b142903440768a5cf79d47fc0d91 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:29:56.885732 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16c137-5d06-4d51-a535-f1e15e6367fe None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:56.898688 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16c137-5d06-4d51-a535-f1e15e6367fe None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:56.955700 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355812e-bff9-4de3-9089-e1f033373f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:56.956560 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355812e-bff9-4de3-9089-e1f033373f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:56.956845 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355812e-bff9-4de3-9089-e1f033373f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:56.957158 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355812e-bff9-4de3-9089-e1f033373f18 admin admin] PATH_INFO: `/v3/projects/be817fd143aa4f3b87f6cfd77666cdb7` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:56.958370 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355812e-bff9-4de3-9089-e1f033373f18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be817fd143aa4f3b87f6cfd77666cdb7)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:56.960277 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355812e-bff9-4de3-9089-e1f033373f18 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:57.055196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c355812e-bff9-4de3-9089-e1f033373f18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be817fd143aa4f3b87f6cfd77666cdb7', 'request_id': 'req-c355812e-bff9-4de3-9089-e1f033373f18'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:57.061304 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c355812e-bff9-4de3-9089-e1f033373f18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be817fd143aa4f3b87f6cfd77666cdb7', 'request_id': 'req-c355812e-bff9-4de3-9089-e1f033373f18'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:57.123215 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c355812e-bff9-4de3-9089-e1f033373f18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be817fd143aa4f3b87f6cfd77666cdb7', 'request_id': 'req-c355812e-bff9-4de3-9089-e1f033373f18'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:57.133753 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c355812e-bff9-4de3-9089-e1f033373f18 admin admin] The token cache is being invalidate because project be817fd143aa4f3b87f6cfd77666cdb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:29:57.134827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c355812e-bff9-4de3-9089-e1f033373f18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:57.134827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c355812e-bff9-4de3-9089-e1f033373f18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:57.136261 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1357/2705] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:29:56 2022] DELETE /identity/v3/projects/be817fd143aa4f3b87f6cfd77666cdb7 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:29:57.140674 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceecc7c-b0f0-4013-ab75-37d157210dd9 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:57.142083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-6ceecc7c-b0f0-4013-ab75-37d157210dd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:57.155386 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceecc7c-b0f0-4013-ab75-37d157210dd9 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:57.209777 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb532d3-2252-41f1-a66b-da4704c36fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:57.210683 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb532d3-2252-41f1-a66b-da4704c36fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:57.210966 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb532d3-2252-41f1-a66b-da4704c36fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:57.211279 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb532d3-2252-41f1-a66b-da4704c36fb6 admin admin] PATH_INFO: `/v3/users/47e6b562b9124745bc836403db4ce945` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:57.212997 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb532d3-2252-41f1-a66b-da4704c36fb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47e6b562b9124745bc836403db4ce945)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:57.214955 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb532d3-2252-41f1-a66b-da4704c36fb6 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:57.378166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9cb532d3-2252-41f1-a66b-da4704c36fb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47e6b562b9124745bc836403db4ce945'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:57.415339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9cb532d3-2252-41f1-a66b-da4704c36fb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47e6b562b9124745bc836403db4ce945'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:57.416276 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9cb532d3-2252-41f1-a66b-da4704c36fb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47e6b562b9124745bc836403db4ce945'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:57.431008 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9cb532d3-2252-41f1-a66b-da4704c36fb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47e6b562b9124745bc836403db4ce945'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:57.431777 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-9cb532d3-2252-41f1-a66b-da4704c36fb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47e6b562b9124745bc836403db4ce945'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:57.444005 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1349/2706] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:29:57 2022] DELETE /identity/v3/users/47e6b562b9124745bc836403db4ce945 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:29:57.733432 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355812e-bff9-4de3-9089-e1f033373f18 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:57.733432 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c355812e-bff9-4de3-9089-e1f033373f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:57.752599 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355812e-bff9-4de3-9089-e1f033373f18 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:57.818395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d6eba-b093-4b6f-bbea-eaed060e9063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:57.819263 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d6eba-b093-4b6f-bbea-eaed060e9063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:57.819547 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d6eba-b093-4b6f-bbea-eaed060e9063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:57.819883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d6eba-b093-4b6f-bbea-eaed060e9063 admin admin] PATH_INFO: `/v3/projects/a4ffac2f990d4965aeeedf414b25e35f` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:57.821122 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d6eba-b093-4b6f-bbea-eaed060e9063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4ffac2f990d4965aeeedf414b25e35f)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:57.823144 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d6eba-b093-4b6f-bbea-eaed060e9063 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:57.953442 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7c9d6eba-b093-4b6f-bbea-eaed060e9063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4ffac2f990d4965aeeedf414b25e35f', 'request_id': 'req-7c9d6eba-b093-4b6f-bbea-eaed060e9063'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:57.959576 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7c9d6eba-b093-4b6f-bbea-eaed060e9063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4ffac2f990d4965aeeedf414b25e35f', 'request_id': 'req-7c9d6eba-b093-4b6f-bbea-eaed060e9063'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:58.032358 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7c9d6eba-b093-4b6f-bbea-eaed060e9063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4ffac2f990d4965aeeedf414b25e35f', 'request_id': 'req-7c9d6eba-b093-4b6f-bbea-eaed060e9063'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:58.043613 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7c9d6eba-b093-4b6f-bbea-eaed060e9063 admin admin] The token cache is being invalidate because project a4ffac2f990d4965aeeedf414b25e35f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:29:58.043897 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7c9d6eba-b093-4b6f-bbea-eaed060e9063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:58.044539 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7c9d6eba-b093-4b6f-bbea-eaed060e9063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:58.046180 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1358/2707] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:29:57 2022] DELETE /identity/v3/projects/a4ffac2f990d4965aeeedf414b25e35f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:29:59.121605 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb532d3-2252-41f1-a66b-da4704c36fb6 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:59.123011 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9cb532d3-2252-41f1-a66b-da4704c36fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:59.135338 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb532d3-2252-41f1-a66b-da4704c36fb6 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:59.190505 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb457fc1-5dbb-4af9-8028-a6818ef3755c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:59.191371 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb457fc1-5dbb-4af9-8028-a6818ef3755c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:59.191649 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb457fc1-5dbb-4af9-8028-a6818ef3755c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:59.191919 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb457fc1-5dbb-4af9-8028-a6818ef3755c admin admin] PATH_INFO: `/v3/users/8a0e79902c3e4b58af0aaa9b348af6ba` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:59.193079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb457fc1-5dbb-4af9-8028-a6818ef3755c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a0e79902c3e4b58af0aaa9b348af6ba)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:59.195020 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb457fc1-5dbb-4af9-8028-a6818ef3755c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:59.342144 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-eb457fc1-5dbb-4af9-8028-a6818ef3755c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a0e79902c3e4b58af0aaa9b348af6ba'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:59.404304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-eb457fc1-5dbb-4af9-8028-a6818ef3755c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a0e79902c3e4b58af0aaa9b348af6ba'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:59.404928 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-eb457fc1-5dbb-4af9-8028-a6818ef3755c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a0e79902c3e4b58af0aaa9b348af6ba'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:59.418700 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-eb457fc1-5dbb-4af9-8028-a6818ef3755c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a0e79902c3e4b58af0aaa9b348af6ba'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:59.419465 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-eb457fc1-5dbb-4af9-8028-a6818ef3755c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a0e79902c3e4b58af0aaa9b348af6ba'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:59.433069 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1350/2708] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:29:59 2022] DELETE /identity/v3/users/8a0e79902c3e4b58af0aaa9b348af6ba => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:29:59.437325 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c23c52-bb4e-481c-92db-8346ff64f91d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:59.437809 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c23c52-bb4e-481c-92db-8346ff64f91d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:59.438042 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c23c52-bb4e-481c-92db-8346ff64f91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:59.455818 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-13c23c52-bb4e-481c-92db-8346ff64f91d None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:29:59.460984 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-13c23c52-bb4e-481c-92db-8346ff64f91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:59.516650 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1359/2709] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:29:59.526879 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb457fc1-5dbb-4af9-8028-a6818ef3755c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:59.528437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-eb457fc1-5dbb-4af9-8028-a6818ef3755c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:59.585993 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb457fc1-5dbb-4af9-8028-a6818ef3755c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:59.590355 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb97b3-728d-49e3-adb8-b0d066cfe7a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:59.591004 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb97b3-728d-49e3-adb8-b0d066cfe7a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:59.591290 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb97b3-728d-49e3-adb8-b0d066cfe7a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:59.591646 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb97b3-728d-49e3-adb8-b0d066cfe7a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:59.600816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb97b3-728d-49e3-adb8-b0d066cfe7a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:59.602295 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb97b3-728d-49e3-adb8-b0d066cfe7a2 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:59.612311 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1351/2710] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:29:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:29:59.988225 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c23c52-bb4e-481c-92db-8346ff64f91d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:59.989829 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-13c23c52-bb4e-481c-92db-8346ff64f91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:00.002099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c23c52-bb4e-481c-92db-8346ff64f91d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:00.007018 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d691a7-168a-466f-8646-fff049e34703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:00.007886 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d691a7-168a-466f-8646-fff049e34703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:00.008279 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d691a7-168a-466f-8646-fff049e34703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:00.008587 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d691a7-168a-466f-8646-fff049e34703 admin admin] PATH_INFO: `/v3/projects/5e6c9421be774554a4d940bdf78a941b` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:00.010326 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d691a7-168a-466f-8646-fff049e34703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e6c9421be774554a4d940bdf78a941b)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:00.012260 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d691a7-168a-466f-8646-fff049e34703 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:00.113019 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b0d691a7-168a-466f-8646-fff049e34703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e6c9421be774554a4d940bdf78a941b', 'request_id': 'req-b0d691a7-168a-466f-8646-fff049e34703'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:00.119186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b0d691a7-168a-466f-8646-fff049e34703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e6c9421be774554a4d940bdf78a941b', 'request_id': 'req-b0d691a7-168a-466f-8646-fff049e34703'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:00.198295 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b0d691a7-168a-466f-8646-fff049e34703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e6c9421be774554a4d940bdf78a941b', 'request_id': 'req-b0d691a7-168a-466f-8646-fff049e34703'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:00.208842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b0d691a7-168a-466f-8646-fff049e34703 admin admin] The token cache is being invalidate because project 5e6c9421be774554a4d940bdf78a941b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:30:00.209128 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b0d691a7-168a-466f-8646-fff049e34703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:00.209747 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b0d691a7-168a-466f-8646-fff049e34703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:00.211328 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1360/2711] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:29:59 2022] DELETE /identity/v3/projects/5e6c9421be774554a4d940bdf78a941b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:30:00.216880 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb97b3-728d-49e3-adb8-b0d066cfe7a2 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:00.226271 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb97b3-728d-49e3-adb8-b0d066cfe7a2 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:00.289456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ed2ab-50dd-4eec-930a-49e7af1e197a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:00.291039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ed2ab-50dd-4eec-930a-49e7af1e197a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:00.291323 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ed2ab-50dd-4eec-930a-49e7af1e197a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:00.291598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ed2ab-50dd-4eec-930a-49e7af1e197a admin admin] PATH_INFO: `/v3/users/561c8fef0b2f44fe88abc0c558c11481` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:00.292783 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ed2ab-50dd-4eec-930a-49e7af1e197a admin admin] RBAC: Authorizing `identity:delete_user(user_id=561c8fef0b2f44fe88abc0c558c11481)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:00.295492 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ed2ab-50dd-4eec-930a-49e7af1e197a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:00.451975 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-366ed2ab-50dd-4eec-930a-49e7af1e197a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '561c8fef0b2f44fe88abc0c558c11481'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:00.501154 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-366ed2ab-50dd-4eec-930a-49e7af1e197a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '561c8fef0b2f44fe88abc0c558c11481'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:00.501799 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-366ed2ab-50dd-4eec-930a-49e7af1e197a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '561c8fef0b2f44fe88abc0c558c11481'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:00.514096 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-366ed2ab-50dd-4eec-930a-49e7af1e197a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '561c8fef0b2f44fe88abc0c558c11481'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:00.515017 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-366ed2ab-50dd-4eec-930a-49e7af1e197a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '561c8fef0b2f44fe88abc0c558c11481'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:00.527104 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1352/2712] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:30:00 2022] DELETE /identity/v3/users/561c8fef0b2f44fe88abc0c558c11481 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:30:00.948349 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d691a7-168a-466f-8646-fff049e34703 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:00.950049 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b0d691a7-168a-466f-8646-fff049e34703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:00.963042 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d691a7-168a-466f-8646-fff049e34703 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:01.020225 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d51284-c89a-4e57-a521-07f678e294c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:01.021083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d51284-c89a-4e57-a521-07f678e294c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:01.021362 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d51284-c89a-4e57-a521-07f678e294c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:01.021636 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d51284-c89a-4e57-a521-07f678e294c1 admin admin] PATH_INFO: `/v3/projects/6f75db92695b4885bcda000d7ae763bd` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:01.022894 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d51284-c89a-4e57-a521-07f678e294c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f75db92695b4885bcda000d7ae763bd)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:01.024803 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d51284-c89a-4e57-a521-07f678e294c1 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:01.165506 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-59d51284-c89a-4e57-a521-07f678e294c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f75db92695b4885bcda000d7ae763bd', 'request_id': 'req-59d51284-c89a-4e57-a521-07f678e294c1'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:01.172167 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-59d51284-c89a-4e57-a521-07f678e294c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f75db92695b4885bcda000d7ae763bd', 'request_id': 'req-59d51284-c89a-4e57-a521-07f678e294c1'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:01.313038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-59d51284-c89a-4e57-a521-07f678e294c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f75db92695b4885bcda000d7ae763bd', 'request_id': 'req-59d51284-c89a-4e57-a521-07f678e294c1'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:01.324330 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-59d51284-c89a-4e57-a521-07f678e294c1 admin admin] The token cache is being invalidate because project 6f75db92695b4885bcda000d7ae763bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:30:01.324619 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-59d51284-c89a-4e57-a521-07f678e294c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:01.325248 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-59d51284-c89a-4e57-a521-07f678e294c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:01.326848 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1361/2713] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:30:00 2022] DELETE /identity/v3/projects/6f75db92695b4885bcda000d7ae763bd => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:30:01.331832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc44ad4-4b8e-424e-99aa-1f1d0ad1a917 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:01.332351 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc44ad4-4b8e-424e-99aa-1f1d0ad1a917 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:01.332351 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc44ad4-4b8e-424e-99aa-1f1d0ad1a917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:01.350063 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5bc44ad4-4b8e-424e-99aa-1f1d0ad1a917 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:30:01.351343 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5bc44ad4-4b8e-424e-99aa-1f1d0ad1a917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:01.411347 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1353/2714] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:30:01.420930 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787c30f-e54c-4329-b9e3-8bb082a86df1 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:01.421226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787c30f-e54c-4329-b9e3-8bb082a86df1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:01.421509 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787c30f-e54c-4329-b9e3-8bb082a86df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:01.440632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f787c30f-e54c-4329-b9e3-8bb082a86df1 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:30:01.441883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f787c30f-e54c-4329-b9e3-8bb082a86df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:01.450220 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1362/2715] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:30:01.454588 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc44ad4-4b8e-424e-99aa-1f1d0ad1a917 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:01.464276 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc44ad4-4b8e-424e-99aa-1f1d0ad1a917 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:01.469107 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3230a7f-ea88-46db-b512-840b6f70860c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:01.469768 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3230a7f-ea88-46db-b512-840b6f70860c admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:01.470051 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3230a7f-ea88-46db-b512-840b6f70860c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:01.470371 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3230a7f-ea88-46db-b512-840b6f70860c admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:01.471099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3230a7f-ea88-46db-b512-840b6f70860c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:30:01.471407 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3230a7f-ea88-46db-b512-840b6f70860c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:01.473204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3230a7f-ea88-46db-b512-840b6f70860c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:01.485377 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1354/2716] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:30:01.489886 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787c30f-e54c-4329-b9e3-8bb082a86df1 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:01.500037 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787c30f-e54c-4329-b9e3-8bb082a86df1 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:01.504798 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9a0af-ad1b-43cd-a250-a298be7610c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:01.505452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9a0af-ad1b-43cd-a250-a298be7610c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:01.505791 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9a0af-ad1b-43cd-a250-a298be7610c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:01.506005 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9a0af-ad1b-43cd-a250-a298be7610c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:01.506788 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9a0af-ad1b-43cd-a250-a298be7610c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:01.508695 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9a0af-ad1b-43cd-a250-a298be7610c9 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:01.601299 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1363/2717] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:30:01 2022] POST /identity/v3/projects => generated 401 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:30:01.606487 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3230a7f-ea88-46db-b512-840b6f70860c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:01.616720 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3230a7f-ea88-46db-b512-840b6f70860c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:01.671011 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af5e7a-8332-413c-a5a9-06ffa47110e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:01.671666 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af5e7a-8332-413c-a5a9-06ffa47110e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:01.671949 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af5e7a-8332-413c-a5a9-06ffa47110e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:01.672219 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af5e7a-8332-413c-a5a9-06ffa47110e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:01.672892 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af5e7a-8332-413c-a5a9-06ffa47110e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:01.674848 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af5e7a-8332-413c-a5a9-06ffa47110e3 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:01.735968 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1355/2718] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:30:01 2022] POST /identity/v3/users => generated 301 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:30:01.739976 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9a0af-ad1b-43cd-a250-a298be7610c9 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:01.750146 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9a0af-ad1b-43cd-a250-a298be7610c9 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:01.754708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2840bcb-9c29-4b56-855f-5adc46b0a886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:01.755356 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2840bcb-9c29-4b56-855f-5adc46b0a886 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:01.755632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2840bcb-9c29-4b56-855f-5adc46b0a886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:01.755902 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2840bcb-9c29-4b56-855f-5adc46b0a886 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:01.756631 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2840bcb-9c29-4b56-855f-5adc46b0a886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:01.758292 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2840bcb-9c29-4b56-855f-5adc46b0a886 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:01.768719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1364/2719] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:30:01.772820 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af5e7a-8332-413c-a5a9-06ffa47110e3 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:01.783603 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af5e7a-8332-413c-a5a9-06ffa47110e3 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:01.788207 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3de1a-4fa7-4412-be90-a811cc8f7144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:01.788856 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3de1a-4fa7-4412-be90-a811cc8f7144 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:01.789141 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3de1a-4fa7-4412-be90-a811cc8f7144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:01.789419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3de1a-4fa7-4412-be90-a811cc8f7144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:01.790167 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3de1a-4fa7-4412-be90-a811cc8f7144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:01.792473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3de1a-4fa7-4412-be90-a811cc8f7144 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:01.802088 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1356/2720] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:30:01.806069 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2840bcb-9c29-4b56-855f-5adc46b0a886 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:01.815785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2840bcb-9c29-4b56-855f-5adc46b0a886 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:01.820360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16130e8-3eef-48e2-818b-9a99b6876862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:01.821205 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16130e8-3eef-48e2-818b-9a99b6876862 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:01.821484 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16130e8-3eef-48e2-818b-9a99b6876862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:01.821758 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16130e8-3eef-48e2-818b-9a99b6876862 admin admin] PATH_INFO: `/v3/projects/bf6624b5b4e64aafa1e38d2c8cd8893d/users/ec3391c5fd2b4610b5a5fc789cec6ffa/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:01.835628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16130e8-3eef-48e2-818b-9a99b6876862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf6624b5b4e64aafa1e38d2c8cd8893d, user_id=ec3391c5fd2b4610b5a5fc789cec6ffa, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:01.838855 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16130e8-3eef-48e2-818b-9a99b6876862 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:01.907724 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1365/2721] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:30:01 2022] PUT /identity/v3/projects/bf6624b5b4e64aafa1e38d2c8cd8893d/users/ec3391c5fd2b4610b5a5fc789cec6ffa/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:30:01.918507 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43eaf4-5167-4d1a-a962-f95ee0e34ff5 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:01.918799 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43eaf4-5167-4d1a-a962-f95ee0e34ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:01.919075 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43eaf4-5167-4d1a-a962-f95ee0e34ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:01.945052 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-bc43eaf4-5167-4d1a-a962-f95ee0e34ff5 None None] MFA Rules not processed for user `ec3391c5fd2b4610b5a5fc789cec6ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:30:01.946287 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-bc43eaf4-5167-4d1a-a962-f95ee0e34ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:02.007691 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1357/2722] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:30:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:30:02.012101 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16130e8-3eef-48e2-818b-9a99b6876862 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:02.071199 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16130e8-3eef-48e2-818b-9a99b6876862 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:02.076550 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a82f2-4cc0-4dd1-84c9-d0ac8a39a4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:02.077229 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a82f2-4cc0-4dd1-84c9-d0ac8a39a4da admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:02.077516 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a82f2-4cc0-4dd1-84c9-d0ac8a39a4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:02.077794 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a82f2-4cc0-4dd1-84c9-d0ac8a39a4da admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:02.078519 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a82f2-4cc0-4dd1-84c9-d0ac8a39a4da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:02.080418 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a82f2-4cc0-4dd1-84c9-d0ac8a39a4da admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:02.148029 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1366/2723] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:30:02 2022] POST /identity/v3/projects => generated 401 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:30:02.151961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43eaf4-5167-4d1a-a962-f95ee0e34ff5 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:02.162385 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43eaf4-5167-4d1a-a962-f95ee0e34ff5 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:02.216179 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f55ffa-bcae-431a-934a-99ceed6320ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:02.216829 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f55ffa-bcae-431a-934a-99ceed6320ef admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:02.217106 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f55ffa-bcae-431a-934a-99ceed6320ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:02.217373 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f55ffa-bcae-431a-934a-99ceed6320ef admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:02.218049 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f55ffa-bcae-431a-934a-99ceed6320ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:02.219969 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f55ffa-bcae-431a-934a-99ceed6320ef admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:02.323842 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1358/2724] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:30:02 2022] POST /identity/v3/users => generated 307 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:30:02.327907 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a82f2-4cc0-4dd1-84c9-d0ac8a39a4da admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:02.338049 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a82f2-4cc0-4dd1-84c9-d0ac8a39a4da admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:02.346628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bf59d-60aa-4600-bd91-cfcc0b41eb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:02.347283 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bf59d-60aa-4600-bd91-cfcc0b41eb84 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:02.347567 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bf59d-60aa-4600-bd91-cfcc0b41eb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:02.347842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bf59d-60aa-4600-bd91-cfcc0b41eb84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:02.348573 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bf59d-60aa-4600-bd91-cfcc0b41eb84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:02.350203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bf59d-60aa-4600-bd91-cfcc0b41eb84 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:02.361817 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1367/2725] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:30:02.365975 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f55ffa-bcae-431a-934a-99ceed6320ef admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:02.376434 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f55ffa-bcae-431a-934a-99ceed6320ef admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:02.381045 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016cd0a-5922-480c-aac1-698342ea7d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:02.381912 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016cd0a-5922-480c-aac1-698342ea7d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:02.382223 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016cd0a-5922-480c-aac1-698342ea7d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:02.382502 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016cd0a-5922-480c-aac1-698342ea7d71 admin admin] PATH_INFO: `/v3/projects/366090654abb40b79ec5e440ad9f4089/users/131b1eb99abb4902a018a090c2f79826/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:02.397602 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016cd0a-5922-480c-aac1-698342ea7d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=366090654abb40b79ec5e440ad9f4089, user_id=131b1eb99abb4902a018a090c2f79826, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:02.400475 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016cd0a-5922-480c-aac1-698342ea7d71 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:02.473183 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1359/2726] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:30:02 2022] PUT /identity/v3/projects/366090654abb40b79ec5e440ad9f4089/users/131b1eb99abb4902a018a090c2f79826/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:30:02.477322 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bf59d-60aa-4600-bd91-cfcc0b41eb84 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:02.488246 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bf59d-60aa-4600-bd91-cfcc0b41eb84 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:02.547189 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4239d4-044e-49c7-ab68-d374efcbcfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:02.547943 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4239d4-044e-49c7-ab68-d374efcbcfa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:02.548219 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4239d4-044e-49c7-ab68-d374efcbcfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:02.548492 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4239d4-044e-49c7-ab68-d374efcbcfa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:02.549218 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4239d4-044e-49c7-ab68-d374efcbcfa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:02.550921 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4239d4-044e-49c7-ab68-d374efcbcfa7 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:02.561722 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1368/2727] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:30:02.569762 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016cd0a-5922-480c-aac1-698342ea7d71 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:02.580287 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016cd0a-5922-480c-aac1-698342ea7d71 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:02.585052 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd7781-f3a1-41aa-8847-e0260a569d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:02.585929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd7781-f3a1-41aa-8847-e0260a569d2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:02.586244 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd7781-f3a1-41aa-8847-e0260a569d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:02.586526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd7781-f3a1-41aa-8847-e0260a569d2d admin admin] PATH_INFO: `/v3/projects/366090654abb40b79ec5e440ad9f4089/users/131b1eb99abb4902a018a090c2f79826/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:02.589318 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd7781-f3a1-41aa-8847-e0260a569d2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=366090654abb40b79ec5e440ad9f4089, user_id=131b1eb99abb4902a018a090c2f79826, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:02.591732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd7781-f3a1-41aa-8847-e0260a569d2d admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:02.601956 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1360/2728] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:30:02 2022] PUT /identity/v3/projects/366090654abb40b79ec5e440ad9f4089/users/131b1eb99abb4902a018a090c2f79826/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:30:02.612807 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7aef52-782d-421a-9a24-4251935a6709 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:02.613132 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7aef52-782d-421a-9a24-4251935a6709 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:02.613418 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7aef52-782d-421a-9a24-4251935a6709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:02.638794 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-bd7aef52-782d-421a-9a24-4251935a6709 None None] MFA Rules not processed for user `131b1eb99abb4902a018a090c2f79826`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:30:02.640254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bd7aef52-782d-421a-9a24-4251935a6709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:02.704979 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1369/2729] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:30:02 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:30:02.716549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd7781-f3a1-41aa-8847-e0260a569d2d admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:02.718327 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-f0dd7781-f3a1-41aa-8847-e0260a569d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:02.772284 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd7781-f3a1-41aa-8847-e0260a569d2d admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:02.776421 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd96d0-ebf5-4daf-8c27-e13722d79ab0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:02.777041 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd96d0-ebf5-4daf-8c27-e13722d79ab0 service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:02.777317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd96d0-ebf5-4daf-8c27-e13722d79ab0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:02.777587 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd96d0-ebf5-4daf-8c27-e13722d79ab0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:02.786283 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd96d0-ebf5-4daf-8c27-e13722d79ab0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:02.787706 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd96d0-ebf5-4daf-8c27-e13722d79ab0 service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:02.797663 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1361/2730] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:30:02 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:30:02.968956 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7aef52-782d-421a-9a24-4251935a6709 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:02.979388 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7aef52-782d-421a-9a24-4251935a6709 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:02.982904 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df54e5-f028-46d9-8910-e4bbe9943cf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:02.983536 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df54e5-f028-46d9-8910-e4bbe9943cf8 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:02.983814 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df54e5-f028-46d9-8910-e4bbe9943cf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:02.984088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df54e5-f028-46d9-8910-e4bbe9943cf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:03.038520 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df54e5-f028-46d9-8910-e4bbe9943cf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:03.039965 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df54e5-f028-46d9-8910-e4bbe9943cf8 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:03.048831 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1370/2731] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:30:02 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:30:07.989972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd96d0-ebf5-4daf-8c27-e13722d79ab0 service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:08.049904 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd96d0-ebf5-4daf-8c27-e13722d79ab0 service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:08.054511 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464666f-016e-4a5e-9558-b6caeb3e6a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:08.055369 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464666f-016e-4a5e-9558-b6caeb3e6a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:08.055653 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464666f-016e-4a5e-9558-b6caeb3e6a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:08.055932 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464666f-016e-4a5e-9558-b6caeb3e6a77 admin admin] PATH_INFO: `/v3/users/ec3391c5fd2b4610b5a5fc789cec6ffa` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:08.057108 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464666f-016e-4a5e-9558-b6caeb3e6a77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec3391c5fd2b4610b5a5fc789cec6ffa)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:08.059086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464666f-016e-4a5e-9558-b6caeb3e6a77 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:08.222812 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a464666f-016e-4a5e-9558-b6caeb3e6a77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec3391c5fd2b4610b5a5fc789cec6ffa'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:08.329383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a464666f-016e-4a5e-9558-b6caeb3e6a77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec3391c5fd2b4610b5a5fc789cec6ffa'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:08.329997 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a464666f-016e-4a5e-9558-b6caeb3e6a77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec3391c5fd2b4610b5a5fc789cec6ffa'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:08.342304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a464666f-016e-4a5e-9558-b6caeb3e6a77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec3391c5fd2b4610b5a5fc789cec6ffa'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:08.346268 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a464666f-016e-4a5e-9558-b6caeb3e6a77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec3391c5fd2b4610b5a5fc789cec6ffa'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:08.354691 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1362/2732] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:30:07 2022] DELETE /identity/v3/users/ec3391c5fd2b4610b5a5fc789cec6ffa => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:30:08.359249 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f156e-7274-41f5-bc01-2cb0037a980e None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:08.359735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f156e-7274-41f5-bc01-2cb0037a980e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:08.359848 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f156e-7274-41f5-bc01-2cb0037a980e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:08.377259 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-4c7f156e-7274-41f5-bc01-2cb0037a980e None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:30:08.378546 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4c7f156e-7274-41f5-bc01-2cb0037a980e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:08.441163 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1371/2733] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:30:08.451464 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464666f-016e-4a5e-9558-b6caeb3e6a77 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:08.452890 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a464666f-016e-4a5e-9558-b6caeb3e6a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:08.512261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464666f-016e-4a5e-9558-b6caeb3e6a77 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:08.512261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c16f86-2d3b-4a97-8536-f03b9e6f532a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:08.512261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c16f86-2d3b-4a97-8536-f03b9e6f532a service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:08.512261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c16f86-2d3b-4a97-8536-f03b9e6f532a service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:08.512884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c16f86-2d3b-4a97-8536-f03b9e6f532a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:08.521689 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c16f86-2d3b-4a97-8536-f03b9e6f532a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:08.523153 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c16f86-2d3b-4a97-8536-f03b9e6f532a service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:08.532563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1363/2734] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:30:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:30:08.881754 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f156e-7274-41f5-bc01-2cb0037a980e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:08.885362 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4c7f156e-7274-41f5-bc01-2cb0037a980e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:08.895868 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f156e-7274-41f5-bc01-2cb0037a980e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:08.900547 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded1fd3-555e-43f4-adaa-e17e31edd15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:08.901407 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded1fd3-555e-43f4-adaa-e17e31edd15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:08.901689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded1fd3-555e-43f4-adaa-e17e31edd15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:08.901966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded1fd3-555e-43f4-adaa-e17e31edd15e admin admin] PATH_INFO: `/v3/projects/bf6624b5b4e64aafa1e38d2c8cd8893d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:08.903317 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded1fd3-555e-43f4-adaa-e17e31edd15e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf6624b5b4e64aafa1e38d2c8cd8893d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:08.905080 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded1fd3-555e-43f4-adaa-e17e31edd15e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:09.021163 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6ded1fd3-555e-43f4-adaa-e17e31edd15e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf6624b5b4e64aafa1e38d2c8cd8893d', 'request_id': 'req-6ded1fd3-555e-43f4-adaa-e17e31edd15e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:09.028380 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6ded1fd3-555e-43f4-adaa-e17e31edd15e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf6624b5b4e64aafa1e38d2c8cd8893d', 'request_id': 'req-6ded1fd3-555e-43f4-adaa-e17e31edd15e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:09.078038 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6ded1fd3-555e-43f4-adaa-e17e31edd15e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf6624b5b4e64aafa1e38d2c8cd8893d', 'request_id': 'req-6ded1fd3-555e-43f4-adaa-e17e31edd15e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:09.088289 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6ded1fd3-555e-43f4-adaa-e17e31edd15e admin admin] The token cache is being invalidate because project bf6624b5b4e64aafa1e38d2c8cd8893d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:30:09.089895 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6ded1fd3-555e-43f4-adaa-e17e31edd15e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:09.089895 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-6ded1fd3-555e-43f4-adaa-e17e31edd15e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:09.090757 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1372/2735] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:30:08 2022] DELETE /identity/v3/projects/bf6624b5b4e64aafa1e38d2c8cd8893d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:30:09.095202 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c16f86-2d3b-4a97-8536-f03b9e6f532a service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:09.104629 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c16f86-2d3b-4a97-8536-f03b9e6f532a service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:09.158706 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c48c1-7c58-49f2-b3e1-ccade64390d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:09.159570 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c48c1-7c58-49f2-b3e1-ccade64390d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:09.159851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c48c1-7c58-49f2-b3e1-ccade64390d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:09.160140 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c48c1-7c58-49f2-b3e1-ccade64390d8 admin admin] PATH_INFO: `/v3/users/131b1eb99abb4902a018a090c2f79826` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:09.161302 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c48c1-7c58-49f2-b3e1-ccade64390d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=131b1eb99abb4902a018a090c2f79826)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:09.163267 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c48c1-7c58-49f2-b3e1-ccade64390d8 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:09.336783 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-052c48c1-7c58-49f2-b3e1-ccade64390d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '131b1eb99abb4902a018a090c2f79826'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:09.392703 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-052c48c1-7c58-49f2-b3e1-ccade64390d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '131b1eb99abb4902a018a090c2f79826'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:09.393328 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-052c48c1-7c58-49f2-b3e1-ccade64390d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '131b1eb99abb4902a018a090c2f79826'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:09.405432 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-052c48c1-7c58-49f2-b3e1-ccade64390d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '131b1eb99abb4902a018a090c2f79826'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:09.406062 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-052c48c1-7c58-49f2-b3e1-ccade64390d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '131b1eb99abb4902a018a090c2f79826'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:09.417782 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1364/2736] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:30:09 2022] DELETE /identity/v3/users/131b1eb99abb4902a018a090c2f79826 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:30:09.800826 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded1fd3-555e-43f4-adaa-e17e31edd15e admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:09.802349 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6ded1fd3-555e-43f4-adaa-e17e31edd15e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:09.816450 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded1fd3-555e-43f4-adaa-e17e31edd15e admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:09.885688 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e0bf6-895d-4598-8efb-fae5bcbd6cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:09.886688 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e0bf6-895d-4598-8efb-fae5bcbd6cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:09.886966 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e0bf6-895d-4598-8efb-fae5bcbd6cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:09.887236 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e0bf6-895d-4598-8efb-fae5bcbd6cb2 admin admin] PATH_INFO: `/v3/projects/366090654abb40b79ec5e440ad9f4089` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:09.888435 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e0bf6-895d-4598-8efb-fae5bcbd6cb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=366090654abb40b79ec5e440ad9f4089)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:09.890655 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e0bf6-895d-4598-8efb-fae5bcbd6cb2 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:09.989437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-643e0bf6-895d-4598-8efb-fae5bcbd6cb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '366090654abb40b79ec5e440ad9f4089', 'request_id': 'req-643e0bf6-895d-4598-8efb-fae5bcbd6cb2'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:09.995597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-643e0bf6-895d-4598-8efb-fae5bcbd6cb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '366090654abb40b79ec5e440ad9f4089', 'request_id': 'req-643e0bf6-895d-4598-8efb-fae5bcbd6cb2'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:10.044072 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-643e0bf6-895d-4598-8efb-fae5bcbd6cb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '366090654abb40b79ec5e440ad9f4089', 'request_id': 'req-643e0bf6-895d-4598-8efb-fae5bcbd6cb2'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:10.055852 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-643e0bf6-895d-4598-8efb-fae5bcbd6cb2 admin admin] The token cache is being invalidate because project 366090654abb40b79ec5e440ad9f4089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:30:10.056268 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-643e0bf6-895d-4598-8efb-fae5bcbd6cb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:10.056784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-643e0bf6-895d-4598-8efb-fae5bcbd6cb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:10.058416 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1373/2737] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:30:09 2022] DELETE /identity/v3/projects/366090654abb40b79ec5e440ad9f4089 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:30:10.063544 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9353f6d-9d4d-4372-817a-1891e97767fc None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:10.063868 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9353f6d-9d4d-4372-817a-1891e97767fc None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:10.064158 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9353f6d-9d4d-4372-817a-1891e97767fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:10.081874 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-b9353f6d-9d4d-4372-817a-1891e97767fc None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:30:10.083171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b9353f6d-9d4d-4372-817a-1891e97767fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:10.143675 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1365/2738] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:30:10.151360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dce990-5bd5-4408-bf5d-237e9d0143e0 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:10.151652 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dce990-5bd5-4408-bf5d-237e9d0143e0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:10.151933 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dce990-5bd5-4408-bf5d-237e9d0143e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:10.170938 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-99dce990-5bd5-4408-bf5d-237e9d0143e0 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:30:10.172132 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-99dce990-5bd5-4408-bf5d-237e9d0143e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:10.180045 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1374/2739] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:30:10.184162 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9353f6d-9d4d-4372-817a-1891e97767fc None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:10.193646 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9353f6d-9d4d-4372-817a-1891e97767fc None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:10.198330 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c379f25-e12c-468d-b7c4-7db905e5e1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:10.198990 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c379f25-e12c-468d-b7c4-7db905e5e1cc admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:10.199272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c379f25-e12c-468d-b7c4-7db905e5e1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:10.199578 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c379f25-e12c-468d-b7c4-7db905e5e1cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:10.200335 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c379f25-e12c-468d-b7c4-7db905e5e1cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:30:10.200641 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c379f25-e12c-468d-b7c4-7db905e5e1cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:10.202901 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c379f25-e12c-468d-b7c4-7db905e5e1cc admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:10.214192 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1366/2740] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:30:10.218914 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dce990-5bd5-4408-bf5d-237e9d0143e0 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:10.227832 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dce990-5bd5-4408-bf5d-237e9d0143e0 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:10.232453 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3197b1-75ea-425c-b62a-620d9bcf5cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:10.233089 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3197b1-75ea-425c-b62a-620d9bcf5cbc admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:10.233369 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3197b1-75ea-425c-b62a-620d9bcf5cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:10.233647 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3197b1-75ea-425c-b62a-620d9bcf5cbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:10.234378 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3197b1-75ea-425c-b62a-620d9bcf5cbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:10.236287 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3197b1-75ea-425c-b62a-620d9bcf5cbc admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:10.338072 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1375/2741] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:30:10 2022] POST /identity/v3/projects => generated 389 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:30:10.341619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c379f25-e12c-468d-b7c4-7db905e5e1cc admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:10.352415 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c379f25-e12c-468d-b7c4-7db905e5e1cc admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:10.407903 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45189f5f-082b-4506-a8fc-6e2b91e9d197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:10.408496 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45189f5f-082b-4506-a8fc-6e2b91e9d197 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:10.408778 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45189f5f-082b-4506-a8fc-6e2b91e9d197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:10.409051 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45189f5f-082b-4506-a8fc-6e2b91e9d197 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:10.409744 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45189f5f-082b-4506-a8fc-6e2b91e9d197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:10.411698 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45189f5f-082b-4506-a8fc-6e2b91e9d197 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:10.496295 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1367/2742] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:30:10 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:30:10.500347 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3197b1-75ea-425c-b62a-620d9bcf5cbc admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:10.510843 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3197b1-75ea-425c-b62a-620d9bcf5cbc admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:10.516323 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f7bcf-0aa7-4b09-9e2e-8e899b28ce24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:10.516974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f7bcf-0aa7-4b09-9e2e-8e899b28ce24 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:10.517292 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f7bcf-0aa7-4b09-9e2e-8e899b28ce24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:10.517569 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f7bcf-0aa7-4b09-9e2e-8e899b28ce24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:10.518331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f7bcf-0aa7-4b09-9e2e-8e899b28ce24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:10.522539 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f7bcf-0aa7-4b09-9e2e-8e899b28ce24 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:10.530937 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1376/2743] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:30:10.534765 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45189f5f-082b-4506-a8fc-6e2b91e9d197 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:10.544519 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45189f5f-082b-4506-a8fc-6e2b91e9d197 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:10.549330 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fbb5b-c595-45f5-9439-9ef943de484a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:10.549987 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fbb5b-c595-45f5-9439-9ef943de484a admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:10.550316 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fbb5b-c595-45f5-9439-9ef943de484a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:10.550597 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fbb5b-c595-45f5-9439-9ef943de484a admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:10.551366 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317fbb5b-c595-45f5-9439-9ef943de484a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:10.552954 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317fbb5b-c595-45f5-9439-9ef943de484a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:10.563024 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1368/2744] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:30:10.566892 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f7bcf-0aa7-4b09-9e2e-8e899b28ce24 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:10.577837 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f7bcf-0aa7-4b09-9e2e-8e899b28ce24 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:10.582834 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc88594-91b7-44a5-9be7-6f25742b0176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:10.583715 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc88594-91b7-44a5-9be7-6f25742b0176 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:10.584004 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc88594-91b7-44a5-9be7-6f25742b0176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:10.584298 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc88594-91b7-44a5-9be7-6f25742b0176 admin admin] PATH_INFO: `/v3/projects/b736d9b5dff04241b63ebed291de42be/users/21c6e7a518a347a5b750b13c54d2184f/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:10.599691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc88594-91b7-44a5-9be7-6f25742b0176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b736d9b5dff04241b63ebed291de42be, user_id=21c6e7a518a347a5b750b13c54d2184f, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:10.602377 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc88594-91b7-44a5-9be7-6f25742b0176 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:10.684881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1377/2745] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:30:10 2022] PUT /identity/v3/projects/b736d9b5dff04241b63ebed291de42be/users/21c6e7a518a347a5b750b13c54d2184f/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:30:10.695805 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2de85-9982-49fd-acca-151e26a88395 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:10.696167 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2de85-9982-49fd-acca-151e26a88395 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:10.696452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2de85-9982-49fd-acca-151e26a88395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:10.722665 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9cb2de85-9982-49fd-acca-151e26a88395 None None] MFA Rules not processed for user `21c6e7a518a347a5b750b13c54d2184f`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:30:10.723855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9cb2de85-9982-49fd-acca-151e26a88395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:10.785095 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1369/2746] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:30:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:30:10.789661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc88594-91b7-44a5-9be7-6f25742b0176 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:10.851094 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc88594-91b7-44a5-9be7-6f25742b0176 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:10.855810 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492c73e-5fca-4fe3-859c-c0a02e3c03c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:10.856460 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492c73e-5fca-4fe3-859c-c0a02e3c03c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:10.856741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492c73e-5fca-4fe3-859c-c0a02e3c03c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:10.857016 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492c73e-5fca-4fe3-859c-c0a02e3c03c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:10.857708 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492c73e-5fca-4fe3-859c-c0a02e3c03c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:10.859644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492c73e-5fca-4fe3-859c-c0a02e3c03c2 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:10.960452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1378/2747] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:30:10 2022] POST /identity/v3/projects => generated 389 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:30:10.964470 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2de85-9982-49fd-acca-151e26a88395 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:10.975116 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2de85-9982-49fd-acca-151e26a88395 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:11.033238 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcba74b-a1c4-44d6-9aac-86d88a451dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:11.033906 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcba74b-a1c4-44d6-9aac-86d88a451dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:11.034216 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcba74b-a1c4-44d6-9aac-86d88a451dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:11.034491 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcba74b-a1c4-44d6-9aac-86d88a451dc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:11.035171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcba74b-a1c4-44d6-9aac-86d88a451dc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:11.037091 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcba74b-a1c4-44d6-9aac-86d88a451dc8 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:11.147381 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1370/2748] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:30:10 2022] POST /identity/v3/users => generated 301 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:30:11.151530 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492c73e-5fca-4fe3-859c-c0a02e3c03c2 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:11.161652 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492c73e-5fca-4fe3-859c-c0a02e3c03c2 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:11.166330 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473450f-5560-49e4-897a-e862e1499f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:11.166982 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473450f-5560-49e4-897a-e862e1499f74 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:11.167269 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473450f-5560-49e4-897a-e862e1499f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:11.167552 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473450f-5560-49e4-897a-e862e1499f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:11.168281 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473450f-5560-49e4-897a-e862e1499f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:11.170407 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473450f-5560-49e4-897a-e862e1499f74 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:11.180673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1379/2749] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:30:11.184709 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcba74b-a1c4-44d6-9aac-86d88a451dc8 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:11.194982 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcba74b-a1c4-44d6-9aac-86d88a451dc8 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:11.199639 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90157433-8418-45ba-947f-614606d8f4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:11.200504 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90157433-8418-45ba-947f-614606d8f4d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:11.200784 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90157433-8418-45ba-947f-614606d8f4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:11.201058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90157433-8418-45ba-947f-614606d8f4d1 admin admin] PATH_INFO: `/v3/projects/c77a22a2f8e445e1a13462099fdabdea/users/478edc6dff004b53b3cfd458b3181394/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:11.215787 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90157433-8418-45ba-947f-614606d8f4d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77a22a2f8e445e1a13462099fdabdea, user_id=478edc6dff004b53b3cfd458b3181394, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:11.218564 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90157433-8418-45ba-947f-614606d8f4d1 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:11.319457 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1371/2750] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:30:11 2022] PUT /identity/v3/projects/c77a22a2f8e445e1a13462099fdabdea/users/478edc6dff004b53b3cfd458b3181394/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:30:11.323476 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473450f-5560-49e4-897a-e862e1499f74 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:11.333330 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473450f-5560-49e4-897a-e862e1499f74 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:11.387175 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed140a98-01db-41db-9b69-f50fe76b1403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:11.387871 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed140a98-01db-41db-9b69-f50fe76b1403 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:11.388156 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed140a98-01db-41db-9b69-f50fe76b1403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:11.388458 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed140a98-01db-41db-9b69-f50fe76b1403 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:11.389163 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed140a98-01db-41db-9b69-f50fe76b1403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:11.391070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed140a98-01db-41db-9b69-f50fe76b1403 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:11.400504 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1380/2751] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:30:11.405059 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90157433-8418-45ba-947f-614606d8f4d1 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:11.415015 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90157433-8418-45ba-947f-614606d8f4d1 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:11.419596 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c187e5-49ec-4411-acc7-84bfae1565a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:11.421022 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c187e5-49ec-4411-acc7-84bfae1565a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:11.421301 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c187e5-49ec-4411-acc7-84bfae1565a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:11.421577 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c187e5-49ec-4411-acc7-84bfae1565a7 admin admin] PATH_INFO: `/v3/projects/c77a22a2f8e445e1a13462099fdabdea/users/478edc6dff004b53b3cfd458b3181394/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:11.423631 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c187e5-49ec-4411-acc7-84bfae1565a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77a22a2f8e445e1a13462099fdabdea, user_id=478edc6dff004b53b3cfd458b3181394, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:11.426300 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c187e5-49ec-4411-acc7-84bfae1565a7 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:11.436574 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1372/2752] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:30:11 2022] PUT /identity/v3/projects/c77a22a2f8e445e1a13462099fdabdea/users/478edc6dff004b53b3cfd458b3181394/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:30:11.447482 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bfcca-8d60-4cf2-b1d1-dddd987c7b68 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:11.447774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bfcca-8d60-4cf2-b1d1-dddd987c7b68 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:11.448056 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bfcca-8d60-4cf2-b1d1-dddd987c7b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:11.473839 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e98bfcca-8d60-4cf2-b1d1-dddd987c7b68 None None] MFA Rules not processed for user `478edc6dff004b53b3cfd458b3181394`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:30:11.474995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e98bfcca-8d60-4cf2-b1d1-dddd987c7b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:11.540778 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1381/2753] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:30:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:30:11.552137 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c187e5-49ec-4411-acc7-84bfae1565a7 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:11.553935 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b6c187e5-49ec-4411-acc7-84bfae1565a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:11.609857 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c187e5-49ec-4411-acc7-84bfae1565a7 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:11.613485 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d177ff5-ed1c-417c-8570-0cf4b8079ced service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:11.614137 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d177ff5-ed1c-417c-8570-0cf4b8079ced service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:11.614442 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d177ff5-ed1c-417c-8570-0cf4b8079ced service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:11.614719 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d177ff5-ed1c-417c-8570-0cf4b8079ced service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:11.623479 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d177ff5-ed1c-417c-8570-0cf4b8079ced service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:11.624914 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d177ff5-ed1c-417c-8570-0cf4b8079ced service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:11.634365 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1373/2754] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:30:11 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:30:11.768397 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bfcca-8d60-4cf2-b1d1-dddd987c7b68 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:11.828064 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bfcca-8d60-4cf2-b1d1-dddd987c7b68 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:11.832482 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72713e25-08a8-4a91-98c6-d360b3be69dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:11.833332 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72713e25-08a8-4a91-98c6-d360b3be69dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:11.833610 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72713e25-08a8-4a91-98c6-d360b3be69dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:11.833878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72713e25-08a8-4a91-98c6-d360b3be69dc admin admin] PATH_INFO: `/v3/users/21c6e7a518a347a5b750b13c54d2184f` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:11.835200 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72713e25-08a8-4a91-98c6-d360b3be69dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=21c6e7a518a347a5b750b13c54d2184f)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:11.837107 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72713e25-08a8-4a91-98c6-d360b3be69dc admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:12.035253 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-72713e25-08a8-4a91-98c6-d360b3be69dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21c6e7a518a347a5b750b13c54d2184f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:12.047152 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-72713e25-08a8-4a91-98c6-d360b3be69dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21c6e7a518a347a5b750b13c54d2184f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:12.047835 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-72713e25-08a8-4a91-98c6-d360b3be69dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21c6e7a518a347a5b750b13c54d2184f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:12.048445 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-72713e25-08a8-4a91-98c6-d360b3be69dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21c6e7a518a347a5b750b13c54d2184f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:12.055086 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-72713e25-08a8-4a91-98c6-d360b3be69dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21c6e7a518a347a5b750b13c54d2184f'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:12.117735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1382/2755] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:30:11 2022] DELETE /identity/v3/users/21c6e7a518a347a5b750b13c54d2184f => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:30:12.122300 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b98c46-8031-4a8f-a60c-1c8c00fd4c3f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:12.122592 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b98c46-8031-4a8f-a60c-1c8c00fd4c3f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:12.122874 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b98c46-8031-4a8f-a60c-1c8c00fd4c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:12.141617 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-13b98c46-8031-4a8f-a60c-1c8c00fd4c3f None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:30:12.142847 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-13b98c46-8031-4a8f-a60c-1c8c00fd4c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:12.199289 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1374/2756] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:30:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:30:12.209493 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72713e25-08a8-4a91-98c6-d360b3be69dc admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:12.210972 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-72713e25-08a8-4a91-98c6-d360b3be69dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:12.268129 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72713e25-08a8-4a91-98c6-d360b3be69dc admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:12.271821 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1c2f3-7ac1-424e-bb6e-86a898907a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:12.272461 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1c2f3-7ac1-424e-bb6e-86a898907a05 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:12.272745 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1c2f3-7ac1-424e-bb6e-86a898907a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:12.273022 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1c2f3-7ac1-424e-bb6e-86a898907a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:12.281960 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1c2f3-7ac1-424e-bb6e-86a898907a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:12.283480 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1c2f3-7ac1-424e-bb6e-86a898907a05 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:12.292973 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1383/2757] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:30:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:30:12.692065 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b98c46-8031-4a8f-a60c-1c8c00fd4c3f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:12.697452 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-13b98c46-8031-4a8f-a60c-1c8c00fd4c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:12.705296 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b98c46-8031-4a8f-a60c-1c8c00fd4c3f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:12.709976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bfa33-5c28-480c-bd64-33c4fe07c836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:12.710861 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bfa33-5c28-480c-bd64-33c4fe07c836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:12.711136 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bfa33-5c28-480c-bd64-33c4fe07c836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:12.711416 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bfa33-5c28-480c-bd64-33c4fe07c836 admin admin] PATH_INFO: `/v3/projects/b736d9b5dff04241b63ebed291de42be` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:12.712598 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359bfa33-5c28-480c-bd64-33c4fe07c836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b736d9b5dff04241b63ebed291de42be)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:12.714564 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359bfa33-5c28-480c-bd64-33c4fe07c836 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:12.791881 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-359bfa33-5c28-480c-bd64-33c4fe07c836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b736d9b5dff04241b63ebed291de42be', 'request_id': 'req-359bfa33-5c28-480c-bd64-33c4fe07c836'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:12.844128 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-359bfa33-5c28-480c-bd64-33c4fe07c836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b736d9b5dff04241b63ebed291de42be', 'request_id': 'req-359bfa33-5c28-480c-bd64-33c4fe07c836'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:12.850773 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-359bfa33-5c28-480c-bd64-33c4fe07c836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b736d9b5dff04241b63ebed291de42be', 'request_id': 'req-359bfa33-5c28-480c-bd64-33c4fe07c836'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:12.861438 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-359bfa33-5c28-480c-bd64-33c4fe07c836 admin admin] The token cache is being invalidate because project b736d9b5dff04241b63ebed291de42be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:30:12.861727 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-359bfa33-5c28-480c-bd64-33c4fe07c836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:12.862572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-359bfa33-5c28-480c-bd64-33c4fe07c836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:12.864140 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1375/2758] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:30:12 2022] DELETE /identity/v3/projects/b736d9b5dff04241b63ebed291de42be => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:30:12.868081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1c2f3-7ac1-424e-bb6e-86a898907a05 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:12.878251 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1c2f3-7ac1-424e-bb6e-86a898907a05 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:12.934103 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834f1e0-6015-45eb-bcc0-fc2aad691db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:12.935032 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834f1e0-6015-45eb-bcc0-fc2aad691db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:12.935319 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834f1e0-6015-45eb-bcc0-fc2aad691db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:12.935589 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834f1e0-6015-45eb-bcc0-fc2aad691db6 admin admin] PATH_INFO: `/v3/users/478edc6dff004b53b3cfd458b3181394` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:12.936784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834f1e0-6015-45eb-bcc0-fc2aad691db6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=478edc6dff004b53b3cfd458b3181394)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:12.938784 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834f1e0-6015-45eb-bcc0-fc2aad691db6 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:13.098342 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c834f1e0-6015-45eb-bcc0-fc2aad691db6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '478edc6dff004b53b3cfd458b3181394'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:13.110496 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c834f1e0-6015-45eb-bcc0-fc2aad691db6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '478edc6dff004b53b3cfd458b3181394'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:13.111170 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c834f1e0-6015-45eb-bcc0-fc2aad691db6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '478edc6dff004b53b3cfd458b3181394'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:13.111783 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c834f1e0-6015-45eb-bcc0-fc2aad691db6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '478edc6dff004b53b3cfd458b3181394'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:13.118395 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c834f1e0-6015-45eb-bcc0-fc2aad691db6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '478edc6dff004b53b3cfd458b3181394'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:13.163419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1384/2759] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:30:12 2022] DELETE /identity/v3/users/478edc6dff004b53b3cfd458b3181394 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:30:13.605774 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bfa33-5c28-480c-bd64-33c4fe07c836 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:13.614113 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-359bfa33-5c28-480c-bd64-33c4fe07c836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:13.622106 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bfa33-5c28-480c-bd64-33c4fe07c836 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:13.687515 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5740d01-1b2c-4c10-91c9-09cab7af8cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:13.688384 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5740d01-1b2c-4c10-91c9-09cab7af8cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:13.688666 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5740d01-1b2c-4c10-91c9-09cab7af8cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:13.688942 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5740d01-1b2c-4c10-91c9-09cab7af8cf3 admin admin] PATH_INFO: `/v3/projects/c77a22a2f8e445e1a13462099fdabdea` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:13.690117 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5740d01-1b2c-4c10-91c9-09cab7af8cf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c77a22a2f8e445e1a13462099fdabdea)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:13.692071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5740d01-1b2c-4c10-91c9-09cab7af8cf3 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:13.803319 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d5740d01-1b2c-4c10-91c9-09cab7af8cf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c77a22a2f8e445e1a13462099fdabdea', 'request_id': 'req-d5740d01-1b2c-4c10-91c9-09cab7af8cf3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:13.873001 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d5740d01-1b2c-4c10-91c9-09cab7af8cf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c77a22a2f8e445e1a13462099fdabdea', 'request_id': 'req-d5740d01-1b2c-4c10-91c9-09cab7af8cf3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:13.879824 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d5740d01-1b2c-4c10-91c9-09cab7af8cf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c77a22a2f8e445e1a13462099fdabdea', 'request_id': 'req-d5740d01-1b2c-4c10-91c9-09cab7af8cf3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:13.890696 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d5740d01-1b2c-4c10-91c9-09cab7af8cf3 admin admin] The token cache is being invalidate because project c77a22a2f8e445e1a13462099fdabdea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:30:13.890988 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d5740d01-1b2c-4c10-91c9-09cab7af8cf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:13.891641 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-d5740d01-1b2c-4c10-91c9-09cab7af8cf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:13.893231 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1376/2760] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:30:13 2022] DELETE /identity/v3/projects/c77a22a2f8e445e1a13462099fdabdea => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:30:13.898098 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03709ca2-e2db-4a6c-a032-36b41976ae93 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:13.898414 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03709ca2-e2db-4a6c-a032-36b41976ae93 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:13.898693 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03709ca2-e2db-4a6c-a032-36b41976ae93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:13.919592 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-03709ca2-e2db-4a6c-a032-36b41976ae93 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:30:13.921452 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-03709ca2-e2db-4a6c-a032-36b41976ae93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:13.980167 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1385/2761] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:30:13.987968 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4dd9f-dcbf-4958-a413-5f4c54372529 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:13.988255 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4dd9f-dcbf-4958-a413-5f4c54372529 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:13.988528 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4dd9f-dcbf-4958-a413-5f4c54372529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:14.006712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-61f4dd9f-dcbf-4958-a413-5f4c54372529 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:30:14.007893 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-61f4dd9f-dcbf-4958-a413-5f4c54372529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:14.016630 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1377/2762] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:30:14.020834 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03709ca2-e2db-4a6c-a032-36b41976ae93 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:14.031191 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03709ca2-e2db-4a6c-a032-36b41976ae93 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:14.036107 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1eff5-ac5a-42b9-a042-e50b14364869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:14.036793 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1eff5-ac5a-42b9-a042-e50b14364869 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:14.037078 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1eff5-ac5a-42b9-a042-e50b14364869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:14.037356 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1eff5-ac5a-42b9-a042-e50b14364869 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:14.038083 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1eff5-ac5a-42b9-a042-e50b14364869 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:30:14.038428 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1eff5-ac5a-42b9-a042-e50b14364869 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:14.040125 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1eff5-ac5a-42b9-a042-e50b14364869 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:14.051846 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1386/2763] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:30:14.056486 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4dd9f-dcbf-4958-a413-5f4c54372529 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:14.065698 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4dd9f-dcbf-4958-a413-5f4c54372529 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:14.070607 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68430d-d250-42ac-a37f-941d415652d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:14.073099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68430d-d250-42ac-a37f-941d415652d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:14.073099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68430d-d250-42ac-a37f-941d415652d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:14.073099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68430d-d250-42ac-a37f-941d415652d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:14.073099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68430d-d250-42ac-a37f-941d415652d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:14.074372 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68430d-d250-42ac-a37f-941d415652d0 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:14.171372 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1378/2764] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:30:14 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:30:14.175379 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1eff5-ac5a-42b9-a042-e50b14364869 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:14.185586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1eff5-ac5a-42b9-a042-e50b14364869 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:14.241082 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e11d2-f156-4177-8a15-aa77278113a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:14.241771 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e11d2-f156-4177-8a15-aa77278113a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:14.242041 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e11d2-f156-4177-8a15-aa77278113a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:14.242351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e11d2-f156-4177-8a15-aa77278113a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:14.243043 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e11d2-f156-4177-8a15-aa77278113a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:14.245018 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e11d2-f156-4177-8a15-aa77278113a7 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:14.353162 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1387/2765] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:30:14 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:30:14.363886 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68430d-d250-42ac-a37f-941d415652d0 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:14.374539 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68430d-d250-42ac-a37f-941d415652d0 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:14.379100 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f67cd4-5837-4a7a-86dc-61a1c386cc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:14.379865 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f67cd4-5837-4a7a-86dc-61a1c386cc7b admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:14.380152 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f67cd4-5837-4a7a-86dc-61a1c386cc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:14.380423 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f67cd4-5837-4a7a-86dc-61a1c386cc7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:14.381247 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f67cd4-5837-4a7a-86dc-61a1c386cc7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:14.382772 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f67cd4-5837-4a7a-86dc-61a1c386cc7b admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:14.394536 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1379/2766] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:30:14.398427 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e11d2-f156-4177-8a15-aa77278113a7 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:14.408306 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e11d2-f156-4177-8a15-aa77278113a7 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:14.412925 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac401c77-3e22-482f-9d1c-7e7e11770b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:14.414302 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac401c77-3e22-482f-9d1c-7e7e11770b39 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:14.414302 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac401c77-3e22-482f-9d1c-7e7e11770b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:14.414302 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac401c77-3e22-482f-9d1c-7e7e11770b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:14.414843 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac401c77-3e22-482f-9d1c-7e7e11770b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:14.416434 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac401c77-3e22-482f-9d1c-7e7e11770b39 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:14.426341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1388/2767] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:30:14.430239 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f67cd4-5837-4a7a-86dc-61a1c386cc7b admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:14.440619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f67cd4-5837-4a7a-86dc-61a1c386cc7b admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:14.445191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cdbe6-d5dc-4acb-a793-193c3a55576a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:14.446065 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cdbe6-d5dc-4acb-a793-193c3a55576a admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:14.446422 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cdbe6-d5dc-4acb-a793-193c3a55576a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:14.446701 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cdbe6-d5dc-4acb-a793-193c3a55576a admin admin] PATH_INFO: `/v3/projects/ec44a56101ca415d885833890c420e34/users/b58f239cb88b4a28b8399fbf8f7fdc0c/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:14.461666 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3cdbe6-d5dc-4acb-a793-193c3a55576a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec44a56101ca415d885833890c420e34, user_id=b58f239cb88b4a28b8399fbf8f7fdc0c, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:14.464377 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3cdbe6-d5dc-4acb-a793-193c3a55576a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:14.576290 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1380/2768] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:30:14 2022] PUT /identity/v3/projects/ec44a56101ca415d885833890c420e34/users/b58f239cb88b4a28b8399fbf8f7fdc0c/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:30:14.587317 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6f33a-91d9-40c2-8479-e5f6592f9af5 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:14.587612 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6f33a-91d9-40c2-8479-e5f6592f9af5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:14.587894 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6f33a-91d9-40c2-8479-e5f6592f9af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:14.613896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9bc6f33a-91d9-40c2-8479-e5f6592f9af5 None None] MFA Rules not processed for user `b58f239cb88b4a28b8399fbf8f7fdc0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:30:14.615139 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9bc6f33a-91d9-40c2-8479-e5f6592f9af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:14.679226 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1389/2769] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:30:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:30:14.690476 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cdbe6-d5dc-4acb-a793-193c3a55576a admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:14.692278 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8b3cdbe6-d5dc-4acb-a793-193c3a55576a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:14.750766 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cdbe6-d5dc-4acb-a793-193c3a55576a admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:14.755216 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa7554-f1e9-49b6-bc96-436ece69b28f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d1e67aa4370453fafb5b6525ba13cd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:14.755852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa7554-f1e9-49b6-bc96-436ece69b28f service glance] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:14.756133 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa7554-f1e9-49b6-bc96-436ece69b28f service glance] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:14.756405 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa7554-f1e9-49b6-bc96-436ece69b28f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:14.765172 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa7554-f1e9-49b6-bc96-436ece69b28f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:14.766936 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa7554-f1e9-49b6-bc96-436ece69b28f service glance] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:14.775492 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1381/2770] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:30:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:30:31.839451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6f33a-91d9-40c2-8479-e5f6592f9af5 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:31.902694 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6f33a-91d9-40c2-8479-e5f6592f9af5 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:31.907576 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3743587-b106-469b-a249-98950ce8410d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:31.908502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3743587-b106-469b-a249-98950ce8410d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:31.908827 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3743587-b106-469b-a249-98950ce8410d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:31.909104 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3743587-b106-469b-a249-98950ce8410d admin admin] PATH_INFO: `/v3/users/b58f239cb88b4a28b8399fbf8f7fdc0c` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:31.910331 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3743587-b106-469b-a249-98950ce8410d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b58f239cb88b4a28b8399fbf8f7fdc0c)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:31.912299 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3743587-b106-469b-a249-98950ce8410d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:32.077923 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d3743587-b106-469b-a249-98950ce8410d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b58f239cb88b4a28b8399fbf8f7fdc0c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:32.088679 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d3743587-b106-469b-a249-98950ce8410d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b58f239cb88b4a28b8399fbf8f7fdc0c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:32.089427 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d3743587-b106-469b-a249-98950ce8410d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b58f239cb88b4a28b8399fbf8f7fdc0c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:32.090157 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d3743587-b106-469b-a249-98950ce8410d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b58f239cb88b4a28b8399fbf8f7fdc0c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:32.097186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d3743587-b106-469b-a249-98950ce8410d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b58f239cb88b4a28b8399fbf8f7fdc0c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:32.193243 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1390/2771] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:30:31 2022] DELETE /identity/v3/users/b58f239cb88b4a28b8399fbf8f7fdc0c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:30:32.197918 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415e43f-2282-4af6-90b1-9609971d0c1f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:32.198427 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415e43f-2282-4af6-90b1-9609971d0c1f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:32.198572 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415e43f-2282-4af6-90b1-9609971d0c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:32.216213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0415e43f-2282-4af6-90b1-9609971d0c1f None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:30:32.217412 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0415e43f-2282-4af6-90b1-9609971d0c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:32.278273 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1382/2772] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:30:32.288969 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3743587-b106-469b-a249-98950ce8410d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:32.290460 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d3743587-b106-469b-a249-98950ce8410d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:32.351469 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3743587-b106-469b-a249-98950ce8410d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:32.355228 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97727185-5d7c-4762-b8a4-6d10f33f30e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:32.356831 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97727185-5d7c-4762-b8a4-6d10f33f30e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:32.357120 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97727185-5d7c-4762-b8a4-6d10f33f30e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:32.357397 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97727185-5d7c-4762-b8a4-6d10f33f30e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:32.367473 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97727185-5d7c-4762-b8a4-6d10f33f30e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:32.368931 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97727185-5d7c-4762-b8a4-6d10f33f30e5 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:32.378937 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1391/2773] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:30:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:30:32.824164 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415e43f-2282-4af6-90b1-9609971d0c1f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:32.827146 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0415e43f-2282-4af6-90b1-9609971d0c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:32.842089 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415e43f-2282-4af6-90b1-9609971d0c1f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:32.847852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad674310-e610-437f-ae41-57074833f2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:32.849697 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad674310-e610-437f-ae41-57074833f2c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:32.849979 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad674310-e610-437f-ae41-57074833f2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:32.850325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad674310-e610-437f-ae41-57074833f2c3 admin admin] PATH_INFO: `/v3/projects/ec44a56101ca415d885833890c420e34` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:32.852330 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad674310-e610-437f-ae41-57074833f2c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec44a56101ca415d885833890c420e34)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:32.856261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad674310-e610-437f-ae41-57074833f2c3 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:32.973923 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ad674310-e610-437f-ae41-57074833f2c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec44a56101ca415d885833890c420e34', 'request_id': 'req-ad674310-e610-437f-ae41-57074833f2c3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:33.056182 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ad674310-e610-437f-ae41-57074833f2c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec44a56101ca415d885833890c420e34', 'request_id': 'req-ad674310-e610-437f-ae41-57074833f2c3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:33.063099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ad674310-e610-437f-ae41-57074833f2c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec44a56101ca415d885833890c420e34', 'request_id': 'req-ad674310-e610-437f-ae41-57074833f2c3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:33.075280 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ad674310-e610-437f-ae41-57074833f2c3 admin admin] The token cache is being invalidate because project ec44a56101ca415d885833890c420e34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:30:33.075577 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ad674310-e610-437f-ae41-57074833f2c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:33.076275 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ad674310-e610-437f-ae41-57074833f2c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:33.077899 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1383/2774] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:30:32 2022] DELETE /identity/v3/projects/ec44a56101ca415d885833890c420e34 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:30:33.083098 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fbc51-10a4-4538-bed4-62607b19ad2f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:33.083597 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fbc51-10a4-4538-bed4-62607b19ad2f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:33.083696 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fbc51-10a4-4538-bed4-62607b19ad2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:33.103764 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-053fbc51-10a4-4538-bed4-62607b19ad2f None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:30:33.105062 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-053fbc51-10a4-4538-bed4-62607b19ad2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:33.166203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1392/2775] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:30:33.175090 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0b311-a7a9-4f0c-9fc0-4a94eb43e632 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:33.175383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0b311-a7a9-4f0c-9fc0-4a94eb43e632 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:33.177348 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0b311-a7a9-4f0c-9fc0-4a94eb43e632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:33.198819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-c3f0b311-a7a9-4f0c-9fc0-4a94eb43e632 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:30:33.200016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c3f0b311-a7a9-4f0c-9fc0-4a94eb43e632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:33.208175 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1384/2776] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:30:33.212301 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fbc51-10a4-4538-bed4-62607b19ad2f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:33.223272 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fbc51-10a4-4538-bed4-62607b19ad2f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:33.228885 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86da4af-38ac-477b-8935-14522a22697c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:33.229519 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86da4af-38ac-477b-8935-14522a22697c admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:33.229796 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86da4af-38ac-477b-8935-14522a22697c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:33.230065 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86da4af-38ac-477b-8935-14522a22697c admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:33.230840 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86da4af-38ac-477b-8935-14522a22697c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:30:33.231144 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86da4af-38ac-477b-8935-14522a22697c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:33.232807 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86da4af-38ac-477b-8935-14522a22697c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:33.245185 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1393/2777] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:30:33.249481 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0b311-a7a9-4f0c-9fc0-4a94eb43e632 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:33.259763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0b311-a7a9-4f0c-9fc0-4a94eb43e632 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:33.264632 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311595f-feef-444a-8263-d2397967c46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:33.265318 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311595f-feef-444a-8263-d2397967c46c admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:33.265601 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311595f-feef-444a-8263-d2397967c46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:33.265878 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311595f-feef-444a-8263-d2397967c46c admin admin] PATH_INFO: `/v3/projects` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:33.266918 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311595f-feef-444a-8263-d2397967c46c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:33.268872 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311595f-feef-444a-8263-d2397967c46c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:33.349415 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1385/2778] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:30:33 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:30:33.353698 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86da4af-38ac-477b-8935-14522a22697c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:33.364841 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86da4af-38ac-477b-8935-14522a22697c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:33.424511 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774bb89-ae26-4c57-b68b-b30b897b25fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:33.425196 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774bb89-ae26-4c57-b68b-b30b897b25fd admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:33.425478 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774bb89-ae26-4c57-b68b-b30b897b25fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:33.425754 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774bb89-ae26-4c57-b68b-b30b897b25fd admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:33.426516 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f774bb89-ae26-4c57-b68b-b30b897b25fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:33.428455 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f774bb89-ae26-4c57-b68b-b30b897b25fd admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:33.538073 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1394/2779] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:30:33 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:30:33.538337 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311595f-feef-444a-8263-d2397967c46c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:33.545699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311595f-feef-444a-8263-d2397967c46c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:33.550838 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180f520-4c72-4755-8aa9-d38c822faf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:33.551541 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180f520-4c72-4755-8aa9-d38c822faf56 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:33.551810 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180f520-4c72-4755-8aa9-d38c822faf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:33.552080 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180f520-4c72-4755-8aa9-d38c822faf56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:33.552857 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180f520-4c72-4755-8aa9-d38c822faf56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:33.555087 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180f520-4c72-4755-8aa9-d38c822faf56 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:33.566299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1386/2780] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:30:33.571117 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774bb89-ae26-4c57-b68b-b30b897b25fd admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:33.581174 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774bb89-ae26-4c57-b68b-b30b897b25fd admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:33.586217 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a8d46-fff0-404e-b2cb-8388aee4cf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:33.586885 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a8d46-fff0-404e-b2cb-8388aee4cf9b admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:33.587164 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a8d46-fff0-404e-b2cb-8388aee4cf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:33.587448 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a8d46-fff0-404e-b2cb-8388aee4cf9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:33.588271 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a8d46-fff0-404e-b2cb-8388aee4cf9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:33.589867 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a8d46-fff0-404e-b2cb-8388aee4cf9b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:33.600172 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1395/2781] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:30:33.604516 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180f520-4c72-4755-8aa9-d38c822faf56 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:33.614784 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180f520-4c72-4755-8aa9-d38c822faf56 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:33.620319 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4b0d4-69ab-4234-ace0-bce1c43b59cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:33.621248 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4b0d4-69ab-4234-ace0-bce1c43b59cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:33.621531 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4b0d4-69ab-4234-ace0-bce1c43b59cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:33.621809 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4b0d4-69ab-4234-ace0-bce1c43b59cf admin admin] PATH_INFO: `/v3/projects/5ea9dcef4cd844b38dc00e9e59e5be90/users/c8a5df25766142e6baed74b5793f8a5c/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:33.636916 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4b0d4-69ab-4234-ace0-bce1c43b59cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ea9dcef4cd844b38dc00e9e59e5be90, user_id=c8a5df25766142e6baed74b5793f8a5c, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:33.639626 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4b0d4-69ab-4234-ace0-bce1c43b59cf admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:33.794417 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1387/2782] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:30:33 2022] PUT /identity/v3/projects/5ea9dcef4cd844b38dc00e9e59e5be90/users/c8a5df25766142e6baed74b5793f8a5c/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:30:33.805402 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4252c7-0468-4c8d-b3a3-f3cb950fdc3a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:33.805710 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4252c7-0468-4c8d-b3a3-f3cb950fdc3a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:33.814360 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4252c7-0468-4c8d-b3a3-f3cb950fdc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:33.833287 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-fc4252c7-0468-4c8d-b3a3-f3cb950fdc3a None None] MFA Rules not processed for user `c8a5df25766142e6baed74b5793f8a5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:30:33.834544 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fc4252c7-0468-4c8d-b3a3-f3cb950fdc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:33.899898 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1396/2783] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:30:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:30:33.911241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4b0d4-69ab-4234-ace0-bce1c43b59cf admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:33.913526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-14b4b0d4-69ab-4234-ace0-bce1c43b59cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:33.970552 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4b0d4-69ab-4234-ace0-bce1c43b59cf admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:33.974304 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56b004-5e83-45db-888a-12e39dea9dac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:33.974959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56b004-5e83-45db-888a-12e39dea9dac service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:33.975235 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56b004-5e83-45db-888a-12e39dea9dac service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:33.976082 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56b004-5e83-45db-888a-12e39dea9dac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:33.984817 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56b004-5e83-45db-888a-12e39dea9dac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:33.986291 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56b004-5e83-45db-888a-12e39dea9dac service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:33.996347 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1388/2784] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:30:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:30:45.041792 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4252c7-0468-4c8d-b3a3-f3cb950fdc3a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:45.100985 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4252c7-0468-4c8d-b3a3-f3cb950fdc3a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:45.105513 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98db530-39e8-42c6-a49f-72ac33a5d300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:45.106401 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98db530-39e8-42c6-a49f-72ac33a5d300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:45.106693 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98db530-39e8-42c6-a49f-72ac33a5d300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:45.106972 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98db530-39e8-42c6-a49f-72ac33a5d300 admin admin] PATH_INFO: `/v3/users/c8a5df25766142e6baed74b5793f8a5c` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:45.108157 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98db530-39e8-42c6-a49f-72ac33a5d300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8a5df25766142e6baed74b5793f8a5c)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:45.110070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98db530-39e8-42c6-a49f-72ac33a5d300 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:45.257001 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f98db530-39e8-42c6-a49f-72ac33a5d300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8a5df25766142e6baed74b5793f8a5c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:45.269266 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f98db530-39e8-42c6-a49f-72ac33a5d300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8a5df25766142e6baed74b5793f8a5c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:45.269927 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f98db530-39e8-42c6-a49f-72ac33a5d300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8a5df25766142e6baed74b5793f8a5c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:45.270565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f98db530-39e8-42c6-a49f-72ac33a5d300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8a5df25766142e6baed74b5793f8a5c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:45.277206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-f98db530-39e8-42c6-a49f-72ac33a5d300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8a5df25766142e6baed74b5793f8a5c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:45.352354 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1397/2785] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:30:45 2022] DELETE /identity/v3/users/c8a5df25766142e6baed74b5793f8a5c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:30:45.356835 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952bf6d-9ba4-45ed-b62c-07fc07ef3dec None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:45.357313 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952bf6d-9ba4-45ed-b62c-07fc07ef3dec None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:45.357432 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952bf6d-9ba4-45ed-b62c-07fc07ef3dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:45.374382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-c952bf6d-9ba4-45ed-b62c-07fc07ef3dec None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:30:45.375569 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c952bf6d-9ba4-45ed-b62c-07fc07ef3dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:45.432508 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1389/2786] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:30:45.442070 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98db530-39e8-42c6-a49f-72ac33a5d300 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:45.443526 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f98db530-39e8-42c6-a49f-72ac33a5d300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:45.498691 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98db530-39e8-42c6-a49f-72ac33a5d300 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:45.502323 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd02c0b-ac22-4ebf-9018-3311e5792a54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:45.511151 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd02c0b-ac22-4ebf-9018-3311e5792a54 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:45.511151 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd02c0b-ac22-4ebf-9018-3311e5792a54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:45.511151 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd02c0b-ac22-4ebf-9018-3311e5792a54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:45.512801 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd02c0b-ac22-4ebf-9018-3311e5792a54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:45.514268 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd02c0b-ac22-4ebf-9018-3311e5792a54 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:45.523616 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1398/2787] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:30:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:30:45.926378 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952bf6d-9ba4-45ed-b62c-07fc07ef3dec None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:30:45.927819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c952bf6d-9ba4-45ed-b62c-07fc07ef3dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:30:45.940510 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952bf6d-9ba4-45ed-b62c-07fc07ef3dec None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:30:45.946290 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d647b-9b40-4883-a05f-16fbe2d9cbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:30:45.947192 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d647b-9b40-4883-a05f-16fbe2d9cbd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:30:45.947465 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d647b-9b40-4883-a05f-16fbe2d9cbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:30:45.947742 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d647b-9b40-4883-a05f-16fbe2d9cbd7 admin admin] PATH_INFO: `/v3/projects/5ea9dcef4cd844b38dc00e9e59e5be90` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:30:45.948935 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d647b-9b40-4883-a05f-16fbe2d9cbd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ea9dcef4cd844b38dc00e9e59e5be90)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:30:45.951583 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d647b-9b40-4883-a05f-16fbe2d9cbd7 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:30:46.089998 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a73d647b-9b40-4883-a05f-16fbe2d9cbd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ea9dcef4cd844b38dc00e9e59e5be90', 'request_id': 'req-a73d647b-9b40-4883-a05f-16fbe2d9cbd7'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:46.164792 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a73d647b-9b40-4883-a05f-16fbe2d9cbd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ea9dcef4cd844b38dc00e9e59e5be90', 'request_id': 'req-a73d647b-9b40-4883-a05f-16fbe2d9cbd7'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:46.171039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a73d647b-9b40-4883-a05f-16fbe2d9cbd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ea9dcef4cd844b38dc00e9e59e5be90', 'request_id': 'req-a73d647b-9b40-4883-a05f-16fbe2d9cbd7'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:46.181002 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a73d647b-9b40-4883-a05f-16fbe2d9cbd7 admin admin] The token cache is being invalidate because project 5ea9dcef4cd844b38dc00e9e59e5be90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80320) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:30:46.181851 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a73d647b-9b40-4883-a05f-16fbe2d9cbd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:46.181961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-a73d647b-9b40-4883-a05f-16fbe2d9cbd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:30:46.183430 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1390/2788] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:30:45 2022] DELETE /identity/v3/projects/5ea9dcef4cd844b38dc00e9e59e5be90 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:31:03.364092 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67a103-c972-4ecd-b69e-c8ffd5930a02 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:31:03.364896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67a103-c972-4ecd-b69e-c8ffd5930a02 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:31:03.364896 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67a103-c972-4ecd-b69e-c8ffd5930a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:31:03.380998 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7b67a103-c972-4ecd-b69e-c8ffd5930a02 None None] MFA Rules not processed for user `e916a70861fc44e69160faf793999f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:31:03.382214 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7b67a103-c972-4ecd-b69e-c8ffd5930a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:31:03.436686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1399/2789] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:31:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:31:05.194431 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da8dd4-cd6d-459d-89cf-9a7e5bc79e2a None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:31:05.194929 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da8dd4-cd6d-459d-89cf-9a7e5bc79e2a None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:31:05.195033 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da8dd4-cd6d-459d-89cf-9a7e5bc79e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:31:05.212691 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-02da8dd4-cd6d-459d-89cf-9a7e5bc79e2a None None] MFA Rules not processed for user `066750f0db754834aa2984c2cfd40e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:31:05.213885 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-02da8dd4-cd6d-459d-89cf-9a7e5bc79e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:31:05.266213 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1391/2790] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:31:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:31:10.623675 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67a103-c972-4ecd-b69e-c8ffd5930a02 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:31:10.625163 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7b67a103-c972-4ecd-b69e-c8ffd5930a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:31:10.681822 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67a103-c972-4ecd-b69e-c8ffd5930a02 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:31:10.686397 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1ea98-9dfc-48da-b504-35fa6410c9e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:31:10.687071 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1ea98-9dfc-48da-b504-35fa6410c9e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:31:10.687358 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1ea98-9dfc-48da-b504-35fa6410c9e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:31:10.687644 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1ea98-9dfc-48da-b504-35fa6410c9e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:31:10.689796 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cba1ea98-9dfc-48da-b504-35fa6410c9e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:31:10.760114 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1ea98-9dfc-48da-b504-35fa6410c9e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:31:10.761573 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1ea98-9dfc-48da-b504-35fa6410c9e2 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:31:10.773710 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1400/2791] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:31:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:31:11.546638 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da8dd4-cd6d-459d-89cf-9a7e5bc79e2a None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:31:11.548030 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-02da8dd4-cd6d-459d-89cf-9a7e5bc79e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:31:11.559847 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da8dd4-cd6d-459d-89cf-9a7e5bc79e2a None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:31:11.563418 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089ac16-ed89-4284-b7ac-9991cc70e760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:31:11.564052 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089ac16-ed89-4284-b7ac-9991cc70e760 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:31:11.564334 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089ac16-ed89-4284-b7ac-9991cc70e760 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:31:11.564640 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089ac16-ed89-4284-b7ac-9991cc70e760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:31:11.566383 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8089ac16-ed89-4284-b7ac-9991cc70e760 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:31:11.579584 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089ac16-ed89-4284-b7ac-9991cc70e760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:31:11.581014 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089ac16-ed89-4284-b7ac-9991cc70e760 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:31:11.592723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1392/2792] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:31:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:32:12.225050 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1ea98-9dfc-48da-b504-35fa6410c9e2 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:32:12.227305 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cba1ea98-9dfc-48da-b504-35fa6410c9e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:32:12.241991 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1ea98-9dfc-48da-b504-35fa6410c9e2 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:32:12.247850 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567ad32-bb25-4a65-8453-5477e459efd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:32:12.248502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567ad32-bb25-4a65-8453-5477e459efd8 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:32:12.248801 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567ad32-bb25-4a65-8453-5477e459efd8 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:32:12.249058 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567ad32-bb25-4a65-8453-5477e459efd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:32:12.251051 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4567ad32-bb25-4a65-8453-5477e459efd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:32:12.266279 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567ad32-bb25-4a65-8453-5477e459efd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:32:12.266279 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567ad32-bb25-4a65-8453-5477e459efd8 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:32:12.290026 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1401/2793] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:32:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:32:17.031760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8656dd7-730b-492a-a66b-983e832503fb None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:32:17.032568 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8656dd7-730b-492a-a66b-983e832503fb None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:32:17.032760 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8656dd7-730b-492a-a66b-983e832503fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:32:17.050146 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-b8656dd7-730b-492a-a66b-983e832503fb None None] MFA Rules not processed for user `066750f0db754834aa2984c2cfd40e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:32:17.053784 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b8656dd7-730b-492a-a66b-983e832503fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:32:17.059106 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1393/2794] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:32:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:32:17.549519 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567ad32-bb25-4a65-8453-5477e459efd8 service nova] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:32:17.558868 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567ad32-bb25-4a65-8453-5477e459efd8 service nova] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:32:17.562534 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61e995-c08a-4e45-a39a-56f2ce367ae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:32:17.563177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61e995-c08a-4e45-a39a-56f2ce367ae2 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:32:17.563462 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61e995-c08a-4e45-a39a-56f2ce367ae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:32:17.563740 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61e995-c08a-4e45-a39a-56f2ce367ae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:32:17.565566 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cb61e995-c08a-4e45-a39a-56f2ce367ae2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:32:17.575437 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61e995-c08a-4e45-a39a-56f2ce367ae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:32:17.576880 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61e995-c08a-4e45-a39a-56f2ce367ae2 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:32:17.584965 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1402/2795] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:32:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:32:17.638015 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8656dd7-730b-492a-a66b-983e832503fb None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:32:17.648081 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8656dd7-730b-492a-a66b-983e832503fb None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:32:17.652114 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5b7bb-29f1-4029-bdcc-5af756b91e83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:32:17.652784 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5b7bb-29f1-4029-bdcc-5af756b91e83 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:32:17.653065 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5b7bb-29f1-4029-bdcc-5af756b91e83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:32:17.653335 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5b7bb-29f1-4029-bdcc-5af756b91e83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:32:17.655168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-bdd5b7bb-29f1-4029-bdcc-5af756b91e83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:32:17.665422 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5b7bb-29f1-4029-bdcc-5af756b91e83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:32:17.667472 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5b7bb-29f1-4029-bdcc-5af756b91e83 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:32:17.677379 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1394/2796] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:32:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:32:18.032852 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61e995-c08a-4e45-a39a-56f2ce367ae2 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:32:18.034243 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cb61e995-c08a-4e45-a39a-56f2ce367ae2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:32:18.104400 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61e995-c08a-4e45-a39a-56f2ce367ae2 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:32:18.109518 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca6b73-bbaa-4d7b-9f14-bab03dc22405 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f231aa78ac84054b06a2126e1a11f31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:32:18.110391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca6b73-bbaa-4d7b-9f14-bab03dc22405 service placement] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:32:18.110678 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca6b73-bbaa-4d7b-9f14-bab03dc22405 service placement] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:32:18.110955 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca6b73-bbaa-4d7b-9f14-bab03dc22405 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:32:18.112735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-eaca6b73-bbaa-4d7b-9f14-bab03dc22405 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:32:18.124702 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca6b73-bbaa-4d7b-9f14-bab03dc22405 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:32:18.126422 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca6b73-bbaa-4d7b-9f14-bab03dc22405 service placement] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:32:18.137052 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1403/2797] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:32:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:32:29.536168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5b7bb-29f1-4029-bdcc-5af756b91e83 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:32:29.550171 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5b7bb-29f1-4029-bdcc-5af756b91e83 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:32:29.555842 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7c2c6-ba3a-4e89-a2ba-9e6823df6144 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:32:29.556517 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7c2c6-ba3a-4e89-a2ba-9e6823df6144 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:32:29.556800 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7c2c6-ba3a-4e89-a2ba-9e6823df6144 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:32:29.557083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7c2c6-ba3a-4e89-a2ba-9e6823df6144 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:32:29.558916 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-98e7c2c6-ba3a-4e89-a2ba-9e6823df6144 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:32:29.571664 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7c2c6-ba3a-4e89-a2ba-9e6823df6144 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:32:29.573269 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7c2c6-ba3a-4e89-a2ba-9e6823df6144 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:32:29.584180 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1395/2798] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:32:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:33:03.657758 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca6b73-bbaa-4d7b-9f14-bab03dc22405 service placement] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:03.659169 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-eaca6b73-bbaa-4d7b-9f14-bab03dc22405 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:03.724820 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca6b73-bbaa-4d7b-9f14-bab03dc22405 service placement] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:03.728373 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c333b63-91df-468c-9da5-13ca71149904 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:03.729003 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c333b63-91df-468c-9da5-13ca71149904 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:03.729287 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c333b63-91df-468c-9da5-13ca71149904 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:03.729562 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c333b63-91df-468c-9da5-13ca71149904 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:03.731313 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8c333b63-91df-468c-9da5-13ca71149904 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:03.754808 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c333b63-91df-468c-9da5-13ca71149904 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:03.756254 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c333b63-91df-468c-9da5-13ca71149904 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:03.764990 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1404/2799] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:33:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:33:12.183078 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8cd9c-152c-4e8c-afc3-839acceab9a4 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:12.183661 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8cd9c-152c-4e8c-afc3-839acceab9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:12.183661 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8cd9c-152c-4e8c-afc3-839acceab9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:12.201099 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-5de8cd9c-152c-4e8c-afc3-839acceab9a4 None None] MFA Rules not processed for user `e916a70861fc44e69160faf793999f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:33:12.204081 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-5de8cd9c-152c-4e8c-afc3-839acceab9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:12.209815 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1396/2800] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:33:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:33:16.528016 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c333b63-91df-468c-9da5-13ca71149904 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:16.557446 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c333b63-91df-468c-9da5-13ca71149904 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:16.561748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074de349-3c2f-45dc-ba50-aed3d023babe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:16.562745 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074de349-3c2f-45dc-ba50-aed3d023babe service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:16.563117 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074de349-3c2f-45dc-ba50-aed3d023babe service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:16.563473 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074de349-3c2f-45dc-ba50-aed3d023babe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:16.567175 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-074de349-3c2f-45dc-ba50-aed3d023babe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:16.583080 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074de349-3c2f-45dc-ba50-aed3d023babe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:16.584571 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074de349-3c2f-45dc-ba50-aed3d023babe service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:16.597029 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1405/2801] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:33:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:33:28.299876 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8cd9c-152c-4e8c-afc3-839acceab9a4 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:28.321193 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8cd9c-152c-4e8c-afc3-839acceab9a4 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:28.326712 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390a01b-ac20-44c3-8044-c60c1709a440 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d85024f010c40129d79543b3ec4cfae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:28.327362 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390a01b-ac20-44c3-8044-c60c1709a440 service nova] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:28.327619 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390a01b-ac20-44c3-8044-c60c1709a440 service nova] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:28.327903 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390a01b-ac20-44c3-8044-c60c1709a440 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:28.329700 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e390a01b-ac20-44c3-8044-c60c1709a440 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:28.352471 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390a01b-ac20-44c3-8044-c60c1709a440 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:28.354073 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390a01b-ac20-44c3-8044-c60c1709a440 service nova] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:28.365158 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1397/2802] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:33:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:33:31.447539 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074de349-3c2f-45dc-ba50-aed3d023babe service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:31.473519 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074de349-3c2f-45dc-ba50-aed3d023babe service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:31.477223 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f764661-af92-4236-b386-aa83a05a56ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:31.477868 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f764661-af92-4236-b386-aa83a05a56ea service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:31.478174 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f764661-af92-4236-b386-aa83a05a56ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:31.478457 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f764661-af92-4236-b386-aa83a05a56ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:31.480284 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9f764661-af92-4236-b386-aa83a05a56ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:31.571223 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f764661-af92-4236-b386-aa83a05a56ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:31.572715 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f764661-af92-4236-b386-aa83a05a56ea service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:31.593052 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1406/2803] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:33:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:33:35.522699 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390a01b-ac20-44c3-8044-c60c1709a440 service nova] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:35.524999 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-e390a01b-ac20-44c3-8044-c60c1709a440 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:35.539060 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390a01b-ac20-44c3-8044-c60c1709a440 service nova] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:35.543661 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d0eb6-725c-4de0-8ccc-cdb063ff8819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:35.544555 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d0eb6-725c-4de0-8ccc-cdb063ff8819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:35.544840 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d0eb6-725c-4de0-8ccc-cdb063ff8819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:35.545116 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d0eb6-725c-4de0-8ccc-cdb063ff8819 admin admin] PATH_INFO: `/v3/users/066750f0db754834aa2984c2cfd40e9f` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:35.546330 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d0eb6-725c-4de0-8ccc-cdb063ff8819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=066750f0db754834aa2984c2cfd40e9f)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:35.548254 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d0eb6-725c-4de0-8ccc-cdb063ff8819 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:35.820609 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-fc8d0eb6-725c-4de0-8ccc-cdb063ff8819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '066750f0db754834aa2984c2cfd40e9f'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:35.898665 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-fc8d0eb6-725c-4de0-8ccc-cdb063ff8819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '066750f0db754834aa2984c2cfd40e9f'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:35.899296 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-fc8d0eb6-725c-4de0-8ccc-cdb063ff8819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '066750f0db754834aa2984c2cfd40e9f'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:35.913593 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-fc8d0eb6-725c-4de0-8ccc-cdb063ff8819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '066750f0db754834aa2984c2cfd40e9f'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:35.913593 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-fc8d0eb6-725c-4de0-8ccc-cdb063ff8819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '066750f0db754834aa2984c2cfd40e9f'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:35.924561 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1398/2804] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:33:35 2022] DELETE /identity/v3/users/066750f0db754834aa2984c2cfd40e9f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:33:36.175672 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f764661-af92-4236-b386-aa83a05a56ea service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:36.187518 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f764661-af92-4236-b386-aa83a05a56ea service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:36.246013 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea2645-1ac1-42e2-ae45-f1fcff6301ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:36.246906 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea2645-1ac1-42e2-ae45-f1fcff6301ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:36.247191 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea2645-1ac1-42e2-ae45-f1fcff6301ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:36.247468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea2645-1ac1-42e2-ae45-f1fcff6301ec admin admin] PATH_INFO: `/v3/projects/fbaba74aca3d447eb9cc9d56700fa13e` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:36.248639 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea2645-1ac1-42e2-ae45-f1fcff6301ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbaba74aca3d447eb9cc9d56700fa13e)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:36.250602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea2645-1ac1-42e2-ae45-f1fcff6301ec admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:36.344092 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5cea2645-1ac1-42e2-ae45-f1fcff6301ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbaba74aca3d447eb9cc9d56700fa13e', 'request_id': 'req-5cea2645-1ac1-42e2-ae45-f1fcff6301ec'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:36.350723 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5cea2645-1ac1-42e2-ae45-f1fcff6301ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbaba74aca3d447eb9cc9d56700fa13e', 'request_id': 'req-5cea2645-1ac1-42e2-ae45-f1fcff6301ec'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:36.401336 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5cea2645-1ac1-42e2-ae45-f1fcff6301ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbaba74aca3d447eb9cc9d56700fa13e', 'request_id': 'req-5cea2645-1ac1-42e2-ae45-f1fcff6301ec'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:36.412239 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5cea2645-1ac1-42e2-ae45-f1fcff6301ec admin admin] The token cache is being invalidate because project fbaba74aca3d447eb9cc9d56700fa13e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:33:36.412576 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5cea2645-1ac1-42e2-ae45-f1fcff6301ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:36.413187 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5cea2645-1ac1-42e2-ae45-f1fcff6301ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:36.414785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1407/2805] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:33:36 2022] DELETE /identity/v3/projects/fbaba74aca3d447eb9cc9d56700fa13e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:33:36.420857 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998260ef-e70c-4ed4-a951-3d0b3472cc95 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:36.421093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998260ef-e70c-4ed4-a951-3d0b3472cc95 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:36.421377 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998260ef-e70c-4ed4-a951-3d0b3472cc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:36.476367 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-998260ef-e70c-4ed4-a951-3d0b3472cc95 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:33:36.477565 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-998260ef-e70c-4ed4-a951-3d0b3472cc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:36.533318 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1399/2806] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:33:36.541879 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29d11d-6f26-4f10-84ec-f9a30340995c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:36.542265 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29d11d-6f26-4f10-84ec-f9a30340995c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:36.542555 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29d11d-6f26-4f10-84ec-f9a30340995c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:36.560460 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-5c29d11d-6f26-4f10-84ec-f9a30340995c None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:33:36.561654 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5c29d11d-6f26-4f10-84ec-f9a30340995c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:36.569894 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1408/2807] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:33:36.574914 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998260ef-e70c-4ed4-a951-3d0b3472cc95 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:36.585423 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998260ef-e70c-4ed4-a951-3d0b3472cc95 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:36.590208 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523aab5-6a9c-4002-998d-e4b84e1b01f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:36.590874 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523aab5-6a9c-4002-998d-e4b84e1b01f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:36.591160 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523aab5-6a9c-4002-998d-e4b84e1b01f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:36.591437 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523aab5-6a9c-4002-998d-e4b84e1b01f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:36.592168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523aab5-6a9c-4002-998d-e4b84e1b01f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:33:36.592474 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523aab5-6a9c-4002-998d-e4b84e1b01f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:36.594085 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523aab5-6a9c-4002-998d-e4b84e1b01f5 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:36.606366 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1400/2808] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:33:36.610611 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29d11d-6f26-4f10-84ec-f9a30340995c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:36.620619 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29d11d-6f26-4f10-84ec-f9a30340995c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:36.625239 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180ddaf-1fd8-4712-b53c-24753017db68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:36.625881 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180ddaf-1fd8-4712-b53c-24753017db68 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:36.626197 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180ddaf-1fd8-4712-b53c-24753017db68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:36.626473 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180ddaf-1fd8-4712-b53c-24753017db68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:36.627166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180ddaf-1fd8-4712-b53c-24753017db68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:36.629058 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180ddaf-1fd8-4712-b53c-24753017db68 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:36.705445 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1409/2809] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:33:36 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:33:36.709456 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523aab5-6a9c-4002-998d-e4b84e1b01f5 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:36.719403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523aab5-6a9c-4002-998d-e4b84e1b01f5 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:36.774240 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74605e-0e58-4c3f-8704-5600dfa02968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:36.774903 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74605e-0e58-4c3f-8704-5600dfa02968 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:36.775186 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74605e-0e58-4c3f-8704-5600dfa02968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:36.775461 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74605e-0e58-4c3f-8704-5600dfa02968 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:36.776136 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74605e-0e58-4c3f-8704-5600dfa02968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:36.778048 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74605e-0e58-4c3f-8704-5600dfa02968 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:36.881897 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1401/2810] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:33:36 2022] POST /identity/v3/users => generated 284 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:33:36.886430 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180ddaf-1fd8-4712-b53c-24753017db68 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:36.899187 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180ddaf-1fd8-4712-b53c-24753017db68 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:36.903862 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db685dfa-6d7b-4098-b78d-4756fd0e4776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:36.904548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db685dfa-6d7b-4098-b78d-4756fd0e4776 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:36.904822 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db685dfa-6d7b-4098-b78d-4756fd0e4776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:36.905094 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db685dfa-6d7b-4098-b78d-4756fd0e4776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:36.905817 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db685dfa-6d7b-4098-b78d-4756fd0e4776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:36.907490 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db685dfa-6d7b-4098-b78d-4756fd0e4776 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:36.918294 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1410/2811] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:33:36.922340 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74605e-0e58-4c3f-8704-5600dfa02968 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:36.932899 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74605e-0e58-4c3f-8704-5600dfa02968 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:36.937473 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba56e6-7079-4743-9f40-e88d919ac3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:36.938120 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba56e6-7079-4743-9f40-e88d919ac3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:36.938438 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba56e6-7079-4743-9f40-e88d919ac3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:36.938713 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba56e6-7079-4743-9f40-e88d919ac3b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:36.939461 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba56e6-7079-4743-9f40-e88d919ac3b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:36.941044 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba56e6-7079-4743-9f40-e88d919ac3b1 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:36.951392 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1402/2812] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:33:36.955257 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db685dfa-6d7b-4098-b78d-4756fd0e4776 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:36.964975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db685dfa-6d7b-4098-b78d-4756fd0e4776 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:36.969541 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3e863-c805-47c7-b045-4440e5079895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:36.970438 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3e863-c805-47c7-b045-4440e5079895 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:36.970719 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3e863-c805-47c7-b045-4440e5079895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:36.970995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3e863-c805-47c7-b045-4440e5079895 admin admin] PATH_INFO: `/v3/projects/fe13cacd1e324474a256c67d7bd3fd84/users/1a834aa06853499093f5a5c58fdd6ff3/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:36.985556 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3e863-c805-47c7-b045-4440e5079895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe13cacd1e324474a256c67d7bd3fd84, user_id=1a834aa06853499093f5a5c58fdd6ff3, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:36.988243 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3e863-c805-47c7-b045-4440e5079895 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:37.081058 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1411/2813] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:33:36 2022] PUT /identity/v3/projects/fe13cacd1e324474a256c67d7bd3fd84/users/1a834aa06853499093f5a5c58fdd6ff3/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:33:37.092272 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92025dcd-f801-48f6-bca9-548811a3b9be None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:37.092624 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92025dcd-f801-48f6-bca9-548811a3b9be None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:37.092905 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92025dcd-f801-48f6-bca9-548811a3b9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:37.120134 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-92025dcd-f801-48f6-bca9-548811a3b9be None None] MFA Rules not processed for user `1a834aa06853499093f5a5c58fdd6ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:33:37.121342 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-92025dcd-f801-48f6-bca9-548811a3b9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:37.188166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1403/2814] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:33:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:33:37.193468 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3e863-c805-47c7-b045-4440e5079895 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:37.253785 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3e863-c805-47c7-b045-4440e5079895 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:37.258417 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74732d96-7713-460f-8eae-96ce4e76de8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:37.259069 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74732d96-7713-460f-8eae-96ce4e76de8d admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:37.259351 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74732d96-7713-460f-8eae-96ce4e76de8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:37.259633 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74732d96-7713-460f-8eae-96ce4e76de8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:37.260316 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74732d96-7713-460f-8eae-96ce4e76de8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:37.262260 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74732d96-7713-460f-8eae-96ce4e76de8d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:37.356959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1412/2815] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:33:37 2022] POST /identity/v3/projects => generated 365 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:33:37.360917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92025dcd-f801-48f6-bca9-548811a3b9be None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:37.371652 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92025dcd-f801-48f6-bca9-548811a3b9be None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:37.426799 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786affd-a0df-4679-9369-143108b51bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:37.427468 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786affd-a0df-4679-9369-143108b51bfa admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:37.427750 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786affd-a0df-4679-9369-143108b51bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:37.428023 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786affd-a0df-4679-9369-143108b51bfa admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:37.428715 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786affd-a0df-4679-9369-143108b51bfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:37.430654 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786affd-a0df-4679-9369-143108b51bfa admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:37.538873 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1404/2816] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:33:37 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:33:37.542963 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74732d96-7713-460f-8eae-96ce4e76de8d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:37.553223 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74732d96-7713-460f-8eae-96ce4e76de8d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:37.557997 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a8126-9e55-4a9c-bffa-a23fcf691384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:37.558686 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a8126-9e55-4a9c-bffa-a23fcf691384 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:37.558972 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a8126-9e55-4a9c-bffa-a23fcf691384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:37.559248 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a8126-9e55-4a9c-bffa-a23fcf691384 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:37.560016 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a8126-9e55-4a9c-bffa-a23fcf691384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:37.561627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a8126-9e55-4a9c-bffa-a23fcf691384 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:37.572735 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1413/2817] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:33:37.576878 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786affd-a0df-4679-9369-143108b51bfa admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:37.587549 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786affd-a0df-4679-9369-143108b51bfa admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:37.592221 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e580be6-2537-4ec7-93a7-dc3aab968070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:37.593093 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e580be6-2537-4ec7-93a7-dc3aab968070 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:37.593372 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e580be6-2537-4ec7-93a7-dc3aab968070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:37.593645 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e580be6-2537-4ec7-93a7-dc3aab968070 admin admin] PATH_INFO: `/v3/projects/ba9b9e8acf184fcab6836dd0245722c9/users/b1af7e939bf146f299aac89883d8b8bd/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:37.608135 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e580be6-2537-4ec7-93a7-dc3aab968070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba9b9e8acf184fcab6836dd0245722c9, user_id=b1af7e939bf146f299aac89883d8b8bd, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:37.610833 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e580be6-2537-4ec7-93a7-dc3aab968070 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:37.658391 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1405/2818] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:33:37 2022] PUT /identity/v3/projects/ba9b9e8acf184fcab6836dd0245722c9/users/b1af7e939bf146f299aac89883d8b8bd/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:33:37.662279 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a8126-9e55-4a9c-bffa-a23fcf691384 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:37.672384 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a8126-9e55-4a9c-bffa-a23fcf691384 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:37.726521 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2518b-c87a-435e-9693-af25d0b06e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:37.727173 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2518b-c87a-435e-9693-af25d0b06e18 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:37.727458 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2518b-c87a-435e-9693-af25d0b06e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:37.727754 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2518b-c87a-435e-9693-af25d0b06e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:37.728458 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a2518b-c87a-435e-9693-af25d0b06e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:37.730059 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a2518b-c87a-435e-9693-af25d0b06e18 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:37.739381 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1414/2819] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:33:37.743357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e580be6-2537-4ec7-93a7-dc3aab968070 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:37.753435 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e580be6-2537-4ec7-93a7-dc3aab968070 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:37.758657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8e976-9fd5-4d35-8771-fd7ab3cd8533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:37.759527 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8e976-9fd5-4d35-8771-fd7ab3cd8533 admin admin] REQUEST_METHOD: `PUT` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:37.759810 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8e976-9fd5-4d35-8771-fd7ab3cd8533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:37.760086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8e976-9fd5-4d35-8771-fd7ab3cd8533 admin admin] PATH_INFO: `/v3/projects/ba9b9e8acf184fcab6836dd0245722c9/users/b1af7e939bf146f299aac89883d8b8bd/roles/f6c8fc0dc0f24de3907b0960a1201901` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:37.762039 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8e976-9fd5-4d35-8771-fd7ab3cd8533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba9b9e8acf184fcab6836dd0245722c9, user_id=b1af7e939bf146f299aac89883d8b8bd, role_id=f6c8fc0dc0f24de3907b0960a1201901)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:37.764720 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8e976-9fd5-4d35-8771-fd7ab3cd8533 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:37.775489 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1406/2820] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:33:37 2022] PUT /identity/v3/projects/ba9b9e8acf184fcab6836dd0245722c9/users/b1af7e939bf146f299aac89883d8b8bd/roles/f6c8fc0dc0f24de3907b0960a1201901 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:33:37.785166 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b7261-7cf5-412b-b438-673f9675da3b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:37.785463 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b7261-7cf5-412b-b438-673f9675da3b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:37.785791 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b7261-7cf5-412b-b438-673f9675da3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:37.811149 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-452b7261-7cf5-412b-b438-673f9675da3b None None] MFA Rules not processed for user `b1af7e939bf146f299aac89883d8b8bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:33:37.812287 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-452b7261-7cf5-412b-b438-673f9675da3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:37.879327 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1415/2821] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:33:37 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:33:37.891280 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8e976-9fd5-4d35-8771-fd7ab3cd8533 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:37.892971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-a4f8e976-9fd5-4d35-8771-fd7ab3cd8533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:37.948071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8e976-9fd5-4d35-8771-fd7ab3cd8533 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:37.951723 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a60005-d6e3-4008-a6f6-85c3abc98e7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:37.952357 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a60005-d6e3-4008-a6f6-85c3abc98e7a service cinder] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:37.952636 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a60005-d6e3-4008-a6f6-85c3abc98e7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:37.952909 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a60005-d6e3-4008-a6f6-85c3abc98e7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:37.961521 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a60005-d6e3-4008-a6f6-85c3abc98e7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:37.962976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a60005-d6e3-4008-a6f6-85c3abc98e7a service cinder] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:37.972072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1407/2822] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:33:37 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:33:38.160241 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b7261-7cf5-412b-b438-673f9675da3b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:38.169921 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b7261-7cf5-412b-b438-673f9675da3b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:38.173564 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413052a-7576-4b33-a938-16ed375af86e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:38.174225 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413052a-7576-4b33-a938-16ed375af86e service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:38.174518 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413052a-7576-4b33-a938-16ed375af86e service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:38.174792 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413052a-7576-4b33-a938-16ed375af86e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:38.237278 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413052a-7576-4b33-a938-16ed375af86e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:38.238772 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413052a-7576-4b33-a938-16ed375af86e service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:38.248192 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1416/2823] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:33:38 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:33:44.500832 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a60005-d6e3-4008-a6f6-85c3abc98e7a service cinder] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:44.565522 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a60005-d6e3-4008-a6f6-85c3abc98e7a service cinder] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:44.570666 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71210027-1c97-4382-b86a-adaa20f55bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:44.571538 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71210027-1c97-4382-b86a-adaa20f55bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:44.571813 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71210027-1c97-4382-b86a-adaa20f55bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:44.572086 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71210027-1c97-4382-b86a-adaa20f55bee admin admin] PATH_INFO: `/v3/users/1a834aa06853499093f5a5c58fdd6ff3` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:44.573369 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71210027-1c97-4382-b86a-adaa20f55bee admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a834aa06853499093f5a5c58fdd6ff3)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:44.575413 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71210027-1c97-4382-b86a-adaa20f55bee admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:44.774759 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-71210027-1c97-4382-b86a-adaa20f55bee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a834aa06853499093f5a5c58fdd6ff3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:44.858810 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-71210027-1c97-4382-b86a-adaa20f55bee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a834aa06853499093f5a5c58fdd6ff3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:44.859433 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-71210027-1c97-4382-b86a-adaa20f55bee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a834aa06853499093f5a5c58fdd6ff3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:44.871794 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-71210027-1c97-4382-b86a-adaa20f55bee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a834aa06853499093f5a5c58fdd6ff3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:44.872464 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-71210027-1c97-4382-b86a-adaa20f55bee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a834aa06853499093f5a5c58fdd6ff3'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:44.884360 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1408/2824] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:33:44 2022] DELETE /identity/v3/users/1a834aa06853499093f5a5c58fdd6ff3 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:33:44.888870 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d6b59-689e-449f-badb-f48eac40370a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:44.889424 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d6b59-689e-449f-badb-f48eac40370a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:44.889424 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d6b59-689e-449f-badb-f48eac40370a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:44.907067 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-337d6b59-689e-449f-badb-f48eac40370a None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:33:44.908265 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-337d6b59-689e-449f-badb-f48eac40370a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:44.968297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1417/2825] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:33:44.977959 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71210027-1c97-4382-b86a-adaa20f55bee admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:44.979377 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-71210027-1c97-4382-b86a-adaa20f55bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:45.046813 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71210027-1c97-4382-b86a-adaa20f55bee admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:45.050429 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd3d26-119d-4c51-acda-b595e80d17c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:45.051074 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd3d26-119d-4c51-acda-b595e80d17c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:45.051356 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd3d26-119d-4c51-acda-b595e80d17c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:45.051631 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd3d26-119d-4c51-acda-b595e80d17c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:45.060513 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd3d26-119d-4c51-acda-b595e80d17c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:45.061942 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd3d26-119d-4c51-acda-b595e80d17c6 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:45.071764 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1409/2826] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:33:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:33:45.466767 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d6b59-689e-449f-badb-f48eac40370a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:45.468169 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-337d6b59-689e-449f-badb-f48eac40370a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:45.482684 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d6b59-689e-449f-badb-f48eac40370a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:45.488029 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bd7b1-9963-4942-831c-09b419d54c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:45.489034 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bd7b1-9963-4942-831c-09b419d54c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:45.489154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bd7b1-9963-4942-831c-09b419d54c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:45.489423 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bd7b1-9963-4942-831c-09b419d54c93 admin admin] PATH_INFO: `/v3/projects/fe13cacd1e324474a256c67d7bd3fd84` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:45.490803 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bd7b1-9963-4942-831c-09b419d54c93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe13cacd1e324474a256c67d7bd3fd84)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:45.492661 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bd7b1-9963-4942-831c-09b419d54c93 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:45.613416 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-971bd7b1-9963-4942-831c-09b419d54c93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe13cacd1e324474a256c67d7bd3fd84', 'request_id': 'req-971bd7b1-9963-4942-831c-09b419d54c93'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:45.619878 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-971bd7b1-9963-4942-831c-09b419d54c93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe13cacd1e324474a256c67d7bd3fd84', 'request_id': 'req-971bd7b1-9963-4942-831c-09b419d54c93'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:45.702515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-971bd7b1-9963-4942-831c-09b419d54c93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe13cacd1e324474a256c67d7bd3fd84', 'request_id': 'req-971bd7b1-9963-4942-831c-09b419d54c93'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:45.712841 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-971bd7b1-9963-4942-831c-09b419d54c93 admin admin] The token cache is being invalidate because project fe13cacd1e324474a256c67d7bd3fd84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:33:45.713124 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-971bd7b1-9963-4942-831c-09b419d54c93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:45.713745 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-971bd7b1-9963-4942-831c-09b419d54c93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:45.715320 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1418/2827] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:33:45 2022] DELETE /identity/v3/projects/fe13cacd1e324474a256c67d7bd3fd84 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:33:45.719396 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd3d26-119d-4c51-acda-b595e80d17c6 service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:45.729297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd3d26-119d-4c51-acda-b595e80d17c6 service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:45.783833 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb521b-0892-4d1c-957e-4cdda3997afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:45.784707 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb521b-0892-4d1c-957e-4cdda3997afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:45.784986 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb521b-0892-4d1c-957e-4cdda3997afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:45.785261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb521b-0892-4d1c-957e-4cdda3997afa admin admin] PATH_INFO: `/v3/users/b1af7e939bf146f299aac89883d8b8bd` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:45.786994 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb521b-0892-4d1c-957e-4cdda3997afa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1af7e939bf146f299aac89883d8b8bd)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:45.788976 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb521b-0892-4d1c-957e-4cdda3997afa admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:45.981166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2acb521b-0892-4d1c-957e-4cdda3997afa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1af7e939bf146f299aac89883d8b8bd'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:46.058530 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2acb521b-0892-4d1c-957e-4cdda3997afa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1af7e939bf146f299aac89883d8b8bd'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:46.059461 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2acb521b-0892-4d1c-957e-4cdda3997afa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1af7e939bf146f299aac89883d8b8bd'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:46.071120 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2acb521b-0892-4d1c-957e-4cdda3997afa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1af7e939bf146f299aac89883d8b8bd'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:46.071748 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2acb521b-0892-4d1c-957e-4cdda3997afa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1af7e939bf146f299aac89883d8b8bd'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:46.083913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1410/2828] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:33:45 2022] DELETE /identity/v3/users/b1af7e939bf146f299aac89883d8b8bd => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:33:46.482979 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bd7b1-9963-4942-831c-09b419d54c93 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:46.484507 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-971bd7b1-9963-4942-831c-09b419d54c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:46.497935 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bd7b1-9963-4942-831c-09b419d54c93 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:46.554094 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9986b-4d73-4062-8b19-091303653697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:46.555049 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9986b-4d73-4062-8b19-091303653697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:46.555341 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9986b-4d73-4062-8b19-091303653697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:46.555627 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9986b-4d73-4062-8b19-091303653697 admin admin] PATH_INFO: `/v3/projects/ba9b9e8acf184fcab6836dd0245722c9` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:46.556803 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9986b-4d73-4062-8b19-091303653697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba9b9e8acf184fcab6836dd0245722c9)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:46.558777 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9986b-4d73-4062-8b19-091303653697 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:46.665206 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9cf9986b-4d73-4062-8b19-091303653697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba9b9e8acf184fcab6836dd0245722c9', 'request_id': 'req-9cf9986b-4d73-4062-8b19-091303653697'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:46.671311 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9cf9986b-4d73-4062-8b19-091303653697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba9b9e8acf184fcab6836dd0245722c9', 'request_id': 'req-9cf9986b-4d73-4062-8b19-091303653697'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:46.738295 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9cf9986b-4d73-4062-8b19-091303653697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba9b9e8acf184fcab6836dd0245722c9', 'request_id': 'req-9cf9986b-4d73-4062-8b19-091303653697'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:46.749423 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9cf9986b-4d73-4062-8b19-091303653697 admin admin] The token cache is being invalidate because project ba9b9e8acf184fcab6836dd0245722c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:33:46.749653 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9cf9986b-4d73-4062-8b19-091303653697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:46.750404 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9cf9986b-4d73-4062-8b19-091303653697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:46.752047 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1419/2829] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:33:46 2022] DELETE /identity/v3/projects/ba9b9e8acf184fcab6836dd0245722c9 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:33:46.756971 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50144f-5eee-4bba-ab82-18cc00194ab0 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:46.757461 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50144f-5eee-4bba-ab82-18cc00194ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:46.757669 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50144f-5eee-4bba-ab82-18cc00194ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:46.775852 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-df50144f-5eee-4bba-ab82-18cc00194ab0 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:33:46.777047 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-df50144f-5eee-4bba-ab82-18cc00194ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:46.834638 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1411/2830] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:33:46.842107 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a95d9-9f75-44f4-827c-35e6d04ddf2a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:46.842428 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a95d9-9f75-44f4-827c-35e6d04ddf2a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:46.844373 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a95d9-9f75-44f4-827c-35e6d04ddf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:46.861741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c88a95d9-9f75-44f4-827c-35e6d04ddf2a None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:33:46.867355 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c88a95d9-9f75-44f4-827c-35e6d04ddf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:46.873673 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1420/2831] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:33:46.877905 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50144f-5eee-4bba-ab82-18cc00194ab0 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:46.887975 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50144f-5eee-4bba-ab82-18cc00194ab0 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:46.892642 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f8552-de7f-46e6-8d30-853acdf2cbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:46.893299 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f8552-de7f-46e6-8d30-853acdf2cbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:46.893587 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f8552-de7f-46e6-8d30-853acdf2cbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:46.893867 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f8552-de7f-46e6-8d30-853acdf2cbe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:46.894635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f8552-de7f-46e6-8d30-853acdf2cbe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:33:46.894945 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f8552-de7f-46e6-8d30-853acdf2cbe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:46.897061 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f8552-de7f-46e6-8d30-853acdf2cbe7 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:46.908962 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1412/2832] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:33:46.913929 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a95d9-9f75-44f4-827c-35e6d04ddf2a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:46.923235 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a95d9-9f75-44f4-827c-35e6d04ddf2a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:46.928459 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5517c15-710e-4569-ae8c-dbf93fa3f98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:46.929107 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5517c15-710e-4569-ae8c-dbf93fa3f98c admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:46.929389 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5517c15-710e-4569-ae8c-dbf93fa3f98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:46.929669 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5517c15-710e-4569-ae8c-dbf93fa3f98c admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:46.930405 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5517c15-710e-4569-ae8c-dbf93fa3f98c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:46.932376 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5517c15-710e-4569-ae8c-dbf93fa3f98c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:47.013787 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1421/2833] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:33:46 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:33:47.017961 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f8552-de7f-46e6-8d30-853acdf2cbe7 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:47.028775 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f8552-de7f-46e6-8d30-853acdf2cbe7 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:47.084261 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2b6e9-c81a-49ec-b813-d0dcb5315353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:47.084923 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2b6e9-c81a-49ec-b813-d0dcb5315353 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:47.085204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2b6e9-c81a-49ec-b813-d0dcb5315353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:47.085477 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2b6e9-c81a-49ec-b813-d0dcb5315353 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:47.086197 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2b6e9-c81a-49ec-b813-d0dcb5315353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:47.088103 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2b6e9-c81a-49ec-b813-d0dcb5315353 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:47.196270 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1413/2834] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:33:47 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:33:47.200429 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5517c15-710e-4569-ae8c-dbf93fa3f98c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:47.211169 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5517c15-710e-4569-ae8c-dbf93fa3f98c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:47.216192 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54646f-caf8-443a-a0d9-0debcd299ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:47.216864 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54646f-caf8-443a-a0d9-0debcd299ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:47.217173 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54646f-caf8-443a-a0d9-0debcd299ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:47.217460 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54646f-caf8-443a-a0d9-0debcd299ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:47.219488 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54646f-caf8-443a-a0d9-0debcd299ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:47.221116 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54646f-caf8-443a-a0d9-0debcd299ae1 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:47.236211 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1422/2835] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:33:47.241297 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2b6e9-c81a-49ec-b813-d0dcb5315353 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:47.251371 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2b6e9-c81a-49ec-b813-d0dcb5315353 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:47.256388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1414f-ae66-42ce-96b5-0545333a6af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:47.257041 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1414f-ae66-42ce-96b5-0545333a6af4 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:47.257317 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1414f-ae66-42ce-96b5-0545333a6af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:47.257589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1414f-ae66-42ce-96b5-0545333a6af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:47.258399 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1414f-ae66-42ce-96b5-0545333a6af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:47.259980 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1414f-ae66-42ce-96b5-0545333a6af4 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:47.269601 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1414/2836] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:33:47.274413 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54646f-caf8-443a-a0d9-0debcd299ae1 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:47.284354 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54646f-caf8-443a-a0d9-0debcd299ae1 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:47.288995 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9b804-cf6b-4f95-b3aa-452c73d85420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:47.289862 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9b804-cf6b-4f95-b3aa-452c73d85420 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:47.290165 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9b804-cf6b-4f95-b3aa-452c73d85420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:47.290448 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9b804-cf6b-4f95-b3aa-452c73d85420 admin admin] PATH_INFO: `/v3/projects/fd2b3fbc5fc54197a903495173acd67a/users/fe148877b3c84fc5af586aa1869b4410/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:47.304420 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9b804-cf6b-4f95-b3aa-452c73d85420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2b3fbc5fc54197a903495173acd67a, user_id=fe148877b3c84fc5af586aa1869b4410, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:47.307112 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9b804-cf6b-4f95-b3aa-452c73d85420 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:47.378713 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1423/2837] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:33:47 2022] PUT /identity/v3/projects/fd2b3fbc5fc54197a903495173acd67a/users/fe148877b3c84fc5af586aa1869b4410/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:33:47.390895 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddc624-101b-4a21-8291-8ca8e893ee6b None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:47.391180 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddc624-101b-4a21-8291-8ca8e893ee6b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:47.391472 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddc624-101b-4a21-8291-8ca8e893ee6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:47.417703 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-0fddc624-101b-4a21-8291-8ca8e893ee6b None None] MFA Rules not processed for user `fe148877b3c84fc5af586aa1869b4410`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:33:47.418938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-0fddc624-101b-4a21-8291-8ca8e893ee6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:47.479241 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1415/2838] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:33:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:33:47.490084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9b804-cf6b-4f95-b3aa-452c73d85420 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:47.491787 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7ce9b804-cf6b-4f95-b3aa-452c73d85420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:47.566758 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9b804-cf6b-4f95-b3aa-452c73d85420 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:47.571177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824c024-d740-4360-84bb-2dca41ce28e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:47.571834 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824c024-d740-4360-84bb-2dca41ce28e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:47.572122 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824c024-d740-4360-84bb-2dca41ce28e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:47.572400 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824c024-d740-4360-84bb-2dca41ce28e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:47.581074 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824c024-d740-4360-84bb-2dca41ce28e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:47.582588 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824c024-d740-4360-84bb-2dca41ce28e3 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:47.592379 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1424/2839] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:33:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:33:47.611899 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddc624-101b-4a21-8291-8ca8e893ee6b None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:47.672352 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddc624-101b-4a21-8291-8ca8e893ee6b None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:47.676882 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434ec02-6bf3-4054-aa92-98db0d72959c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:47.678279 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434ec02-6bf3-4054-aa92-98db0d72959c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:47.678564 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434ec02-6bf3-4054-aa92-98db0d72959c admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:47.678840 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434ec02-6bf3-4054-aa92-98db0d72959c admin admin] PATH_INFO: `/v3/users/fe148877b3c84fc5af586aa1869b4410` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:47.680025 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434ec02-6bf3-4054-aa92-98db0d72959c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe148877b3c84fc5af586aa1869b4410)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:47.681944 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434ec02-6bf3-4054-aa92-98db0d72959c admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:47.843204 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2434ec02-6bf3-4054-aa92-98db0d72959c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe148877b3c84fc5af586aa1869b4410'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:47.925338 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2434ec02-6bf3-4054-aa92-98db0d72959c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe148877b3c84fc5af586aa1869b4410'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:47.925980 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2434ec02-6bf3-4054-aa92-98db0d72959c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe148877b3c84fc5af586aa1869b4410'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:47.938325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2434ec02-6bf3-4054-aa92-98db0d72959c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe148877b3c84fc5af586aa1869b4410'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:47.938965 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-2434ec02-6bf3-4054-aa92-98db0d72959c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe148877b3c84fc5af586aa1869b4410'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:47.951284 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1416/2840] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:33:47 2022] DELETE /identity/v3/users/fe148877b3c84fc5af586aa1869b4410 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:33:47.955730 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eeac6b-5ad4-4d45-8b0b-1bd51d972a4d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:47.956019 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eeac6b-5ad4-4d45-8b0b-1bd51d972a4d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:47.958047 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eeac6b-5ad4-4d45-8b0b-1bd51d972a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:47.974324 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-d8eeac6b-5ad4-4d45-8b0b-1bd51d972a4d None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:33:47.975520 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d8eeac6b-5ad4-4d45-8b0b-1bd51d972a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:48.031880 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1425/2841] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:33:48.041403 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434ec02-6bf3-4054-aa92-98db0d72959c admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:48.042834 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2434ec02-6bf3-4054-aa92-98db0d72959c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:48.097494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434ec02-6bf3-4054-aa92-98db0d72959c admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:48.101064 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ab433-63b2-4b05-8269-fc6042d41aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:48.101698 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ab433-63b2-4b05-8269-fc6042d41aff service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:48.101978 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ab433-63b2-4b05-8269-fc6042d41aff service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:48.102284 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ab433-63b2-4b05-8269-fc6042d41aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:48.110925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ab433-63b2-4b05-8269-fc6042d41aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:48.112353 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ab433-63b2-4b05-8269-fc6042d41aff service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:48.121421 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1417/2842] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:33:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:33:48.527084 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eeac6b-5ad4-4d45-8b0b-1bd51d972a4d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:48.528687 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d8eeac6b-5ad4-4d45-8b0b-1bd51d972a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:48.543154 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eeac6b-5ad4-4d45-8b0b-1bd51d972a4d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:48.548261 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888e128-9c3e-4bc6-860d-677837c74a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:48.549318 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888e128-9c3e-4bc6-860d-677837c74a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:48.549587 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888e128-9c3e-4bc6-860d-677837c74a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:48.549859 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888e128-9c3e-4bc6-860d-677837c74a53 admin admin] PATH_INFO: `/v3/projects/fd2b3fbc5fc54197a903495173acd67a` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:48.551177 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888e128-9c3e-4bc6-860d-677837c74a53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd2b3fbc5fc54197a903495173acd67a)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:48.553174 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888e128-9c3e-4bc6-860d-677837c74a53 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:48.657314 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5888e128-9c3e-4bc6-860d-677837c74a53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd2b3fbc5fc54197a903495173acd67a', 'request_id': 'req-5888e128-9c3e-4bc6-860d-677837c74a53'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:48.663936 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5888e128-9c3e-4bc6-860d-677837c74a53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd2b3fbc5fc54197a903495173acd67a', 'request_id': 'req-5888e128-9c3e-4bc6-860d-677837c74a53'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:48.738419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5888e128-9c3e-4bc6-860d-677837c74a53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd2b3fbc5fc54197a903495173acd67a', 'request_id': 'req-5888e128-9c3e-4bc6-860d-677837c74a53'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:48.748561 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5888e128-9c3e-4bc6-860d-677837c74a53 admin admin] The token cache is being invalidate because project fd2b3fbc5fc54197a903495173acd67a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:33:48.748883 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5888e128-9c3e-4bc6-860d-677837c74a53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:48.749502 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5888e128-9c3e-4bc6-860d-677837c74a53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:48.751068 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1426/2843] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:33:48 2022] DELETE /identity/v3/projects/fd2b3fbc5fc54197a903495173acd67a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:33:48.756441 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f9833-0183-45ab-80d2-c60601f05b9f None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:48.756807 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f9833-0183-45ab-80d2-c60601f05b9f None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:48.757085 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f9833-0183-45ab-80d2-c60601f05b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:48.775117 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-c96f9833-0183-45ab-80d2-c60601f05b9f None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:33:48.776292 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c96f9833-0183-45ab-80d2-c60601f05b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:48.832849 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1418/2844] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:33:48.840471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5f9c0-e7cd-4147-a06f-d30104ff581a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:48.840779 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5f9c0-e7cd-4147-a06f-d30104ff581a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:48.841056 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5f9c0-e7cd-4147-a06f-d30104ff581a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:48.861114 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-2cf5f9c0-e7cd-4147-a06f-d30104ff581a None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:33:48.863078 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2cf5f9c0-e7cd-4147-a06f-d30104ff581a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:48.872018 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1427/2845] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:33:48.876077 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f9833-0183-45ab-80d2-c60601f05b9f None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:48.896173 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f9833-0183-45ab-80d2-c60601f05b9f None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:48.904222 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2152f7c-975c-41b1-a496-3493f192ecae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:48.908296 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2152f7c-975c-41b1-a496-3493f192ecae admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:48.908296 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2152f7c-975c-41b1-a496-3493f192ecae admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:48.908296 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2152f7c-975c-41b1-a496-3493f192ecae admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:48.908296 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2152f7c-975c-41b1-a496-3493f192ecae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:33:48.908296 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2152f7c-975c-41b1-a496-3493f192ecae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:48.910111 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2152f7c-975c-41b1-a496-3493f192ecae admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:48.925071 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1419/2846] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:33:48.930102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5f9c0-e7cd-4147-a06f-d30104ff581a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:48.939517 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5f9c0-e7cd-4147-a06f-d30104ff581a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:48.944548 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90818b20-2944-4951-9a2e-02bf70eb615a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:48.945201 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90818b20-2944-4951-9a2e-02bf70eb615a admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:48.945485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90818b20-2944-4951-9a2e-02bf70eb615a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:48.945763 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90818b20-2944-4951-9a2e-02bf70eb615a admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:48.946503 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90818b20-2944-4951-9a2e-02bf70eb615a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:48.948493 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90818b20-2944-4951-9a2e-02bf70eb615a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:49.025624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1428/2847] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:33:48 2022] POST /identity/v3/projects => generated 361 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:33:49.029761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2152f7c-975c-41b1-a496-3493f192ecae admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:49.040165 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2152f7c-975c-41b1-a496-3493f192ecae admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:49.094050 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42048382-c817-4195-af92-77b7195b92fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:49.094738 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42048382-c817-4195-af92-77b7195b92fc admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:49.095021 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42048382-c817-4195-af92-77b7195b92fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:49.095296 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42048382-c817-4195-af92-77b7195b92fc admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:49.095972 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42048382-c817-4195-af92-77b7195b92fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:49.097874 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42048382-c817-4195-af92-77b7195b92fc admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:49.201574 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1420/2848] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:33:49 2022] POST /identity/v3/users => generated 281 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:33:49.204962 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90818b20-2944-4951-9a2e-02bf70eb615a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:49.215965 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90818b20-2944-4951-9a2e-02bf70eb615a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:49.226898 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6590e3-9fdd-4c91-9d2b-aaa7022ce10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:49.227572 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6590e3-9fdd-4c91-9d2b-aaa7022ce10f admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:49.227852 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6590e3-9fdd-4c91-9d2b-aaa7022ce10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:49.228121 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6590e3-9fdd-4c91-9d2b-aaa7022ce10f admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:49.228856 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6590e3-9fdd-4c91-9d2b-aaa7022ce10f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:49.230532 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6590e3-9fdd-4c91-9d2b-aaa7022ce10f admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:49.241150 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1429/2849] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:33:49.245288 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42048382-c817-4195-af92-77b7195b92fc admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:49.255013 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42048382-c817-4195-af92-77b7195b92fc admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:49.259796 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4422a0-952a-4c00-a5dd-d36509609ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:49.260447 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4422a0-952a-4c00-a5dd-d36509609ebf admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:49.260728 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4422a0-952a-4c00-a5dd-d36509609ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:49.260999 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4422a0-952a-4c00-a5dd-d36509609ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:49.261743 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4422a0-952a-4c00-a5dd-d36509609ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:49.263365 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4422a0-952a-4c00-a5dd-d36509609ebf admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:49.273936 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1421/2850] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:33:49.277628 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6590e3-9fdd-4c91-9d2b-aaa7022ce10f admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:49.287905 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6590e3-9fdd-4c91-9d2b-aaa7022ce10f admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:49.292460 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59935086-d726-4ec0-8109-c27bd3a26fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:49.293304 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59935086-d726-4ec0-8109-c27bd3a26fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:49.293581 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59935086-d726-4ec0-8109-c27bd3a26fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:49.293848 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59935086-d726-4ec0-8109-c27bd3a26fb4 admin admin] PATH_INFO: `/v3/projects/196d318bbaea4dbfbff444f0eff389d7/users/17829f2dee1b49ff9c0b6471a80cc271/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:49.307774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59935086-d726-4ec0-8109-c27bd3a26fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=196d318bbaea4dbfbff444f0eff389d7, user_id=17829f2dee1b49ff9c0b6471a80cc271, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:49.310501 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59935086-d726-4ec0-8109-c27bd3a26fb4 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:49.378017 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1430/2851] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:33:49 2022] PUT /identity/v3/projects/196d318bbaea4dbfbff444f0eff389d7/users/17829f2dee1b49ff9c0b6471a80cc271/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:33:49.388106 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f58e51-321d-4b33-a6e4-99d191763f41 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:49.388416 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f58e51-321d-4b33-a6e4-99d191763f41 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:49.388687 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f58e51-321d-4b33-a6e4-99d191763f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:49.415973 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-93f58e51-321d-4b33-a6e4-99d191763f41 None None] MFA Rules not processed for user `17829f2dee1b49ff9c0b6471a80cc271`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:33:49.417177 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-93f58e51-321d-4b33-a6e4-99d191763f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:49.476910 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1422/2852] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:33:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:33:49.507357 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59935086-d726-4ec0-8109-c27bd3a26fb4 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:49.509071 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-59935086-d726-4ec0-8109-c27bd3a26fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:49.563647 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59935086-d726-4ec0-8109-c27bd3a26fb4 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:49.567375 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782918a-25c8-47dc-85e4-8d33dc26bf44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:49.568557 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782918a-25c8-47dc-85e4-8d33dc26bf44 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:49.568839 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782918a-25c8-47dc-85e4-8d33dc26bf44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:49.569111 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782918a-25c8-47dc-85e4-8d33dc26bf44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:49.577674 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782918a-25c8-47dc-85e4-8d33dc26bf44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:49.579163 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782918a-25c8-47dc-85e4-8d33dc26bf44 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:49.588811 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1431/2853] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:33:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:33:49.602819 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f58e51-321d-4b33-a6e4-99d191763f41 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:49.664983 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f58e51-321d-4b33-a6e4-99d191763f41 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:49.669562 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28100c-3947-433e-8f7a-6e7f34ee8725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:49.670453 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28100c-3947-433e-8f7a-6e7f34ee8725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:49.670730 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28100c-3947-433e-8f7a-6e7f34ee8725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:49.671003 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28100c-3947-433e-8f7a-6e7f34ee8725 admin admin] PATH_INFO: `/v3/users/17829f2dee1b49ff9c0b6471a80cc271` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:49.672175 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28100c-3947-433e-8f7a-6e7f34ee8725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17829f2dee1b49ff9c0b6471a80cc271)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:49.674105 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28100c-3947-433e-8f7a-6e7f34ee8725 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:49.854875 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-dc28100c-3947-433e-8f7a-6e7f34ee8725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17829f2dee1b49ff9c0b6471a80cc271'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:49.915988 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-dc28100c-3947-433e-8f7a-6e7f34ee8725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17829f2dee1b49ff9c0b6471a80cc271'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:49.916622 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-dc28100c-3947-433e-8f7a-6e7f34ee8725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17829f2dee1b49ff9c0b6471a80cc271'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:49.928655 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-dc28100c-3947-433e-8f7a-6e7f34ee8725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17829f2dee1b49ff9c0b6471a80cc271'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:49.929306 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-dc28100c-3947-433e-8f7a-6e7f34ee8725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17829f2dee1b49ff9c0b6471a80cc271'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:49.941221 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1423/2854] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:33:49 2022] DELETE /identity/v3/users/17829f2dee1b49ff9c0b6471a80cc271 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:33:49.945741 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8589c6-11b1-4a2c-b706-0bde0cecd4f5 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:49.946044 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8589c6-11b1-4a2c-b706-0bde0cecd4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:49.946345 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8589c6-11b1-4a2c-b706-0bde0cecd4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:49.963509 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-fb8589c6-11b1-4a2c-b706-0bde0cecd4f5 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:33:49.964697 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fb8589c6-11b1-4a2c-b706-0bde0cecd4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:50.022115 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1432/2855] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:33:50.031891 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28100c-3947-433e-8f7a-6e7f34ee8725 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:50.033286 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-dc28100c-3947-433e-8f7a-6e7f34ee8725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:50.091643 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28100c-3947-433e-8f7a-6e7f34ee8725 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:50.095295 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bb8a3-b236-4be5-85ed-9bd193ae2cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:50.095938 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bb8a3-b236-4be5-85ed-9bd193ae2cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:50.096219 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bb8a3-b236-4be5-85ed-9bd193ae2cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:50.096496 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bb8a3-b236-4be5-85ed-9bd193ae2cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:50.105339 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31bb8a3-b236-4be5-85ed-9bd193ae2cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:50.106750 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31bb8a3-b236-4be5-85ed-9bd193ae2cd6 service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:50.116478 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1424/2856] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:33:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:33:50.477391 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8589c6-11b1-4a2c-b706-0bde0cecd4f5 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:50.478838 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fb8589c6-11b1-4a2c-b706-0bde0cecd4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:50.492364 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8589c6-11b1-4a2c-b706-0bde0cecd4f5 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:50.497320 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24aae0-d659-4981-b4b0-3c11573f765c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:50.499013 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24aae0-d659-4981-b4b0-3c11573f765c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:50.499297 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24aae0-d659-4981-b4b0-3c11573f765c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:50.499793 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24aae0-d659-4981-b4b0-3c11573f765c admin admin] PATH_INFO: `/v3/projects/196d318bbaea4dbfbff444f0eff389d7` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:50.501088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24aae0-d659-4981-b4b0-3c11573f765c admin admin] RBAC: Authorizing `identity:delete_project(project_id=196d318bbaea4dbfbff444f0eff389d7)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:50.503040 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24aae0-d659-4981-b4b0-3c11573f765c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:50.594810 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ea24aae0-d659-4981-b4b0-3c11573f765c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '196d318bbaea4dbfbff444f0eff389d7', 'request_id': 'req-ea24aae0-d659-4981-b4b0-3c11573f765c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:50.601727 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ea24aae0-d659-4981-b4b0-3c11573f765c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '196d318bbaea4dbfbff444f0eff389d7', 'request_id': 'req-ea24aae0-d659-4981-b4b0-3c11573f765c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:50.670426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ea24aae0-d659-4981-b4b0-3c11573f765c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '196d318bbaea4dbfbff444f0eff389d7', 'request_id': 'req-ea24aae0-d659-4981-b4b0-3c11573f765c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:50.680759 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ea24aae0-d659-4981-b4b0-3c11573f765c admin admin] The token cache is being invalidate because project 196d318bbaea4dbfbff444f0eff389d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:33:50.685106 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ea24aae0-d659-4981-b4b0-3c11573f765c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:50.685106 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ea24aae0-d659-4981-b4b0-3c11573f765c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:50.685106 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1433/2857] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:33:50 2022] DELETE /identity/v3/projects/196d318bbaea4dbfbff444f0eff389d7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:33:50.688048 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301dd6db-7b1f-4c20-a0e3-d4f633d4590b None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:50.688340 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301dd6db-7b1f-4c20-a0e3-d4f633d4590b None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:50.688630 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301dd6db-7b1f-4c20-a0e3-d4f633d4590b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:50.705555 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-301dd6db-7b1f-4c20-a0e3-d4f633d4590b None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:33:50.706779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-301dd6db-7b1f-4c20-a0e3-d4f633d4590b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:50.763247 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1425/2858] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:33:50.772602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45446b-4ca9-4e5a-b8aa-4696b6de9d9a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:50.772895 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45446b-4ca9-4e5a-b8aa-4696b6de9d9a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:50.773179 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45446b-4ca9-4e5a-b8aa-4696b6de9d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:50.792840 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6e45446b-4ca9-4e5a-b8aa-4696b6de9d9a None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:33:50.794031 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6e45446b-4ca9-4e5a-b8aa-4696b6de9d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:50.801830 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1434/2859] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:33:50.805855 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301dd6db-7b1f-4c20-a0e3-d4f633d4590b None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:50.815276 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301dd6db-7b1f-4c20-a0e3-d4f633d4590b None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:50.819717 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763f5bd-360d-4ec2-b726-b9b0fe504bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:50.820354 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763f5bd-360d-4ec2-b726-b9b0fe504bbe admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:50.820631 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763f5bd-360d-4ec2-b726-b9b0fe504bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:50.820901 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763f5bd-360d-4ec2-b726-b9b0fe504bbe admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:50.821615 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763f5bd-360d-4ec2-b726-b9b0fe504bbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:33:50.821914 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763f5bd-360d-4ec2-b726-b9b0fe504bbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:50.823675 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763f5bd-360d-4ec2-b726-b9b0fe504bbe admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:50.835199 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1426/2860] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:33:50.839203 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45446b-4ca9-4e5a-b8aa-4696b6de9d9a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:50.848255 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45446b-4ca9-4e5a-b8aa-4696b6de9d9a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:50.853578 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c94059-bf2d-4f83-8d77-4419e1e952c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:50.854255 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c94059-bf2d-4f83-8d77-4419e1e952c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:50.854541 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c94059-bf2d-4f83-8d77-4419e1e952c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:50.854821 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c94059-bf2d-4f83-8d77-4419e1e952c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:50.855507 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c94059-bf2d-4f83-8d77-4419e1e952c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:50.857519 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c94059-bf2d-4f83-8d77-4419e1e952c2 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:50.934778 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1435/2861] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:33:50 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:33:50.938602 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763f5bd-360d-4ec2-b726-b9b0fe504bbe admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:50.953369 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763f5bd-360d-4ec2-b726-b9b0fe504bbe admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:51.007513 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ace97-1ee9-47f9-9d82-f89856ab4ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:51.008290 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ace97-1ee9-47f9-9d82-f89856ab4ecf admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:51.008573 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ace97-1ee9-47f9-9d82-f89856ab4ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:51.008870 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ace97-1ee9-47f9-9d82-f89856ab4ecf admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:51.009552 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ace97-1ee9-47f9-9d82-f89856ab4ecf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:51.011498 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ace97-1ee9-47f9-9d82-f89856ab4ecf admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:51.085035 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1427/2862] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:33:50 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:33:51.089253 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c94059-bf2d-4f83-8d77-4419e1e952c2 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:51.099433 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c94059-bf2d-4f83-8d77-4419e1e952c2 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:51.104028 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a10ef-e2b6-42b6-bcbf-9ead21572432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:51.104677 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a10ef-e2b6-42b6-bcbf-9ead21572432 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:51.104959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a10ef-e2b6-42b6-bcbf-9ead21572432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:51.105233 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a10ef-e2b6-42b6-bcbf-9ead21572432 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:51.105957 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a10ef-e2b6-42b6-bcbf-9ead21572432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:51.107586 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a10ef-e2b6-42b6-bcbf-9ead21572432 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:51.117624 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1436/2863] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:33:51.121519 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ace97-1ee9-47f9-9d82-f89856ab4ecf admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:51.131590 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ace97-1ee9-47f9-9d82-f89856ab4ecf admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:51.136110 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f459f-f80e-4c6f-be72-1f782c042728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:51.136747 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f459f-f80e-4c6f-be72-1f782c042728 admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:51.137026 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f459f-f80e-4c6f-be72-1f782c042728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:51.137300 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f459f-f80e-4c6f-be72-1f782c042728 admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:51.138014 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f459f-f80e-4c6f-be72-1f782c042728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:51.139627 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f459f-f80e-4c6f-be72-1f782c042728 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:51.149873 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1428/2864] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:33:51.153830 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a10ef-e2b6-42b6-bcbf-9ead21572432 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:51.163431 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a10ef-e2b6-42b6-bcbf-9ead21572432 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:51.168016 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac6892-ef22-48ab-9640-45e34f004e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:51.168864 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac6892-ef22-48ab-9640-45e34f004e52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:51.169144 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac6892-ef22-48ab-9640-45e34f004e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:51.169419 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac6892-ef22-48ab-9640-45e34f004e52 admin admin] PATH_INFO: `/v3/projects/4132c009129f484b9c19469e709ad89a/users/5e5671f8f50a4ed380a97b1c38983cbf/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:51.183257 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac6892-ef22-48ab-9640-45e34f004e52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4132c009129f484b9c19469e709ad89a, user_id=5e5671f8f50a4ed380a97b1c38983cbf, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:51.185949 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac6892-ef22-48ab-9640-45e34f004e52 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:51.246762 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1437/2865] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:33:51 2022] PUT /identity/v3/projects/4132c009129f484b9c19469e709ad89a/users/5e5671f8f50a4ed380a97b1c38983cbf/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:33:51.257504 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418f53c-3acb-4bd3-b502-b88ca628ae28 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:51.257793 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418f53c-3acb-4bd3-b502-b88ca628ae28 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:51.258098 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418f53c-3acb-4bd3-b502-b88ca628ae28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:51.284593 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-9418f53c-3acb-4bd3-b502-b88ca628ae28 None None] MFA Rules not processed for user `5e5671f8f50a4ed380a97b1c38983cbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:33:51.285790 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-9418f53c-3acb-4bd3-b502-b88ca628ae28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:51.346752 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1429/2866] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:33:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:33:51.357565 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac6892-ef22-48ab-9640-45e34f004e52 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:51.359255 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c1ac6892-ef22-48ab-9640-45e34f004e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:51.415807 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac6892-ef22-48ab-9640-45e34f004e52 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:51.419515 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a414b-e1ca-4ce7-be18-154cb9057561 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:51.420155 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a414b-e1ca-4ce7-be18-154cb9057561 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:51.420440 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a414b-e1ca-4ce7-be18-154cb9057561 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:51.420742 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a414b-e1ca-4ce7-be18-154cb9057561 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:51.429073 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a414b-e1ca-4ce7-be18-154cb9057561 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:51.430567 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a414b-e1ca-4ce7-be18-154cb9057561 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:51.439285 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1438/2867] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:33:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:33:54.428569 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418f53c-3acb-4bd3-b502-b88ca628ae28 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:54.488954 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418f53c-3acb-4bd3-b502-b88ca628ae28 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:54.493349 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8232d6-5e2c-4910-b8de-f5b36051bd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:54.494230 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8232d6-5e2c-4910-b8de-f5b36051bd16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:54.494509 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8232d6-5e2c-4910-b8de-f5b36051bd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:54.494779 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8232d6-5e2c-4910-b8de-f5b36051bd16 admin admin] PATH_INFO: `/v3/users/5e5671f8f50a4ed380a97b1c38983cbf` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:54.495934 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8232d6-5e2c-4910-b8de-f5b36051bd16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e5671f8f50a4ed380a97b1c38983cbf)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:54.497827 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8232d6-5e2c-4910-b8de-f5b36051bd16 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:54.700484 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ca8232d6-5e2c-4910-b8de-f5b36051bd16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e5671f8f50a4ed380a97b1c38983cbf'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:54.779018 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ca8232d6-5e2c-4910-b8de-f5b36051bd16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e5671f8f50a4ed380a97b1c38983cbf'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:54.779873 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ca8232d6-5e2c-4910-b8de-f5b36051bd16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e5671f8f50a4ed380a97b1c38983cbf'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:54.792388 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ca8232d6-5e2c-4910-b8de-f5b36051bd16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e5671f8f50a4ed380a97b1c38983cbf'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:54.793016 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-ca8232d6-5e2c-4910-b8de-f5b36051bd16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e5671f8f50a4ed380a97b1c38983cbf'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:54.805105 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1430/2868] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:33:54 2022] DELETE /identity/v3/users/5e5671f8f50a4ed380a97b1c38983cbf => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:33:54.809598 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620a498-1665-4638-b3f6-740b03c60cae None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:54.810077 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620a498-1665-4638-b3f6-740b03c60cae None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:54.810230 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620a498-1665-4638-b3f6-740b03c60cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:54.829362 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-5620a498-1665-4638-b3f6-740b03c60cae None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:33:54.830602 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5620a498-1665-4638-b3f6-740b03c60cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:54.888225 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1439/2869] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:33:54.898726 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8232d6-5e2c-4910-b8de-f5b36051bd16 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:54.900635 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-ca8232d6-5e2c-4910-b8de-f5b36051bd16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:54.957146 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8232d6-5e2c-4910-b8de-f5b36051bd16 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:54.961471 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5aab6-1b49-499f-8f6a-5288b7a5fa1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:54.962111 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5aab6-1b49-499f-8f6a-5288b7a5fa1f service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:54.962422 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5aab6-1b49-499f-8f6a-5288b7a5fa1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:54.962700 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5aab6-1b49-499f-8f6a-5288b7a5fa1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:54.971925 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5aab6-1b49-499f-8f6a-5288b7a5fa1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:54.973354 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5aab6-1b49-499f-8f6a-5288b7a5fa1f service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:54.982854 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1431/2870] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:33:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:33:55.399666 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620a498-1665-4638-b3f6-740b03c60cae None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:55.401142 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5620a498-1665-4638-b3f6-740b03c60cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:55.413481 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620a498-1665-4638-b3f6-740b03c60cae None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:55.418462 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64d94e-47e0-4a78-b91b-fa4c547fe16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:55.419306 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64d94e-47e0-4a78-b91b-fa4c547fe16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:55.419658 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64d94e-47e0-4a78-b91b-fa4c547fe16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:55.419847 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64d94e-47e0-4a78-b91b-fa4c547fe16e admin admin] PATH_INFO: `/v3/projects/4132c009129f484b9c19469e709ad89a` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:55.421043 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64d94e-47e0-4a78-b91b-fa4c547fe16e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4132c009129f484b9c19469e709ad89a)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:55.423060 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64d94e-47e0-4a78-b91b-fa4c547fe16e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:55.549879 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-1a64d94e-47e0-4a78-b91b-fa4c547fe16e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4132c009129f484b9c19469e709ad89a', 'request_id': 'req-1a64d94e-47e0-4a78-b91b-fa4c547fe16e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:55.556033 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-1a64d94e-47e0-4a78-b91b-fa4c547fe16e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4132c009129f484b9c19469e709ad89a', 'request_id': 'req-1a64d94e-47e0-4a78-b91b-fa4c547fe16e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:55.630842 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-1a64d94e-47e0-4a78-b91b-fa4c547fe16e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4132c009129f484b9c19469e709ad89a', 'request_id': 'req-1a64d94e-47e0-4a78-b91b-fa4c547fe16e'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:55.641482 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-1a64d94e-47e0-4a78-b91b-fa4c547fe16e admin admin] The token cache is being invalidate because project 4132c009129f484b9c19469e709ad89a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:33:55.641768 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-1a64d94e-47e0-4a78-b91b-fa4c547fe16e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:55.642420 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-1a64d94e-47e0-4a78-b91b-fa4c547fe16e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:33:55.644073 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1440/2871] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:33:55 2022] DELETE /identity/v3/projects/4132c009129f484b9c19469e709ad89a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:33:55.650002 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1eb004-0f23-4665-84ac-4b8ac375fbbc None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:55.650512 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1eb004-0f23-4665-84ac-4b8ac375fbbc None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:55.650623 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1eb004-0f23-4665-84ac-4b8ac375fbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:55.668419 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-8e1eb004-0f23-4665-84ac-4b8ac375fbbc None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:33:55.669616 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8e1eb004-0f23-4665-84ac-4b8ac375fbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:55.726787 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1432/2872] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:33:55.734600 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933ac60-a878-4c71-90c6-0e8c37d8bbdf None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:55.734888 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933ac60-a878-4c71-90c6-0e8c37d8bbdf None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:55.735167 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933ac60-a878-4c71-90c6-0e8c37d8bbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:55.755642 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1933ac60-a878-4c71-90c6-0e8c37d8bbdf None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:33:55.756869 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1933ac60-a878-4c71-90c6-0e8c37d8bbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:55.765522 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1441/2873] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:33:55.769396 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1eb004-0f23-4665-84ac-4b8ac375fbbc None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:55.779747 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1eb004-0f23-4665-84ac-4b8ac375fbbc None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:55.784375 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ce5d5-c4bd-480a-aa5c-979081db92bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:55.785027 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ce5d5-c4bd-480a-aa5c-979081db92bd admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:55.785311 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ce5d5-c4bd-480a-aa5c-979081db92bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:55.785589 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ce5d5-c4bd-480a-aa5c-979081db92bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:55.786346 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ce5d5-c4bd-480a-aa5c-979081db92bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80320) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:33:55.786657 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ce5d5-c4bd-480a-aa5c-979081db92bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:55.788257 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ce5d5-c4bd-480a-aa5c-979081db92bd admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:55.799732 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1433/2874] 10.222.0.76 () {58 vars in 1152 bytes} [Mon May 16 15:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:33:55.806332 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933ac60-a878-4c71-90c6-0e8c37d8bbdf None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:55.813356 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933ac60-a878-4c71-90c6-0e8c37d8bbdf None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:55.818546 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d910f5-a512-4d23-a057-4c577220928e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:55.819186 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d910f5-a512-4d23-a057-4c577220928e admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:55.819461 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d910f5-a512-4d23-a057-4c577220928e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:55.819732 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d910f5-a512-4d23-a057-4c577220928e admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:55.820410 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d910f5-a512-4d23-a057-4c577220928e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:55.822315 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d910f5-a512-4d23-a057-4c577220928e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:55.923117 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1442/2875] 10.222.0.76 () {60 vars in 1152 bytes} [Mon May 16 15:33:55 2022] POST /identity/v3/projects => generated 397 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:33:55.927168 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ce5d5-c4bd-480a-aa5c-979081db92bd admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:55.938148 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ce5d5-c4bd-480a-aa5c-979081db92bd admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:55.992103 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d849fb5-82e5-4545-9d3b-20f00f9651f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:55.992761 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d849fb5-82e5-4545-9d3b-20f00f9651f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:55.993058 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d849fb5-82e5-4545-9d3b-20f00f9651f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:55.993310 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d849fb5-82e5-4545-9d3b-20f00f9651f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:55.993990 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d849fb5-82e5-4545-9d3b-20f00f9651f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:55.995917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d849fb5-82e5-4545-9d3b-20f00f9651f1 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:56.070557 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1434/2876] 10.222.0.76 () {60 vars in 1143 bytes} [Mon May 16 15:33:55 2022] POST /identity/v3/users => generated 299 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:33:56.074676 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d910f5-a512-4d23-a057-4c577220928e admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:56.084681 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d910f5-a512-4d23-a057-4c577220928e admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:56.089428 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ca5f6-bd98-4a5e-8453-f99c7356cb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:56.090088 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ca5f6-bd98-4a5e-8453-f99c7356cb2d admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:56.090406 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ca5f6-bd98-4a5e-8453-f99c7356cb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:56.090690 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ca5f6-bd98-4a5e-8453-f99c7356cb2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:56.091420 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ca5f6-bd98-4a5e-8453-f99c7356cb2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:56.093037 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ca5f6-bd98-4a5e-8453-f99c7356cb2d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:56.103242 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1443/2877] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:33:56.106939 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d849fb5-82e5-4545-9d3b-20f00f9651f1 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:56.117079 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d849fb5-82e5-4545-9d3b-20f00f9651f1 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:56.121631 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5efb0a-5364-4814-b1e8-512258430bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:56.122322 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5efb0a-5364-4814-b1e8-512258430bca admin admin] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:56.122608 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5efb0a-5364-4814-b1e8-512258430bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:56.122886 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5efb0a-5364-4814-b1e8-512258430bca admin admin] PATH_INFO: `/v3/roles` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:56.123605 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5efb0a-5364-4814-b1e8-512258430bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:56.125190 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5efb0a-5364-4814-b1e8-512258430bca admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:56.135267 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1435/2878] 10.222.0.76 () {58 vars in 1121 bytes} [Mon May 16 15:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:33:56.138959 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ca5f6-bd98-4a5e-8453-f99c7356cb2d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:56.148445 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ca5f6-bd98-4a5e-8453-f99c7356cb2d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:56.153317 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c70c6-df65-4063-a30e-6242b9e4e31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:56.154194 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c70c6-df65-4063-a30e-6242b9e4e31e admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:56.154485 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c70c6-df65-4063-a30e-6242b9e4e31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:56.154794 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c70c6-df65-4063-a30e-6242b9e4e31e admin admin] PATH_INFO: `/v3/projects/a7cba8271f6f4a5cb58e67514be45ee6/users/ac4c0db5c9df4365b0de51a4ffecb4d2/roles/0e00f6ebfc2843a0992b3d01f50e262d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:56.171479 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c70c6-df65-4063-a30e-6242b9e4e31e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7cba8271f6f4a5cb58e67514be45ee6, user_id=ac4c0db5c9df4365b0de51a4ffecb4d2, role_id=0e00f6ebfc2843a0992b3d01f50e262d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:56.174353 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c70c6-df65-4063-a30e-6242b9e4e31e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:56.245453 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1444/2879] 10.222.0.76 () {60 vars in 1482 bytes} [Mon May 16 15:33:56 2022] PUT /identity/v3/projects/a7cba8271f6f4a5cb58e67514be45ee6/users/ac4c0db5c9df4365b0de51a4ffecb4d2/roles/0e00f6ebfc2843a0992b3d01f50e262d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:33:56.256482 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf705cc-bdc6-4581-8a9f-0ad2aa717380 None None] REQUEST_METHOD: `POST` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:56.256801 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf705cc-bdc6-4581-8a9f-0ad2aa717380 None None] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:56.257083 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf705cc-bdc6-4581-8a9f-0ad2aa717380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:56.282962 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.auth.core [None req-8cf705cc-bdc6-4581-8a9f-0ad2aa717380 None None] MFA Rules not processed for user `ac4c0db5c9df4365b0de51a4ffecb4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80320) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:33:56.284155 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-8cf705cc-bdc6-4581-8a9f-0ad2aa717380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:56.346602 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1436/2880] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:33:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:33:56.358220 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c70c6-df65-4063-a30e-6242b9e4e31e admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:33:56.359905 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-443c70c6-df65-4063-a30e-6242b9e4e31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:33:56.415241 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c70c6-df65-4063-a30e-6242b9e4e31e admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:33:56.419043 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc24bdf-17af-4454-bebf-e3bd19ad8c98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '496e1178104d468e9b7ce53ea754ec74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:33:56.419689 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc24bdf-17af-4454-bebf-e3bd19ad8c98 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:33:56.419974 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc24bdf-17af-4454-bebf-e3bd19ad8c98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:33:56.420255 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc24bdf-17af-4454-bebf-e3bd19ad8c98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:33:56.429424 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc24bdf-17af-4454-bebf-e3bd19ad8c98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:33:56.430904 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc24bdf-17af-4454-bebf-e3bd19ad8c98 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:33:56.439709 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1445/2881] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:33:56 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:34:05.334721 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf705cc-bdc6-4581-8a9f-0ad2aa717380 None None] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:34:05.395906 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf705cc-bdc6-4581-8a9f-0ad2aa717380 None None] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:34:05.400706 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350ba38-c783-4339-87bd-ec1857e305d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:34:05.401560 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350ba38-c783-4339-87bd-ec1857e305d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:34:05.401836 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350ba38-c783-4339-87bd-ec1857e305d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:34:05.402107 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350ba38-c783-4339-87bd-ec1857e305d0 admin admin] PATH_INFO: `/v3/users/ac4c0db5c9df4365b0de51a4ffecb4d2` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:34:05.403313 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350ba38-c783-4339-87bd-ec1857e305d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac4c0db5c9df4365b0de51a4ffecb4d2)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:34:05.405230 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350ba38-c783-4339-87bd-ec1857e305d0 admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:34:05.604001 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b350ba38-c783-4339-87bd-ec1857e305d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac4c0db5c9df4365b0de51a4ffecb4d2'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:34:05.693295 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b350ba38-c783-4339-87bd-ec1857e305d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac4c0db5c9df4365b0de51a4ffecb4d2'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:34:05.693917 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b350ba38-c783-4339-87bd-ec1857e305d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac4c0db5c9df4365b0de51a4ffecb4d2'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:34:05.706615 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b350ba38-c783-4339-87bd-ec1857e305d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac4c0db5c9df4365b0de51a4ffecb4d2'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:34:05.707263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-b350ba38-c783-4339-87bd-ec1857e305d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac4c0db5c9df4365b0de51a4ffecb4d2'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:34:05.719684 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1437/2882] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:34:05 2022] DELETE /identity/v3/users/ac4c0db5c9df4365b0de51a4ffecb4d2 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:34:05.724159 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269815e-c293-472b-bdca-41ce45c78019 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:34:05.724652 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269815e-c293-472b-bdca-41ce45c78019 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:34:05.724767 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269815e-c293-472b-bdca-41ce45c78019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:34:05.742187 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a269815e-c293-472b-bdca-41ce45c78019 None None] MFA Rules not processed for user `cfa3cc953e414bc0b20f729623352259`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:34:05.743381 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a269815e-c293-472b-bdca-41ce45c78019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:34:05.800247 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1446/2883] 10.222.0.76 () {58 vars in 957 bytes} [Mon May 16 15:34:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:34:05.809745 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350ba38-c783-4339-87bd-ec1857e305d0 admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:34:05.811166 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-b350ba38-c783-4339-87bd-ec1857e305d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:34:05.866397 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350ba38-c783-4339-87bd-ec1857e305d0 admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:34:05.870025 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3bd05-a9c7-4dbb-bb5a-fe800d5598af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:34:05.870697 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3bd05-a9c7-4dbb-bb5a-fe800d5598af service neutron] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:34:05.870981 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3bd05-a9c7-4dbb-bb5a-fe800d5598af service neutron] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:34:05.871255 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3bd05-a9c7-4dbb-bb5a-fe800d5598af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:34:05.880077 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3bd05-a9c7-4dbb-bb5a-fe800d5598af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:34:05.882008 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3bd05-a9c7-4dbb-bb5a-fe800d5598af service neutron] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:34:05.891484 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1438/2884] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:34:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:34:06.286426 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269815e-c293-472b-bdca-41ce45c78019 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:34:06.292003 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a269815e-c293-472b-bdca-41ce45c78019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:34:06.302649 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269815e-c293-472b-bdca-41ce45c78019 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:34:06.307319 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f4d2a-a2ba-4cd0-ab9c-fd45080c70f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:34:06.308687 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f4d2a-a2ba-4cd0-ab9c-fd45080c70f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:34:06.309174 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f4d2a-a2ba-4cd0-ab9c-fd45080c70f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:34:06.309454 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f4d2a-a2ba-4cd0-ab9c-fd45080c70f4 admin admin] PATH_INFO: `/v3/projects/a7cba8271f6f4a5cb58e67514be45ee6` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:34:06.310748 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f4d2a-a2ba-4cd0-ab9c-fd45080c70f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7cba8271f6f4a5cb58e67514be45ee6)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:34:06.312635 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f4d2a-a2ba-4cd0-ab9c-fd45080c70f4 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:34:06.562017 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fa0f4d2a-a2ba-4cd0-ab9c-fd45080c70f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7cba8271f6f4a5cb58e67514be45ee6', 'request_id': 'req-fa0f4d2a-a2ba-4cd0-ab9c-fd45080c70f4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:34:06.568384 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fa0f4d2a-a2ba-4cd0-ab9c-fd45080c70f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7cba8271f6f4a5cb58e67514be45ee6', 'request_id': 'req-fa0f4d2a-a2ba-4cd0-ab9c-fd45080c70f4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:34:06.639378 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fa0f4d2a-a2ba-4cd0-ab9c-fd45080c70f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7cba8271f6f4a5cb58e67514be45ee6', 'request_id': 'req-fa0f4d2a-a2ba-4cd0-ab9c-fd45080c70f4'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:34:06.651161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fa0f4d2a-a2ba-4cd0-ab9c-fd45080c70f4 admin admin] The token cache is being invalidate because project a7cba8271f6f4a5cb58e67514be45ee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:34:06.651451 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fa0f4d2a-a2ba-4cd0-ab9c-fd45080c70f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:34:06.652081 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fa0f4d2a-a2ba-4cd0-ab9c-fd45080c70f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:34:06.653632 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1447/2885] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:34:06 2022] DELETE /identity/v3/projects/a7cba8271f6f4a5cb58e67514be45ee6 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:35:05.398913 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3bd05-a9c7-4dbb-bb5a-fe800d5598af service neutron] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:35:05.400335 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-2fa3bd05-a9c7-4dbb-bb5a-fe800d5598af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:35:05.490175 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3bd05-a9c7-4dbb-bb5a-fe800d5598af service neutron] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:35:05.548413 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac0af5-ce52-416a-b66b-51c25180f6f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f231aa78ac84054b06a2126e1a11f31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:35:05.549055 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac0af5-ce52-416a-b66b-51c25180f6f1 service placement] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:35:05.549334 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac0af5-ce52-416a-b66b-51c25180f6f1 service placement] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:35:05.549606 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac0af5-ce52-416a-b66b-51c25180f6f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:35:05.551427 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-56ac0af5-ce52-416a-b66b-51c25180f6f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:35:05.562464 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac0af5-ce52-416a-b66b-51c25180f6f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:35:05.564043 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac0af5-ce52-416a-b66b-51c25180f6f1 service placement] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:35:05.573816 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1439/2886] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:35:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:35:17.564099 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f4d2a-a2ba-4cd0-ab9c-fd45080c70f4 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:35:17.565550 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fa0f4d2a-a2ba-4cd0-ab9c-fd45080c70f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:35:17.621184 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f4d2a-a2ba-4cd0-ab9c-fd45080c70f4 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:35:17.624951 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a756da-c6a7-40ee-9e91-b6dda4e4229c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ff90527ece4406be62f449bdf71d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:35:17.625626 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a756da-c6a7-40ee-9e91-b6dda4e4229c service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:35:17.626766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a756da-c6a7-40ee-9e91-b6dda4e4229c service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:35:17.626766 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a756da-c6a7-40ee-9e91-b6dda4e4229c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:35:17.628144 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f4a756da-c6a7-40ee-9e91-b6dda4e4229c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:35:17.687953 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a756da-c6a7-40ee-9e91-b6dda4e4229c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:35:17.689394 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a756da-c6a7-40ee-9e91-b6dda4e4229c service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:35:17.698754 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1448/2887] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:35:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:35:24.416804 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac0af5-ce52-416a-b66b-51c25180f6f1 service placement] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:35:24.418263 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-56ac0af5-ce52-416a-b66b-51c25180f6f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:35:24.431920 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac0af5-ce52-416a-b66b-51c25180f6f1 service placement] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:35:24.436468 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cc2be-667b-44a4-9ec5-a840fe791a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:35:24.437325 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cc2be-667b-44a4-9ec5-a840fe791a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:35:24.438252 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cc2be-667b-44a4-9ec5-a840fe791a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:35:24.438563 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cc2be-667b-44a4-9ec5-a840fe791a6a admin admin] PATH_INFO: `/v3/users/e916a70861fc44e69160faf793999f6d` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:35:24.439745 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cc2be-667b-44a4-9ec5-a840fe791a6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e916a70861fc44e69160faf793999f6d)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:35:24.441662 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cc2be-667b-44a4-9ec5-a840fe791a6a admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:35:24.609616 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-778cc2be-667b-44a4-9ec5-a840fe791a6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e916a70861fc44e69160faf793999f6d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:35:24.705191 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-778cc2be-667b-44a4-9ec5-a840fe791a6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e916a70861fc44e69160faf793999f6d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:35:24.705801 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-778cc2be-667b-44a4-9ec5-a840fe791a6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e916a70861fc44e69160faf793999f6d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:35:24.718008 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-778cc2be-667b-44a4-9ec5-a840fe791a6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e916a70861fc44e69160faf793999f6d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:35:24.718825 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-778cc2be-667b-44a4-9ec5-a840fe791a6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e916a70861fc44e69160faf793999f6d'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:35:24.731677 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1440/2888] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:35:24 2022] DELETE /identity/v3/users/e916a70861fc44e69160faf793999f6d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:35:24.969774 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a756da-c6a7-40ee-9e91-b6dda4e4229c service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:35:24.981106 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a756da-c6a7-40ee-9e91-b6dda4e4229c service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:35:25.038330 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab94178-22e0-4a6e-aed8-d527a7e018ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:35:25.039499 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab94178-22e0-4a6e-aed8-d527a7e018ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:35:25.039991 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab94178-22e0-4a6e-aed8-d527a7e018ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:35:25.040471 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab94178-22e0-4a6e-aed8-d527a7e018ed admin admin] PATH_INFO: `/v3/projects/bc74c97613c4462bb551e50800a5f5e2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:35:25.042610 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab94178-22e0-4a6e-aed8-d527a7e018ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc74c97613c4462bb551e50800a5f5e2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:35:25.046390 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab94178-22e0-4a6e-aed8-d527a7e018ed admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:35:25.158920 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8ab94178-22e0-4a6e-aed8-d527a7e018ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc74c97613c4462bb551e50800a5f5e2', 'request_id': 'req-8ab94178-22e0-4a6e-aed8-d527a7e018ed'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:35:25.165161 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8ab94178-22e0-4a6e-aed8-d527a7e018ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc74c97613c4462bb551e50800a5f5e2', 'request_id': 'req-8ab94178-22e0-4a6e-aed8-d527a7e018ed'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:35:25.238530 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8ab94178-22e0-4a6e-aed8-d527a7e018ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc74c97613c4462bb551e50800a5f5e2', 'request_id': 'req-8ab94178-22e0-4a6e-aed8-d527a7e018ed'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:35:25.248694 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8ab94178-22e0-4a6e-aed8-d527a7e018ed admin admin] The token cache is being invalidate because project bc74c97613c4462bb551e50800a5f5e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:35:25.248975 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8ab94178-22e0-4a6e-aed8-d527a7e018ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:35:25.249629 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8ab94178-22e0-4a6e-aed8-d527a7e018ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:35:25.251746 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1449/2889] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:35:24 2022] DELETE /identity/v3/projects/bc74c97613c4462bb551e50800a5f5e2 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:35:25.255757 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cc2be-667b-44a4-9ec5-a840fe791a6a admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:35:25.257174 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-778cc2be-667b-44a4-9ec5-a840fe791a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:35:25.270763 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cc2be-667b-44a4-9ec5-a840fe791a6a admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:35:25.324877 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b0c71-7075-4263-a110-c3b72158ec5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:35:25.325736 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b0c71-7075-4263-a110-c3b72158ec5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:35:25.326015 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b0c71-7075-4263-a110-c3b72158ec5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:35:25.326322 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b0c71-7075-4263-a110-c3b72158ec5e admin admin] PATH_INFO: `/v3/users/89fffe6b0a22490b81795b49d02c171b` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:35:25.327494 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b0c71-7075-4263-a110-c3b72158ec5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=89fffe6b0a22490b81795b49d02c171b)` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:35:25.330049 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b0c71-7075-4263-a110-c3b72158ec5e admin admin] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:35:25.497599 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-364b0c71-7075-4263-a110-c3b72158ec5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89fffe6b0a22490b81795b49d02c171b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:35:25.567839 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-364b0c71-7075-4263-a110-c3b72158ec5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89fffe6b0a22490b81795b49d02c171b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:35:25.568497 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-364b0c71-7075-4263-a110-c3b72158ec5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89fffe6b0a22490b81795b49d02c171b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:35:25.581232 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-364b0c71-7075-4263-a110-c3b72158ec5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89fffe6b0a22490b81795b49d02c171b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:35:25.581889 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.notifications [None req-364b0c71-7075-4263-a110-c3b72158ec5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89fffe6b0a22490b81795b49d02c171b'} {{(pid=80320) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:35:25.594229 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1441/2890] 10.222.0.76 () {58 vars in 1223 bytes} [Mon May 16 15:35:25 2022] DELETE /identity/v3/users/89fffe6b0a22490b81795b49d02c171b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:35:25.843886 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab94178-22e0-4a6e-aed8-d527a7e018ed admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:35:25.847346 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8ab94178-22e0-4a6e-aed8-d527a7e018ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:35:25.858175 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab94178-22e0-4a6e-aed8-d527a7e018ed admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:35:25.916962 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171cfcac-1b85-4363-a43e-7aa4cffb022c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfa3cc953e414bc0b20f729623352259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c01b64ed2e84249921cacc6ee5ef7ac', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:35:25.917821 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cfcac-1b85-4363-a43e-7aa4cffb022c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:35:25.918102 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cfcac-1b85-4363-a43e-7aa4cffb022c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:35:25.918404 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cfcac-1b85-4363-a43e-7aa4cffb022c admin admin] PATH_INFO: `/v3/projects/093f74506b6c4769ba1b72e49e46b02a` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:35:25.919581 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171cfcac-1b85-4363-a43e-7aa4cffb022c admin admin] RBAC: Authorizing `identity:delete_project(project_id=093f74506b6c4769ba1b72e49e46b02a)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:35:25.921494 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171cfcac-1b85-4363-a43e-7aa4cffb022c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:35:26.030968 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-171cfcac-1b85-4363-a43e-7aa4cffb022c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '093f74506b6c4769ba1b72e49e46b02a', 'request_id': 'req-171cfcac-1b85-4363-a43e-7aa4cffb022c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:35:26.037556 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-171cfcac-1b85-4363-a43e-7aa4cffb022c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '093f74506b6c4769ba1b72e49e46b02a', 'request_id': 'req-171cfcac-1b85-4363-a43e-7aa4cffb022c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:35:26.098879 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-171cfcac-1b85-4363-a43e-7aa4cffb022c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '093f74506b6c4769ba1b72e49e46b02a', 'request_id': 'req-171cfcac-1b85-4363-a43e-7aa4cffb022c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:35:26.109279 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-171cfcac-1b85-4363-a43e-7aa4cffb022c admin admin] The token cache is being invalidate because project 093f74506b6c4769ba1b72e49e46b02a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:35:26.109560 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-171cfcac-1b85-4363-a43e-7aa4cffb022c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:35:26.110797 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-171cfcac-1b85-4363-a43e-7aa4cffb022c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:35:26.112352 dv-cinder-790535-39-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1450/2891] 10.222.0.76 () {58 vars in 1232 bytes} [Mon May 16 15:35:25 2022] DELETE /identity/v3/projects/093f74506b6c4769ba1b72e49e46b02a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:40:29.892781 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b0c71-7075-4263-a110-c3b72158ec5e admin admin] Authenticating user token {{(pid=80320) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:40:29.894293 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-364b0c71-7075-4263-a110-c3b72158ec5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:40:29.967799 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b0c71-7075-4263-a110-c3b72158ec5e admin admin] Validating token access rules against request {{(pid=80320) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:40:30.022884 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a2ae1-7d98-4223-b773-9030413b9e14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f231aa78ac84054b06a2126e1a11f31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '681a6490f3c04f9fa2830cfde3deb2e9', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80320) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:40:30.023526 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a2ae1-7d98-4223-b773-9030413b9e14 service placement] REQUEST_METHOD: `GET` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:40:30.023803 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a2ae1-7d98-4223-b773-9030413b9e14 service placement] SCRIPT_NAME: `/identity` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:40:30.024072 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a2ae1-7d98-4223-b773-9030413b9e14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80320) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:40:30.026454 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.fernet_utils [None req-c39a2ae1-7d98-4223-b773-9030413b9e14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80320) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:40:30.037769 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a2ae1-7d98-4223-b773-9030413b9e14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:40:30.039382 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a2ae1-7d98-4223-b773-9030413b9e14 service placement] RBAC: Authorization granted {{(pid=80320) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:40:30.049033 dv-cinder-790535-39-iscsi devstack@keystone.service[80320]: [pid: 80320|app: 0|req: 1442/2892] 10.222.0.76 () {60 vars in 1365 bytes} [Mon May 16 15:40:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)